The Axioms of Maximum Entropy
Maximum entropy is presented as a universal method of finding a “best” positive distribution constrained by incomplete data. The generalised entropy ∑(f - m - f log(f/m))) is the only form which selects acceptable distributions f in particular cases. It holds even if f is not normalised, so that maximum entropy applies directly to physical distributions other than probabilities. Furthermore, maximum entropy should also be used to select “best” parameters if the underlying model m has such freedom.
KeywordsMaximum Entropy Variational Equation Maximum Entropy Method Positive Distribution Entropy Formula
Unable to display preview. Download preview PDF.
- Gull, S.F. & Skilling, J. (1984). The maximum entropy method. In Indirect imaging, ed. J.A. Roberts. Cambridge: Cambridge University Press.Google Scholar
- Jaynes, E.T. (1984). Monkeys, Kangaroos and N. Presented at fourth maximum entropy workshop, Calgary, ed. J.H. Justice, Dordrecht: Reidel.Google Scholar
- Livesey, A.K. & Skilling, J. (1985). Maximum entropy theory Acta Cryst., A41, 113–122.Google Scholar