The Relation of Bayesian and Maximum Entropy Methods

  • E. T. Jaynes
Part of the Fundamental Theories of Physics book series (FTPH, volume 31-32)


Further progress in scientific inference must, in our view, come from some kind of unification of our present principles. As a prerequisite for this, we note briefly the great conceptual differences, and the equally great mathematical similarities, of Bayesian and Maximum Entropy methods.


Maximum Entropy Method Exploratory Phase Hypothesis Space Maximum Entropy Principle Good Performance Feature 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bretthorst, L. (1987), Ph.D. Thesis, Department of Physics, Washington University, St. Louis, Missouri.Google Scholar
  2. Jaynes, E. T. (1968), “Prior Probabilities”, IEEE Trans. Systems Sci. Cybern. SSC-4, 227–241 (1968). Reprinted in V. M. Rao Tummala and R. C. Henshaw, Eds., Concepts and Applications of Modern Decision Methods (Michigan State University Business Studies Series, 1976), and in Jaynes (1983).Google Scholar
  3. Jaynes, E. T. (1983), Papers on Probability, Statistics and Statistical Physics”, R. D. Rosenkrantz, Editor, D. Reidel Pub. Co., Dordrecht-Holland. Reprints of 14 papers dated 1957-1980.Google Scholar
  4. Jeffrey, R. C. (1983), The Logic of Decision, 2nd Edition, Univ. of Chicago Press.Google Scholar
  5. van Campenhout, J. & Cover, T. M. (1981), IEEE Trans. Inform. Theory IT-27, 483.Google Scholar
  6. Williams, P.M. (1980), “Bayesian Conditionalisation and the Principle of Minimum Information”, Brit. J. Phil. Sci. 31, 131–144. The same mathematical fact was noted by R. D. Rosenkrantz, Inference, Method and Decision, D. Reidel, Dordrecht-Holland (1977); 55–57.CrossRefGoogle Scholar
  7. Zellner, A. (1987), “Optimal Information Processing and Bayes’ Theorem” The American Statistician (to be published).Google Scholar

Copyright information

© Kluwer Academic Publishers 1988

Authors and Affiliations

  • E. T. Jaynes
    • 1
  1. 1.Arthur Holly Compton Laboratory of PhysicsWashington UniversitySt. LouisUSA

Personalised recommendations