Abstract
Measuring uncertainty/information. Binary search games. Uncertainty associated with probability distributions. Messages and alphabets. The Maximum Entropy Principle.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Applebaum, D.: Probability and Information: an Integrated Approach, 2nd edn. Cambridge University Press, Cambridge (2008)
Buck, B., MacAulay, V.A.: Maximum Entropy in Action: A Collection of Expository Essays. Oxford University Press, Oxford (1991)
Frieden, B.F.: Restoring with maximum likelihood and maximum entropy. J. Opt. Soc. Am. 62, 511–518 (1971)
Jaynes, E.T.: Probability Theory: The Logic of Science, sixth printing. Cambridge University Press, Cambridge (2007)
MacKay, D.J.C.: Information Theory, Inference and Learning Algorithms. Cambridge University Press, Cambridge (2003)
Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press, Cambridge (2007)
Shannon, C.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948)
Shannon, C., Weaver, W.: The Mathematical Theory of Communication. The University of Illinois Press, Champaign (1998)
Stone, J.V.: Information Theory: A Tutorial Introduction. Sebtel Press, Sheffield (2015)
Tribus, M., McIrvine, E.C.: Energy and Information. Sci. Am. 225(3), 179–190 (1971)
Willingale, R.: Use of the maximum entropy method in X-ray astronomy. MNRAS 194, 359–364 (1981)
Websites (all accessed March 2019):
MacKay Inference Group web page: http://www.inference.org.uk/mackay/
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Lawrence, A. (2019). Information, Uncertainty, and Surprise. In: Probability in Physics. Undergraduate Lecture Notes in Physics. Springer, Cham. https://doi.org/10.1007/978-3-030-04544-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-04544-9_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04542-5
Online ISBN: 978-3-030-04544-9
eBook Packages: Physics and AstronomyPhysics and Astronomy (R0)