Skip to main content

Information, Uncertainty, and Surprise

  • Chapter
  • First Online:
Probability in Physics

Part of the book series: Undergraduate Lecture Notes in Physics ((ULNP))

  • 2449 Accesses

Abstract

Measuring uncertainty/information. Binary search games. Uncertainty associated with probability distributions. Messages and alphabets. The Maximum Entropy Principle.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Applebaum, D.: Probability and Information: an Integrated Approach, 2nd edn. Cambridge University Press, Cambridge (2008)

    Google Scholar 

  • Buck, B., MacAulay, V.A.: Maximum Entropy in Action: A Collection of Expository Essays. Oxford University Press, Oxford (1991)

    Google Scholar 

  • Frieden, B.F.: Restoring with maximum likelihood and maximum entropy. J. Opt. Soc. Am. 62, 511–518 (1971)

    Article  ADS  Google Scholar 

  • Jaynes, E.T.: Probability Theory: The Logic of Science, sixth printing. Cambridge University Press, Cambridge (2007)

    Google Scholar 

  • MacKay, D.J.C.: Information Theory, Inference and Learning Algorithms. Cambridge University Press, Cambridge (2003)

    MATH  Google Scholar 

  • Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press, Cambridge (2007)

    Google Scholar 

  • Shannon, C.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948)

    Article  MathSciNet  Google Scholar 

  • Shannon, C., Weaver, W.: The Mathematical Theory of Communication. The University of Illinois Press, Champaign (1998)

    Google Scholar 

  • Stone, J.V.: Information Theory: A Tutorial Introduction. Sebtel Press, Sheffield (2015)

    Google Scholar 

  • Tribus, M., McIrvine, E.C.: Energy and Information. Sci. Am. 225(3), 179–190 (1971)

    Google Scholar 

  • Willingale, R.: Use of the maximum entropy method in X-ray astronomy. MNRAS 194, 359–364 (1981)

    Article  ADS  Google Scholar 

Websites (all accessed March 2019):

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andy Lawrence .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Lawrence, A. (2019). Information, Uncertainty, and Surprise. In: Probability in Physics. Undergraduate Lecture Notes in Physics. Springer, Cham. https://doi.org/10.1007/978-3-030-04544-9_11

Download citation

Publish with us

Policies and ethics