Skip to main content

A Brief Touch on Information Theory\(^*\)

  • Chapter
  • First Online:
Statistical Physics for Electrical Engineering
  • 1198 Accesses

Abstract

Our last topic in this book consists of a very brief description on the relation between statistical physics and information theory, a research field pioneered by Claude Elwood Shannon (1916–2001), whose seminal paper “A Mathematical Theory of communications” (1948) has established the corner–stone of this field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 84.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. N. Merhav, Statistical physics and information theory. Found. Trends Commun. Inf. Theory 6(1–2), 1–212 (2009)

    MATH  Google Scholar 

  2. H. Reiss, Thermodynamic-like transformations in information theory. J. Stat. Phys. 1(1), 107–131 (1969)

    Article  MathSciNet  Google Scholar 

  3. H. Reiss, C. Huang, Statistical thermodynamic formalism in the solution of information theory problems. J. Stat. Phys. 3(2), 191–211 (1971)

    Article  MathSciNet  Google Scholar 

  4. M. Mézard, A. Montanari, Information, Physics, and Computation (Oxford University Press, Oxford, 2009)

    Book  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Neri Merhav .

Rights and permissions

Reprints and permissions

Copyright information

© 2018 The Author(s)

About this chapter

Cite this chapter

Merhav, N. (2018). A Brief Touch on Information Theory\(^*\) . In: Statistical Physics for Electrical Engineering. Springer, Cham. https://doi.org/10.1007/978-3-319-62063-3_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-62063-3_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-62062-6

  • Online ISBN: 978-3-319-62063-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics