Classical Dynamics, Measurement, and Information

Part of the Springer Theses book series (Springer Theses)


In this chapter, we review the basic concepts in the classical information theory [1, 2], which is needed to quantitatively discuss the relationship between thermodynamics and information. First, we formulate stochastic dynamics in classical systems. Second, we introduce the basic quantities in the classical information theory: the Shannon information, the Kullback–Leibler divergence (the relative entropy), and the mutual information. Third, we discuss classical measurement theory with stochastic errors by using the information theory. We illustrate three typical examples of classical measurements.


Mutual Information Discrete Variable Relative Entropy Shannon Entropy Stochastic Dynamic 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    C. Shannon, Bell Syst. Tech. J. 27, 379–423 and 623–656 (1948).Google Scholar
  2. 2.
    T.M. Cover, J.A. Thomas, Elements of Information Theory (Wiley, New York, 1991)MATHCrossRefGoogle Scholar
  3. 3.
    S. Kullback, R.A. Leibler, Ann. Math. Stat. 22, 79 (1951)MathSciNetMATHCrossRefGoogle Scholar
  4. 4.
    T. Sagawa, Prog. Theor. Phys. 127, 1 (2012)ADSMATHCrossRefGoogle Scholar

Copyright information

© Springer Japan 2012

Authors and Affiliations

  1. 1.Kyoto UniversityKyotoJapan

Personalised recommendations