Skip to main content
SpringerLink
Log in

Entropy, Its Language, and Interpretation

  • Published:
Foundations of Physics Aims and scope Submit manuscript

Abstract

The language of entropy is examined for consistency with its mathematics and physics, and for its efficacy as a guide to what entropy means. Do common descriptors such as disorder, missing information, and multiplicity help or hinder understanding? Can the language of entropy be helpful in cases where entropy is not well defined? We argue in favor of the descriptor spreading, which entails space, time, and energy in a fundamental way. This includes spreading of energy spatially during processes and temporal spreading over accessible microstates states in thermodynamic equilibrium. Various examples illustrate the value of the spreading metaphor. To provide further support for this metaphor’s utility, it is shown how a set of reasonable spreading properties can be used to derive the entropy function. A main conclusion is that it is appropriate to view entropy’s symbol S as shorthand for spreading.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Čápek, V., Sheehan, D.P.: Challenges to the Second Law of Thermodynamics—Theory and Experiment. Springer, Dordrecht (2005)

    MATH  Google Scholar 

  2. Boltzmann, L.: Lectures on Gas Theory—Part I, pp. 441–443. Barth, Leipzig (1896), reprinted by University of California Press, Berkeley (1964)

    Google Scholar 

  3. Burgers, J.M.: Entropy and disorder. Br. J. Philos. Sci. 5, 70–71 (1954)

    Article  Google Scholar 

  4. Styer, D.F.: Insight into entropy. Am. J. Phys. 68, 1090–1096 (2000)

    Article  ADS  Google Scholar 

  5. Darrow, K.K.: The concept of entropy. Am. J. Phys. 12, 183–196 (1944)

    Article  ADS  Google Scholar 

  6. Bohren, C.F., Albrecht, B.A.: Atmospheric Thermodynamics, pp. 150–152. Oxford University Press, Oxford (1998)

    Google Scholar 

  7. Dingle, H.: Bull. Inst. Phys. 10, 218 (1959)

    Google Scholar 

  8. Wright, P.G.: Entropy and disorder. Contemp. Phys. 11, 581–588 (1970)

    Article  ADS  Google Scholar 

  9. Lambert, F.L.: Disorder—a cracked crutch for supporting entropy discussions. J. Chem. Ed. 79, 187–192 (2002), revised web version: http://www.entropysite.com/cracked_crutch.html. See also Lambert’s website, http://www.entropysite.com for related discussions

    Google Scholar 

  10. Gibbs, J.W.: The Scientific Papers of J. Willard Gibbs, vol. 1, p. 418. Constable, London (1906), reprinted by Dover, New York (1961)

    Google Scholar 

  11. Jaynes, E.T.: Information theory and statistical mechanics. Phys. Rev. 106, 620–630 (1957)

    Article  ADS  MathSciNet  Google Scholar 

  12. Baierlein, R.: Teaching the approach to thermodynamic equilibrium: some pictures that help. Am. J. Phys. 46, 1042–1045 (1978)

    Article  ADS  Google Scholar 

  13. Swanson, R.M.: Entropy measures amount of choice. J. Chem. Ed. 67, 206–208 (1990)

    Article  Google Scholar 

  14. Brissaud, J.B.: The meanings of entropy. Entropy 7, 68–96 (2005)

    Article  MathSciNet  MATH  ADS  Google Scholar 

  15. Clausius, R.: On the application of the theorem of the equivalence of transformations to the internal work of a mass of matter. Philos. Mag. 24, 81–97 (1862), Reprinted in Kestin, J. (ed.) The Second Law of Thermodynamics. Dowden, Hutchinson & Ross, Stroudsberg (1976)

    Google Scholar 

  16. Klein, M.J.: Gibbs on Clausius. Hist. Stud. Phys. Sci. 1, 127–149 (1969)

    Google Scholar 

  17. Denbigh, K.G.: The many faces of irreversibility. Br. J. Philos. Sci. 40, 501–518 (1989)

    Article  Google Scholar 

  18. Denbigh, K.G.: The Principles of Chemical Equilibrium. Cambridge University Press, Cambridge (1961), Sect. 1.7

    Google Scholar 

  19. Leff, H.S.: Thermodynamic entropy: the spreading and sharing of energy. Am. J. Phys. 64, 1261–1271 (1996)

    Article  ADS  MathSciNet  Google Scholar 

  20. Lambert, F.L.: Entropy is simple, qualitatively. J. Chem. Ed. 79, 1241–1246 (2002), revised web version: http://www.entropysite.com/entropy_is_simple/index.html

    Google Scholar 

  21. Gross, D.H.E.: Microcanonical Thermodynamics: Phase Transitions in ‘Small’ Systems. World Scientific, Singapore (2001)

    Google Scholar 

  22. Leff, H.S.: What if entropy were dimensionless? Am. J. Phys. 67, 1114–1122 (1999)

    Article  ADS  MathSciNet  Google Scholar 

  23. Falk, H.: Physica 29, 1114 (1963)

    Article  MathSciNet  Google Scholar 

  24. Baierlein, R.: Forces, uncertainty, and the Gibbs entropy. Am. J. Phys. 36, 625–629 (1968)

    Article  ADS  Google Scholar 

  25. Leff, H.S.: Entropy differences between ideal and nonideal systems. Am. J. Phys. 37, 548–553 (1969)

    Article  ADS  Google Scholar 

  26. Bruch, L.W., Schick, M., Siddon, R.L.: Limitation on the quantum-mechanical extension of Baierlein’s entropy theorem. Am. J. Phys. 44, 1007–1008 (1976)

    Article  ADS  Google Scholar 

  27. Leff, H.S.: Teaching the photon gas in introductory physics. Am. J. Phys. 70, 792–797 (2002)

    Article  ADS  Google Scholar 

  28. Anderson, M.H., Ensher, J.R., Matthews, M.R., Wieman, C.E., Cornell, E.A.: Observation of Bose–Einstein condensation in a dilute atomic vapor. Science 269, 198–201 (1995)

    Article  ADS  Google Scholar 

  29. Pathria, R.K.: Statistical Mechanics, 2nd edn. Butterworth–Heinemann, Oxford (1996), Chaps. 7, 8

    MATH  Google Scholar 

  30. Goussard, J., Roulet, B.: Free expansion for real gases. Am. J. Phys. 61, 845–848 (1993)

    Article  ADS  Google Scholar 

  31. Lesk, A.M.: Entropy changes in isothermal expansions of real gases. Am. J. Phys. 42, 1030–1033 (1974)

    Article  ADS  Google Scholar 

  32. Leff, H.S.: Entropy changes in real gases and liquids. Am. J. Phys. 43, 1098–1100 (1975)

    Article  ADS  Google Scholar 

  33. Landauer, R.: Irreversibility and heat generation in the computing process. IBM J. Res. Dev. 5, 183–191 (1961)

    Article  MathSciNet  MATH  Google Scholar 

  34. Szilard, L.: On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings. Z. Phys. 53, 840–856 (1929)

    Article  ADS  Google Scholar 

  35. Feld, B.T., Weiss Szilard, G.: The Collected Works of Leo Szilard: Scientific Papers. pp. 103–129. MIT Press, Cambridge (1972), English translation is by A. Rapoport and M. Knoller

    Google Scholar 

  36. Wheeler, J.A., Zurek, W.H.: Quantum Theory and Measurement, pp. 539–548. Princeton University Press, Princeton (1983)

    Google Scholar 

  37. Leff, H.S., Rex, A.F. (eds.): Maxwell’s Demon 2: Entropy, Classical and Quantum Information, Computing. Institute of Physics, Bristol (2003), now distributed by Taylor & Francis

    Google Scholar 

  38. Penrose, O.: Foundations of Statistical Mechanics, pp. 221–238. Pergamon, Oxford (1970)

    MATH  Google Scholar 

  39. Bennett, C.H.: The thermodynamics of computation—a review. Int. J. Theor. Phys. 21, 905–940 (1982), reprinted in Ref. [37]

    Article  Google Scholar 

  40. Zurek, W.H.: Algorithmic randomness and physical entropy. Phys. Rev. 40, 4731–4751 (1989)

    Article  ADS  MathSciNet  Google Scholar 

  41. Earman, J., Norton, J.D.: Exorcist XIV: the wrath of Maxwell’s demon, part I: from Maxwell to Szilard. Studies Hist. Philos. Mod. Phys. 29, 435–471 (1998)

    Article  MathSciNet  Google Scholar 

  42. Earman, J., Norton, J.D.: Exorcist XIV: the wrath of Maxwell’s demon, part II: from Szilard to Landauer and beyond. Studies Hist. Philos. Mod. Phys. 30, 1–40 (1999)

    Article  MathSciNet  Google Scholar 

  43. Allahverdyan, A.E., Nieuwenhuizen, T.M.: Breakdown of the Landauer bound for information erasure in the quantum regime. Phys. Rev. E 64, 0561171–0561179 (2001)

    Article  Google Scholar 

  44. Allahverdyan, A.E., Nieuwenhuizen, T.M.: Testing the violation of the Clausius inequality in nanoscale electric circuits. Phys. Rev. B 66, 1153091–1153095 (2002)

    Article  Google Scholar 

  45. Allahverdyan, A.E., Balian, R., Nieuwenhuizen, T.M.: Thomson’s formulation of the second law: an exact theorem and limits of its validity. In: Sheehan, D.P. (ed.) Quantum Limits to the Second Law. AIP Conference Proceedings, vol. 643. American Institute of Physics, New York (2002)

    Google Scholar 

  46. Allahverdyan, A.E., Nieuwenhuizen, T.M.: Unmasking Maxwell’s demon. In: Sheehan, D.P. (ed.) Quantum Limits to the Second Law. AIP Conference Proceedings, vol. 643. American Institute of Physics, New York (2002)

    Google Scholar 

  47. Nieuwenhuizen, T.M., Allahverdyan, A.E.: Quantum Brownian motion and its conflict with the second law. In: Sheehan, D.P. (ed.) Quantum Limits to the Second Law. AIP Conference Proceedings, vol. 643. American Institute of Physics, New York (2002)

    Google Scholar 

  48. Schneider, E.D., Sagan, D.: Into the Cool: Energy Flow, Thermodynamics, and Life. University of Chicago Press, Chicago (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Physics, California State Polytechnic University, 3801 W. Temple Ave., Pomona, CA, 91768, USA

    Harvey S. Leff

Authors
  1. Harvey S. Leff
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Harvey S. Leff.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Leff, H.S. Entropy, Its Language, and Interpretation. Found Phys 37, 1744–1766 (2007). https://doi.org/10.1007/s10701-007-9163-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10701-007-9163-3

Keywords

Search

Navigation