Skip to main content

Elementary Statistical Physics

  • Chapter
  • First Online:
Statistical Physics for Electrical Engineering
  • 1226 Accesses

Abstract

In this chapter, we provide the formalism and the elementary background in statistical physics. We first define the basic postulates of statistical mechanics, and then define various ensembles. Finally, we shall derive some of the thermodynamic potentials and their properties, as well as the relationships among them. The important laws of thermodynamics will also be pointed out.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 84.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    This is a result of the energy conservation law along with the fact that probability mass behaves like an incompressible fluid in the sense that whatever mass that flows into a certain region from some direction must be equal to the outgoing flow from some other direction. This is reflected in the equation of continuity, which was demonstrated earlier.

  2. 2.

    For example, in the case of an ideal gas, \(\mathcal{E}({{\varvec{x}}})=\sum _{i=1}^N\Vert \vec {p}_i\Vert ^2/(2m)\), where m is the mass of each molecule, namely, it accounts for the contribution of the kinetic energies only. In more complicated situations, there might be additional contributions of potential energy, which depend on the positions.

  3. 3.

    In the example of the ideal gas, since the particles are mobile and since they have no colors and no identity certificates, there is no distinction between a state where particle no. 15 has position \(\vec {r}\) and momentum \(\vec {p}\) while particle no. 437 has position \(\vec {r}'\) and momentum \(\vec {p}'\) and a state where these two particles are swapped.

  4. 4.

    This argument works for distinguishable particles. Later on, a more general argument will be presented, that holds for indistinguishable particles too.

  5. 5.

    Here and in the sequel, the reader might wonder about the meaning of taking derivatives of, and with respect to, integer valued variables, like the number of dislocated particles, n. To this end, imagine an approximation where n is interpolated to be a continuous valued variable.

  6. 6.

    Heat is a form of energy that is transferred neither by mechanical work nor by matter. It is the type of energy that flows spontaneously from a system/body at a higher temperature to one with a lower temperature (and this transfer is accompanied by an increase in the total entropy).

  7. 7.

    In this context, it should be understood that the results we derived for the ideal gas hold only for high enough temperatures: since S was found proportional to \(\ln E\) and E is proportional to T, then S is proportional to \(\ln T\), but this cannot be true for small T as it contradicts (among other things) the third law.

  8. 8.

    Equality of chemical potentials is, in fact, the general principle of chemical equilibrium, and not equality of concentrations or densities. In Sect. 1.3, we saw equality of densities, because in the case of the ideal gas, the chemical potential is a function of the density, so equality of chemical potentials happens to be equivalent to equality of densities in this case.

  9. 9.

    The origin of this name comes from the wave–particle de Broglie relation \(\lambda =h/p\) together with the fact that the denominator, \(\sqrt{2\pi mkT}\), can be viewed as a notion of thermal momentum of the ideal gas, given the fact that the average molecular speed is proportional to \(\sqrt{kT/m}\) (see Sect. 1.1).

  10. 10.

    This is related to the concavity of \(s(\epsilon )\) [3, 4].

  11. 11.

    Since the term \(\lambda \cdot L({{\varvec{x}}})\) is not considered part of the internal energy (but rather an external energy resource), formally, this ensemble is no longer the canonical ensemble, but a somewhat different ensemble, called the Gibbs ensemble, which will be discussed later on.

  12. 12.

    At this point, there is a distinction between the Helmholtz free energy and the Gibbs free energy. The former is defined as \(F=E-TS\) in general, as mentioned earlier. The latter is defined as \(G=E-TS-\lambda L=-kT\ln Z\), where L is shorthand notation for \(\langle L({{\varvec{x}}}) \rangle \) (the quantity \(H=E-\lambda L\) is called the enthalpy). The physical significance of the Gibbs free energy is similar to that of the Helmholtz free energy, except that it refers to the total work of all other external forces in the system (if there are any), except the work contributed by the force \(\lambda \) (Exercise 2.4 show this!). The passage to the Gibbs ensemble, which replaces a fixed value of \(L({{\varvec{x}}})\) (say, constant volume of a gas) by the control of the conjugate external force \(\lambda \), (say, pressure in the example of a gas) can be carried out by another Legendre–Fenchel transform (see, e.g., [5, Sect. 1.14]) as well as Sect. 2.2.3 in the sequel.

  13. 13.

    More precisely, the one–dimensional Legendre–Fenchel transform of a real function f(x) is defined as \(g(y)=\sup _x[xy-f(x)]\). If f is convex, it can readily be shown that: (i) The inverse transform has the very same form, i.e., \(f(x)=\sup _y[xy-g(y)]\), and (ii) The derivatives \(f'(x)\) and \(g'(y)\) are inverses of each other.

  14. 14.

    Note that the expected number of ‘activated’ particles \(\langle n \rangle =NP(1)=Ne^{-\beta \epsilon _0}/(1+e^{-\beta \epsilon _0})=N/(e^{\beta \epsilon _0}+1)\), in agreement with the result of Example 2.1 (Eq. (2.2.17)). This demonstrates the ensemble equivalence principle.

  15. 15.

    The best way to understand this is in analogy to the derivation of \(\epsilon ^*\) as the minimizer of the free energy in the canonical ensemble, except that now the ‘big’ extensive variable is V rather than N, so that \(z^NZ_N(\beta ,V)\) is roughly exponential in V for a given fixed \(\rho =N/V\). The exponential coefficient depends on \(\rho \), and the ‘dominant’ \(\rho ^*\) maximizes this coefficient. Finally, the ‘dominant’ N is \(N^*=\rho ^*V\).

  16. 16.

    Exercise 2.5 Write explicitly the Legendre–Fenchel relation (and its inverse) between the Gibbs partition function and the canonical partition function.

References

  1. N. Merhav, Statistical physics and information theory. Found. Trends Commun. Inf. Theory 6(1–2), 1–212 (2009)

    MATH  Google Scholar 

  2. L.D. Landau, E.M. Lifshitz, Course of Theoretical Physics – Volume 5: Statistical Physics, Part 1, 3rd edn. (Elsevier: Butterworth–Heinemann, New York, 1980)

    Google Scholar 

  3. J. Barré, D. Mukamel, S. Ruffo, Inequivalence of ensembles in a system with long-range interactions. Phys. Rev. Lett. 87(3), 030601 (2001)

    Google Scholar 

  4. D. Mukamel, Statistical mechanics of systems with long range interactions, in AIP Conference Proceedings, vol. 970, no. 1, ed. by A. Campa, A. Giansanti, G. Morigi, F. Sylos Labini (AIP, 2008), pp. 22–38

    Google Scholar 

  5. R. Kubo, Statistical Mechanics (North-Holland, New York, 1965)

    Google Scholar 

  6. M.J.W. Hall, Universal geometric approach to uncertainty, entropy, and information. Phys. Rev. A 59(4), 2602–2615 (1999)

    Article  MathSciNet  Google Scholar 

  7. R.S. Ellis, Entropy, Large Deviations, and Statistical Mechanics (Springer, New York, 1985)

    Book  MATH  Google Scholar 

  8. A.H.W. Beck, Statistical Mechanics, Fluctuations and Noise (Edward Arnold Publishers, London, 1976)

    Google Scholar 

  9. K. Huang, Statistical Mechanics, 2nd edn. (Wiley, New York, 1987)

    MATH  Google Scholar 

  10. J. Honerkamp, Statistical Physics - An Advanced Approach with Applications, 2nd edn. (Springer, Berlin, 2002)

    MATH  Google Scholar 

  11. R.K. Pathria, Statistical Mechanics, 2nd edn. (Elsevier: Butterworth-Heinemann, Oxford, 1996)

    MATH  Google Scholar 

  12. F. Reif, Fundamentals of Statistical and Thermal Physics (McGraw-Hill, New York, 1965)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Neri Merhav .

Rights and permissions

Reprints and permissions

Copyright information

© 2018 The Author(s)

About this chapter

Cite this chapter

Merhav, N. (2018). Elementary Statistical Physics. In: Statistical Physics for Electrical Engineering. Springer, Cham. https://doi.org/10.1007/978-3-319-62063-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-62063-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-62062-6

  • Online ISBN: 978-3-319-62063-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics