# Gaussian Distributions and the Heat Equation

• Gregory S. Chirikjian
Chapter
Part of the Applied and Numerical Harmonic Analysis book series (ANHA)

## Abstract

In this chapter the Gaussian distribution is defined and its properties are explored. The chapter starts with the definition of a Gaussian distribution on the real line. In the process of exploring the properties of the Gaussian on the line, the Fourier transform and heat equation are introduced, and their relationship to the Gaussian is developed. The Gaussian distribution in multiple dimensions is defined, as are clipped and folded versions of this distribution. Some concepts from probability and statistics such as mean, variance, marginalization, and conditioning of probability densities are introduced in a concrete way using the Gaussian as the primary example. The properties of the Gaussian distribution are fundamental to understanding the concept of white noise, which is the driving process for all of the stochastic processes studied in this book. The main things to take away from this chapter are: To become familiar with the Gaussian distribution and its properties, and to be comfortable in performing integrals involving multi-dimensional Gaussians; To become acquainted with the concepts of mean, covariance, and informationtheoretic entropy; To understand how to marginalize and convolve probability densities, to compute conditional densities, and to fold and clip Gaussians; To observe that there is a relationship between Gaussian distributions and the heat equation; To know where to begin if presented with a diffusion equation, the symmetries of which are desired.

## Keywords

Heat Equation Real Line Multivariate Gaussian Distribution Marginal Density Symmetry Analysis
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

## References

1. 1.
Benedetto, J.J., Zimmermann, G., “Sampling multipliers and the Poisson summation formula,” J. Fourier Anal. Appl., 3, pp. 505–523, 1997.
2. 2.
Bluman, G., Construction of Solutions to Partial Differential Equations by the Use of Transformation Groups, PhD Dissertation, Caltech, 1967.Google Scholar
3. 3.
Bluman, G., Cole, J., “The general similarity solution of the heat equation,” J. Math. Mech., 18, pp. 1025–1042, 1969.
4. 4.
Bluman, G., Cole, J., Similarity Methods for Differential Equations, Springer-Verlag, New York, 1974.
5. 5.
Boyer, C., “The maximal kinematical invariance group for an arbitrary potential,” Helv. Phys. Acta, 47, pp. 589–605, 1974.
6. 6.
Bracewell, R.N., The Fourier Transform and Its Applications, 2nd ed., McGraw-Hill, New York, 1986.Google Scholar
7. 7.
Burrus, C.S., Parks, T.W., DFT/FFT and Convolution Algorithms, John Wiley and Sons, New York, 1985.Google Scholar
8. 8.
Chirikjian, G.S., Kyatkin, A.B., Engineering Applications of Noncommutative Harmonic Analysis, CRC Press, Boca Raton, FL, 2001.
9. 9.
Chirikjian, G.S., “A methodology for determining mechanical properties of macromolecules from ensemble motion data,” Trends Anal. Chem., pp. 22, 549–553, 2003.
10. 10.
Cooley, J.W., Tukey, J., “An algorithm for the machine calculation of complex Fourier series,” Math. Comput., 19, pp. 297–301, 1965.
11. 11.
Fourier, J.B.J., Théorie Analytique de la Chaleur, F. Didot, Paris, 1822.Google Scholar
12. 12.
Gray, A., Tubes, 2nd ed., Birkhäuser, Boston, 2004.Google Scholar
13. 13.
Kalnins, E., Miller, W., Jr., “Symmetry and separation of variables for the heat equation,” Proc. Conf. on Symmetry, Similarity and Group-Theoretic Methods in Mechanics, pp. 246–261, University of Calgary, Calgary, Canada, 1974.Google Scholar
14. 14.
Kalnins, E., Miller, W., Jr., “Lie theory and separation of variables 4: The groups SO(2, 1) and SO(3),” J. Math. Phys., 15, pp. 1263–1274, 1974.
15. 15.
Körner, T.W., Fourier Analysis, Cambridge University Press, London, 1988 (reprinted 1993).
16. 16.
Lie, S., “Über die Integration durch bestimmte Integral von einer Klasse linearer partieller Differentialgleichungen,” Arch. Math., 4(3), Kristiana, p. 328, 1881.Google Scholar
17. 17.
Miller, W., Jr., Symmetry and Separation of Variables, Encyclopedia of Mathematics and Its Applications, Vol. 4, G.-C. Rota, ed., Addison-Wesley, Reading MA, 1974.Google Scholar
18. 18.
Olver, P.J., Applications of Lie Groups to Differential Equations, Springer-Verlag, New York, 1986.
19. 19.
Ovsiannikov, L.V., Group Analysis of Differential Equations, Academic Press, New York, 1982.
20. 20.
Patera, J., Winternitz, P., “A new basis for the representations of the rotation group: Lamé and Heun polynomials,” J. Math. Phys., 14, pp. 1130–1139, 1973.
21. 21.
Poluyanov, L.V., Aguilar, A., González, M., Group Properties of the Acoustic Differential Equation, Taylor & Francis, London, 1995.Google Scholar
22. 22.
Rényi, A., Probability Theory, North-Holland, Amsterdam, 1970.Google Scholar
23. 23.
Shannon, C.E., “A mathematical theory of communication,” Bell Syst. Tech. J., 27, pp. 379–423 and 623–656, July and October, 1948.
24. 24.
Van Loan, C., Computational Frameworks for the Fast Fourier Transform, SIAM, Philadelphia, 1992.
25. 25.
Weisner, L., “Group-theoretic origin of certain generating functions,” Pacific J. Math., 5, pp. 1033–1039, 1955.
26. 26.
Weisner, L., “Generating functions for Hermite functions,” Can. J. Math., 11, pp. 141–147, 1959.
27. 27.
Weisner, L., “Generating functions for Bessel functions,” Can. J. Math., 11, pp. 148–155, 1959.
28. 28.
Winternitz, P., Fris, I., “Invariant expansions of relativistic amplitudes and subgroups of the proper Lorentz group,” Soviet Physics JNP, 1, pp. 636–643, 1965.