On the Five-Moment Hamburger Maximum Entropy Reconstruction
We consider the Maximum Entropy Reconstruction (MER) as a solution to the five-moment truncated Hamburger moment problem in one dimension. In the case of five monomial moment constraints, the probability density function (PDF) of the MER takes the form of the exponential of a quartic polynomial. This implies a possible bimodal structure in regions of moment space. An analytical model is developed for the MER PDF applicable near a known singular line in a centered, two-component, third- and fourth-order moment (\(\mu _3\), \(\mu _4\)) space, consistent with the general problem of five moments. The model consists of the superposition of a perturbed, centered Gaussian PDF and a small-amplitude packet of PDF-density, called the outlying moment packet (OMP), sitting far from the mean. Asymptotic solutions are obtained which predict the shape of the perturbed Gaussian and both the amplitude and position on the real line of the OMP. The asymptotic solutions show that the presence of the OMP gives rise to an MER solution that is singular along a line in (\(\mu _3\), \(\mu _4\)) space emanating from, but not including, the point representing a standard normal distribution, or thermodynamic equilibrium. We use this analysis of the OMP to develop a numerical regularization of the MER, creating a procedure we call the Hybrid MER (HMER). Compared with the MER, the HMER is a significant improvement in terms of robustness and efficiency while preserving accuracy in its prediction of other important distribution features, such as higher order moments.
KeywordsMaximum entropy closure Moments Five-moment reconstruction
Mathematics Subject Classification00-01 99-00
This research was partially supported by the National Science Foundation under Award Number: DMS-1418903.
- 4.Bourgault, F., Makarenko, A.A., Williams, S.B., Grocholsky, B., Durrant-Whyte, H.F.: Information based adaptive robotic exploration. In: IEEE/RSJ IEEE International Conference on Intelligent Robots and Systems, vol. 1, pp. 540–545 (2002)Google Scholar
- 7.Bird, G.: Molecular Gas Dynamics and the Direct Simulation of Gas Flows. Clarendon Press, Oxford (1994)Google Scholar
- 9.Jaynes, E.T., Bretthorst, G.L.: Probability Theory: The Logic of Science, vol. 200. Cambridge University Press, Cambridge (1996)Google Scholar
- 10.Jaynes, E.: The relation of Bayesian and maximum entropy methods. Maximum-Entropy and Bayesian Methods in Science and Engineering. Springer, Berlin (1988)Google Scholar
- 15.McDonald, J.G., Groth, C.P.: Numerical solution of maximum-entropy-based hyperbolic moment closures for the prediction of viscous heat-conducting gaseous flows. In: Kuzmin, A. (ed.) Computational Fluid Dynamics 2010: Proceedings of the Sixth International Conference on Computational Fluid Dynamics, ICCFD6, St Petersburg, Russia, 12–16 July 2010, pp. 653–659. Springer, Berlin (2011)Google Scholar
- 16.Aheizer, N.I., Kemmer, N.: The Classical Moment Problem and Some Related Questions in Analysis. Oliver & Boyd, Edinburgh (1965)Google Scholar
- 21.Tribus, M.: Chapter Five: the principle of maximum entropy. In: Tribus, M. (ed.) Rational Descriptions, Decisions and Designs. Pergamon Press, New York (1969)Google Scholar