Abstract
This chapter is devoted to developing ergodic theorems first for relative entropy densities and then information densities for the general case of AMS processes with standard alphabets. The general results were first developed by Barron [9] using the martingale convergence theorem and a new martingale inequality. The similar results of Algoet and Cover [7] can be proved without direct recourse to martingale theory. They infer the result for the stationary Markov approximation and for the infinite order approximation from the ordinary ergodic theorem. They then demonstrate that the growth rate of the true density is asymptotically sandwiched between that for the kth order Markov approximation and the infinite order approximation and that no gap is left between these asymptotic upper and lower bounds in the limit as k → ∞. They use martingale theory to show that the values between which the limiting density is sandwiched are arbitrarily close to each other, but we shall see that this is not necessary and this property follows from the results of Chapter 6.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1990 Springer Science+Business Media New York
About this chapter
Cite this chapter
Gray, R.M. (1990). Ergodic Theorems for Densities. In: Entropy and Information Theory. Springer, New York, NY. https://doi.org/10.1007/978-1-4757-3982-4_8
Download citation
DOI: https://doi.org/10.1007/978-1-4757-3982-4_8
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4757-3984-8
Online ISBN: 978-1-4757-3982-4
eBook Packages: Springer Book Archive