Asymptotic Synchronization for Finite-State Sources
We extend a recent synchronization analysis of exact finite-state sources to nonexact sources for which synchronization occurs only asymptotically. Although the proof methods are quite different, the primary results remain the same. We find that an observer’s average uncertainty in the source state vanishes exponentially fast and, as a consequence, an observer’s average uncertainty in predicting future output converges exponentially fast to the source entropy rate.
KeywordsEntropy rate convergence Synchronization State estimation State uncertainty
Unable to display preview. Download preview PDF.
- 7.Shannon, C.E., Weaver, W.: The Mathematical Theory of Communication. University of Illinois Press, Champaign-Urbana (1962) Google Scholar
- 8.Massey, J.L.: Markov information sources. In: Skwirzynski, J.K. (ed.) New Directions in Signal Processing in Communication and Control. NATO Advanced Study Institutes Series, vol. E25, pp. 15–26. Noordhoff, Leyden (1975) Google Scholar