Abstract
The objective of this paper is to show how some basic informational quality measures (such as entropy and relative entropy / Kullback divergence) of stochastic dynamical systems depend on the system properties and characteristics of the external/internal randomness. First, the Shannon entropy flow in dynamic systems with random initial states is considered with emphasis on the effects of the system properties. Next, we quantify the influence of random external noise as well as the parametric randomness on the entropy and on the Kullback-Leibler relative entropy of the system. The analysis is illustrated by specific dynamical systems for which the entropy change in time is presented graphically.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barron, A.R., Shen, C.-H.: Approximation of the density functions by sequences of exponential families. Annals of Statistics 19(3), 1347–1369 (1991)
Cover, T.M., Thomas, J.A.: Elements of Information Theory. John Wiley, New York (1991)
Ebeling, W.: Entropy and information in processes of self-organization: uncertainty and predictability. Physica A 194, 563–575 (1993)
Garbaczewski, P.: Entropy methods in random motion. Journal of Statistical Physics 123, 315–355 (2006)
Haken, H.: Information and Self-Organization. Springer, Berlin (1988)
Lasota, A., Mackey, M.C.: Chaos, Fractals, and Noise. Springer, New York (1994)
Lin, Y.K., Cai, G.Q.: Probabilistic Structural Dynamics: Advanced Theory and Applications. McGraw-Hill, New York (1995)
Munakata, T., Igarashi, A.: Entropy and entropy production in simple stochastic models. Physical Review E 57(2), 1403–1409 (1998)
Nemytskii, V.V., Stepanov, V.V.: Qualitative Theory of Differential Equations. Princeton University Press, Princeton (1960)
Sissingh, G.J.: Dynamics of rotors operating on high advance ratios. Journal of Helicopter Society 13, 56–63 (1968)
Sobczyk, K.: Stochastic Differential Equations with Applications to Physics and Engineering. Kluwer, Dordrecht (1991)
Sobczyk, K.: Information dynamics: premises, challenges and results. Mechanical Systems & Signal Processing 15(3), 475–498 (2001)
Sobczyk, K., Hołobut, P. Information-theoretic approach to dynamics of stochastic systems (to be published)
Sobczyk, K., Trębicki, J.: Maximum entropy principle and nonlinear stochastic oscillators. Physica A 193, 448–468 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Netherlands
About this paper
Cite this paper
Sobczyk, K., Hołobut, P. (2011). On Information/Entropy Flow in Stochastic Dynamical Systems. In: Zhu, W.Q., Lin, Y.K., Cai, G.Q. (eds) IUTAM Symposium on Nonlinear Stochastic Dynamics and Control. IUTAM Bookseries, vol 29. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0732-0_10
Download citation
DOI: https://doi.org/10.1007/978-94-007-0732-0_10
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-0731-3
Online ISBN: 978-94-007-0732-0
eBook Packages: EngineeringEngineering (R0)