Abstract
The concept of the value of information , introduced in this chapter, connects Shannon’s information theory with statistical decision theory. In the latter theory, the most basic is the notion of average cost or risk, which characterizes the quality of decisions being made. The value of information can be described as the maximum benefit that can be gained in the process of minimizing the average cost with the help of a given amount of information. Such a definition of the value of information turns out to be related to the formulation and the solution of certain conditional variational problems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Berger, T.: Rate Distortion Theory. A Mathematical Basis for Data Compression. Prentice Hall, Englewood Cliffs (1971)
Kolmogorov, A.N.: Theory of transmission of information. In: USSR Academy of Sciences Session on Scientific Problems Related to Production Automation. USSR Academy of Sciences, Moscow (1957, in Russian)
Kolmogorov, A.N.: Theory of transmission of information (translation from Russian). Am. Math. Soc. Translat. Ser. 2(33) (1963)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948)
Shannon, C.E.: Certain results in coding theory for noisy channels. Inform. Control 1(1) (1957)
Shannon, C.E.: Certain results in coding theory for noisy channels (translation to Russian). In: R.L. Dobrushin, O.B. Lupanov (eds.) Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow (1963)
Shannon, C.E.: A mathematical theory of communication (translation to Russian). In: R.L. Dobrushin, O.B. Lupanov (eds.) Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow (1963)
Stratonovich, R.L.: On the value of information (in Russian). Izv. USSR Acad. Sci. Tech. Cybern. 5, 3–12 (1965)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Belavkin, R.V., Pardalos, P.M., Principe, J.C., Stratonovich, R.L. (2020). Definition of the value of information. In: Belavkin, R., Pardalos, P., Principe, J. (eds) Theory of Information and its Value. Springer, Cham. https://doi.org/10.1007/978-3-030-22833-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-22833-0_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22832-3
Online ISBN: 978-3-030-22833-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)