Abstract
In modern science, engineering and public life, a big role is played by information and operations associated with it: information reception, information transmission, information processing, storing information and so on. The significance of information has seemingly outgrown the significance of the other important factor, which used to play a dominant role in the previous century, namely, energy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
‘nat’ refers to natural digit that means natural unit.
- 2.
‘bit’ refers to binary digit that means binary unit (sign).
- 3.
Boltzmann’s entropy is commonly referred to as ‘Shannon’s entropy’, or just ‘entropy’ within the field of information theory.
References
Fano, R.M.: Transmission of Information: A Statistical Theory of Communications, 1st edn. MIT Press, Cambridge (1961)
Fano, R.M.: Transmission of Information: A Statistical Theory of Communications (Translation to Russian). Mir, Moscow (1965)
Feinstein, A.: Foundations of Information Theory. McGraw-Hill, New York (1958)
Feinstein, A.: Foundations of Information Theory (Translation to Russian). Inostrannaya Literatura, Moscow (1960)
Gnedenko, B.V.: The Course of the Theory of Probability. Fizmatgiz, Moscow (1961, in Russian)
Gnedenko, B.V.: The Theory of Probability (Translation from Russian). Chelsea, New York (1962)
Goldman, S.: Information Theory. Prentice Hall, Englewood Cliffs (1953)
Goldman, S.: Information Theory (Translation to Russian). Inostrannaya Literatura, Moscow (1957)
Hartley, R.V.L.: Transmission of information. Bell Syst. Tech. J. 7(3) (1928)
Hartley, R.V.L.: Transmission of information (Translation to Russian). In: A. Harkevich (ed.) Theory of Information and Its Applications. Fizmatgiz, Moscow (1959)
Kullback, S.: Information Theory and Statistics. Wiley, New York (1959)
Kullback, S.: Information Theory and Statistics (Translation to Russian). Nauka, Moscow (1967)
Rao, C.R.: Linear Statistical Inference and Its Applications. Wiley, New York (1965)
Rao, C.R.: Linear Statistical Inference and Its Applications (Translation to Russian). Inostrannaya Literatura, Moscow (1968)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948)
Shannon, C.E.: Communication in the presence of noise. Proc. IRE 37(1), 10–21 (1949)
Shannon, C.E.: Communication in the presence of noise (translation to Russian). In: R.L. Dobrushin, O.B. Lupanov (eds.) Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow (1963)
Shannon, C.E.: A mathematical theory of communication (translation to Russian). In: R.L. Dobrushin, O.B. Lupanov (eds.) Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow (1963)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Belavkin, R.V., Pardalos, P.M., Principe, J.C., Stratonovich, R.L. (2020). Definition of information and entropy in the absence of noise. In: Belavkin, R., Pardalos, P., Principe, J. (eds) Theory of Information and its Value. Springer, Cham. https://doi.org/10.1007/978-3-030-22833-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-22833-0_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22832-3
Online ISBN: 978-3-030-22833-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)