We consider a noisy communication channel in which discrete messages are transmitted by redundant digital signals. It is shown that the probability of true hypotheses can be arbitrarily close to unity if optimal coding is used and the signal-to-noise ratio exceeds the threshold value. This allows us to obtain the Shannon theorem formulation in which the channel capacity and entropy notions are not used.
Similar content being viewed by others
References
C. E. Shannon and W.Weaver, The Mathematical Theory of Communication, Univ. Illinois Press Urbana, Ill. (1949).
C. E. Shannon, Proc. IRE, 37, No. 1, 10 (1949).
R.W. Hamming, Coding and Information Theory, Prentice Hall, Englewood Cliffs, N.J. (1980).
R. Gallagher, Information Theory and Reliable Communication, Wiley, New York (1968).
M. V. Litvin, Proc. Nizhny Novgorod State Techn. Univ., Radioelectronic and Telecommunication Systems and Devices, 64, No. 11, 141 (2007).
M. V. Litvin, Vest. N. I. Lobachevsky Nizhny Novgorod Univ., No. 4, 89 (2011).
S. Winograd and J.D.Cowen, Reliable Computation in the Presence of Noise, MIT Press Cambridge, Mass. (1963).
L. A.Vainshtein and V.D. Zubakov, Isolation of Signals against the Random Noise Background [in Russian], Sovetskoe Radio, Moscow (1960).
V. S. Korolyuk, N. I.Portenko, A.V. Skorokhod, and A.F.Turbin, Handbook of the Probability Theory and Mathematical Statistics [in Russian], Nauka, Moscow (1985).
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated from Izvestiya Vysshikh Uchebnykh Zavedenii, Radiofizika, Vol. 54, No. 11, pp. 859–868, November 2011.
Rights and permissions
About this article
Cite this article
Litvin, M.V. Information transmission and redundancy. Radiophys Quantum El 54, 773–781 (2012). https://doi.org/10.1007/s11141-012-9339-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11141-012-9339-3