Codes, Distortion, and Information
Information theory, the mathematical theory of communication, originated with the classical papers of Claude Shannon , . Shannon modeled communication systems as random processes, introduced probabilistic definitions of information, and used classical ergodic theorems together with new ergodic theorems for information to develop coding theorems, results which quantified the optimal achievable performance in idealized communication systems. Shannon considered two fundamental aspects of communication: source coding or the mapping of an information source into a representation suitable for transmission on a channel and channel coding or error control coding for the reliable communication over a noisy channel. Our emphasis has been on and will remain on source coding.
KeywordsBlock Code Average Mutual Information Code Structure Input Symbol Distortion Measure
Unable to display preview. Download preview PDF.