Codes, Distortion, and Information

  • Robert M. Gray
Part of the The Kluwer International Series in Engineering and Computer Science book series (SECS, volume 83)


Information theory, the mathematical theory of communication, originated with the classical papers of Claude Shannon [73], [74]. Shannon modeled communication systems as random processes, introduced probabilistic definitions of information, and used classical ergodic theorems together with new ergodic theorems for information to develop coding theorems, results which quantified the optimal achievable performance in idealized communication systems. Shannon considered two fundamental aspects of communication: source coding or the mapping of an information source into a representation suitable for transmission on a channel and channel coding or error control coding for the reliable communication over a noisy channel. Our emphasis has been on and will remain on source coding.


Block Code Average Mutual Information Code Structure Input Symbol Distortion Measure 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Kluwer Academic Publishers 1990

Authors and Affiliations

  • Robert M. Gray
    • 1
  1. 1.Stanford UniversityStanfordUSA

Personalised recommendations