Codes, Distortion, and Information

  • Robert M. Gray
Part of the The Kluwer International Series in Engineering and Computer Science book series (SECS, volume 83)


Information theory, the mathematical theory of communication, originated with the classical papers of Claude Shannon [73], [74]. Shannon modeled communication systems as random processes, introduced probabilistic definitions of information, and used classical ergodic theorems together with new ergodic theorems for information to develop coding theorems, results which quantified the optimal achievable performance in idealized communication systems. Shannon considered two fundamental aspects of communication: source coding or the mapping of an information source into a representation suitable for transmission on a channel and channel coding or error control coding for the reliable communication over a noisy channel. Our emphasis has been on and will remain on source coding.


Entropy Beach Dinates Aliasing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Kluwer Academic Publishers 1990

Authors and Affiliations

  • Robert M. Gray
    • 1
  1. 1.Stanford UniversityStanfordUSA

Personalised recommendations