Algorithms for Source Coding

  • F. Jelinek
  • G. Longo
Part of the International Centre for Mechanical Sciences book series (CISM, volume 216)


Consider an information source whose outputs are independent identically distributed random variables (i.i.d. r.v.s) taking values in the finite set or alphabet Jc = {0, 1,..., c−1}; a coding alphabet Jd = {0, 1,..., d−1}; and a noiseless transmission medium, or channel, that accepts letters from Jd as inputs and delivers them to the destination without any change (see figure 1).


Source Code Compression Ratio Probable Word Source Sequence Codeword Length 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Jelinek, F.: Probabilistic Information Theory, McGraw-Hill, 1968.MATHGoogle Scholar
  2. [2]
    Jelinek, F.: “Buffer Overflow in Variable Length Coding of Fixed Rate Sources”, IEEE Trans. Inform. Theory, IT-14(3), May 1968.Google Scholar
  3. [3]
    Kraft, L.G.: “A Device for Quantizing, Grouping and Coding Amplitude Modulated Pulses”, M.S. thesis, Dept. of Elec. Engin., M.I.T., 1949.Google Scholar
  4. [4]
    Huffman, D.A.: “A Method of Construction of Minimum Redundancy Codes”, Proc. IRE, 40 (10), Sept. 1962.Google Scholar
  5. [5]
    Gallager, R.G.: Information Theory and Reliable Communication, J. Wiley and Sons, 1968.Google Scholar
  6. [6]
    Tunstall, A.: “Synthesis of Noiseless Compression Codes”, Ph.D. dissertation, Georgia Inst. Technol., Atlanta, 1968.Google Scholar
  7. [7]
    Shannon, C.E.: “A Mathematical Theory of Communication”, Bell Systems Tech.J., 27, p. 379 and 623, 1948.Google Scholar
  8. [8]
    Longo, G.: “Source Coding Theory” CISM Courses and Lectures, No. 32, Springer, 1970.Google Scholar
  9. [9]
    Elias, P.: unpublished result.Google Scholar
  10. [10]
    Schalkwijk, J.P.: “An Algorithm for Source Coding”, IEEE Trans. Inform. Theory, IT-18(3), May 1972.Google Scholar

Copyright information

© Springer-Verlag Wien 1975

Authors and Affiliations

  • F. Jelinek
    • 1
  • G. Longo
    • 2
  1. 1.IBM Thomas J. Watson Research CenterYorktown HeightsUSA
  2. 2.Istituto di ElettronicaUniversità di TriesteTriesteItaly

Personalised recommendations