Mutual Information Functions Versus Correlation Functions in Binary Sequences

  • Wentian Li
Part of the NATO ASI Series book series (NSSB, volume 208)


Mutual information is a well known concept used in information theory [1]. Recently, it has been suggested that it can be used in the study of chaotic dynamical systems [2] and for the characterization of spatial complex patterns [3]. Although it has been shown that mutual information is a better quantity than correlation function in the determination of the time delay for the delayed signal in reconstructing the phase space of the chaotic trajectory [4], there is no attempt to systematically compare it with the more frequently used correlation functions. Binary sequences provide an excellent example for this comparative study. Some results are included here, for more details see Ref [5].


Correlation Function Mutual Information Cellular Automaton Binary Sequence Block Length 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    C.E.Shannon, “The mathematical theory of communication”, Bell Syst. Techn. Journal, 27, 379–423 (1948).MathSciNetzbMATHGoogle Scholar
  2. 2.
    Rob Shaw, “The dripping faucet as a model chaotic system”, (Aerial Press) (1984); and unpublished ideas.Google Scholar
  3. 3.
    Gregory J. Chaitin, “Toward a mathematical definition of life’ ”, The Maximum Entropy Formalism, ed. Levine and Tribus, ( MIT Press 1979 ).Google Scholar
  4. 4.
    A.M. Fraser, H.L. Swinney, “Independent coordinates for strange attractors from mutual information ”, Physical Review A, 33, 1134–1140 (1986).MathSciNetzbMATHCrossRefGoogle Scholar
  5. 5.
    Wentian Li, “Mutual information versus correlation functions”, (CCSR Tech Report, CCSR, Univ. of Illinois, 1989 ).Google Scholar
  6. 6.
    Wentian Li, Problems in Complex Systems (Ph.D thesis, Columbia University, 1989); “Context-free languages can give 1/f spectra”, (CCSR Tech Report No.10, CCSR Univ. of Illinois, 1988 ).Google Scholar
  7. 7.
    ed. Stephen Wolfram, Theory and Application of Cellular Automata, (World Scientific, 1986 ).Google Scholar
  8. 8.
    Chris Langton, Norman Packard, Wentian Li, “Bifurcation-like phenomena in cellular automata rule space”, (paper in preparation, 1989 ).Google Scholar
  9. 9.
    Wentian Li, “Correlation analysis of JFK’s inaugural speech”, (work in progress).Google Scholar

Copyright information

© Plenum Press, New York 1989

Authors and Affiliations

  • Wentian Li
    • 1
    • 2
  1. 1.Department of Physics Beckman InstituteCenter for Complex Systems ResearchUrbanaUSA
  2. 2.Physics DepartmentColumbia UniversityNew YorkUSA

Personalised recommendations