Toeplitz Covariance Matrices and the von Neumann Relative Entropy

  • Tryphon T. Georgiou
Part of the Trends in Mathematics book series (TM)


Sample covariances based on time-series data fail to be Toeplitz. The purpose of the paper is to suggest the von Neumann relative-entropy as a distance measure for approximating a positive-definite sample covariance by one having the Toeplitz structure. This leads to a convex optimization problem whose solution retains the property of being positive-definite.


Approximation Structured matrices Positivity von Neumann entropy 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    C. Byrnes, T. T. Georgiou, and A. Lindquist, “A generalized entropy criterion for Nevanlinna-Pick interpolation: A convex optimization approach to certain problems in systems and control,”IEEE Trans. on Automatic Controlvol. 45, no. 6, pp. 822–839, June 2001.MathSciNetCrossRefGoogle Scholar
  2. [2]
    C. I. Byrnes, S. V. Gusev, and A. Lindquist, “A convex optimization approach to the rational covariance extension problem,”SIAM J. Control and Opt.vol. 37, pp. 211–229, 1999.MathSciNetzbMATHCrossRefGoogle Scholar
  3. [3]
    T. M. Cover and J. A. ThomasElements of Information Theory.Wiley, 1991.CrossRefGoogle Scholar
  4. [4]
    T. T. Georgiou, “Spectral estimation by selective harmonic amplification,”IEEE Trans. on Automatic Controlvol. 46, no. 1, pp. 29–42, January 2001.MathSciNetzbMATHCrossRefGoogle Scholar
  5. [5]
    T. T. Georgiou, “The structure of state covariances and its relation to the power spectrum of the input,”IEEE Trans. on Automatic Controlvol. 47, no. 7, pp. 1056–1066, July 2002.MathSciNetCrossRefGoogle Scholar
  6. [6]
    T. T. Georgiou, “Spectral analysis based on the state covariance: the maximum entropy spectrum and linear fractional parameterization,”IEEE Trans. on Automatic Controlto appear.Google Scholar
  7. [7]
    T. T. Georgiou and A. Lindquist, “Kullback-Leibler approximation of spectral density functions,” preprint, May 2002.Google Scholar
  8. [8]
    S. Haykin, Nonlinear Methods of Spectral Analysis. New York: Springer-Verlag, New York, 247 pages, 1979.zbMATHGoogle Scholar
  9. [9]
    S. KullbackInformation Theory and Statistics2nd ed. New York: Dover Books, 1968 (1st ed. New York: John Wiley, 1959).Google Scholar
  10. [10]
    M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information.Cambridge University Press, 2000.zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2003

Authors and Affiliations

  • Tryphon T. Georgiou
    • 1
  1. 1.Dept. of Electrical and Computer EngineeringUniversity of MinnesotaUSA

Personalised recommendations