Science in China Series E: Technological Sciences

, Volume 40, Issue 6, pp 597–604 | Cite as

Convergence of algorithms used for principal component analysis

  • Junhua Zhang
  • Hanfu Chen


The convergence of algorithms used for principal component analysis is analyzed. The algorithms are proved to converge to eigenvectors and eigenvalues of a matrixA which is the expectation of observed random samples. The conditions required here are considerably weaker than those used in previous work.


principal component analysis stochastic approximation algorithms convergence 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Oja, E.,Subspace Methods of Pattern Recognition, 1st ed., Letchworth, Hertfordshire: Research Studies Press Ltd., 1983.Google Scholar
  2. 2.
    Deprettere, E. F. (eds.),SVD and Signal Processing, North-Holland: Elsevier, 1988.Google Scholar
  3. 3.
    Vaccaro, R. (eds.),SVD and Signal Processing, II:Algorithms, Analysis and Applications, Amsterdam: Elsevier, 1991.Google Scholar
  4. 4.
    Jain, A. K.,Fundamentals of Digital Image Processing, 1st ed., Engelwood Cliffs: Prentice-Hall, 1989.MATHGoogle Scholar
  5. 5.
    Tufts, D. W., Kumaresan, R., Estimation of frequencies of multiple sinusoids: Making linear prediction perform like maximum likelihood,Proc. IEEE, 1982, 70(9): 975.CrossRefGoogle Scholar
  6. 6.
    Roy, R., Paulraj, A., Kailath, T., ESPRIT—A subspace rotation approach to estimation of parameters of cissoids in noise,IEEE Trans. Acoust., Speech, Signal Processing, 1986, 34(5): 1340.CrossRefGoogle Scholar
  7. 7.
    Kung, S. Y., A new identification and model reduction algorithm via singular value decomposition, inProc. 12th Asilomar Conf. Circuits, Syst. Comput., Pacific Grove, Calif., 1978 (eds. Chi-Chia Hsieh), New York: IEEE Computer Society, 1979, 705–714.Google Scholar
  8. 8.
    Kushner, H. J., Clark, D. S.,Stochastic Approximation Methods for Constrained and Unconstrained Systems, 1st ed., New York: Springer-Verlag, 1978.Google Scholar
  9. 9.
    Chen, H. F., Zhu, Y. M.,Stochastic Approximation (in Chinese), 1st ed., Shanghai: Shanghai Science and Technology Press, 1996.Google Scholar
  10. 10.
    Chen, H. F., Stochastic approximation and its new applications,Proc. International Workshop on New Directions of Control and Manufacturing, Hong Kong, 1994, 2–12.Google Scholar

Copyright information

© Science in China Press 1997

Authors and Affiliations

  • Junhua Zhang
    • 1
  • Hanfu Chen
    • 2
  1. 1.Institute of Applied MathematicsChinese Academy of SciencesBeijingChina
  2. 2.Institute of Systems ScienceChinese Academy of SciencesBeijingChina

Personalised recommendations