Face Retrieval Using 1st- and 2nd-order PCA Mixture Model

  • Sangyoun Lee
  • Hyun-Chul Kim
  • Daijin Kim
  • YoungSik Choi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2668)


This paper deals with face retrieval using the 1st- and 2nd-order PCA mixture model. The well-known eigenface method uses one set of holistic facial features obtained by PCA. However, the single set of eigenfaces is not enough to represent the complicated face images with large variations of poses and/or illuminations. To overcome this weakness, we propose the (1st-order) PCA mixture method that uses several eigenface sets obtained from the EM learning in PCA mixture model. Furthermore, we propose the 2nd-order PCA mixture method that combines the 2nd-order eigenface method and the PCA mixture model. In the 2nd-order eigenface method, each image is represented by a couple of feature vectors obtained by projecting the face image onto a selected approximate eigenface set and then by projecting the residual face image onto a selected residual eigenface set. Face retrieval is performed by finding the identity that provides the shortest distance in the feature space between the input image and the template image. Simulation results show that face retrieval using the 2nd-order PCA mixture method is best for face images with illumination variations and face retrieval using the 1st-order PCA mixture model is best for the face images with pose variations in terms of ANMRR (Average of the Normalized Modified Retrieval Rank) and CRR (Correct Retrieval Rate).


Face Recognition Face Image Face Database Geometric Distance Template Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    R. Chellappa, C. L. Wilson, S. Sirohey, “Human and Machine Recognition of Faces: A Survey,” Proceedings of the IEEE, vol. 83, no. 5, 705–740, 1995.CrossRefGoogle Scholar
  2. 2.
    M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, 1991.Google Scholar
  3. 3.
    H. Kim, D. Kim, S. Bang, “A PCA Mixture Model with an E.cient Model Selection Method,” Proceedings IJCNN2001, 2001.Google Scholar
  4. 4.
    L. Wang and T. K. Tan, “Experimental results of face description based on the 2nd-order eigenface method,” ISO/MPEG m6001, Geneva, May, 2000.Google Scholar
  5. 5.
    L. Wang and T. K. Tan, “A new proposal for face feature description,” ISO/MPEG m5750, Noordwijkerhout, March, 2000Google Scholar
  6. 6.
    I. T. Jolliffe, Principal component analysis, New York: Springer-Verlag, 1896.Google Scholar
  7. 7.
    H. Hostelling, “Analysis of a complex statistical variables into principal components,” Journal of Educational Psychology, vol. 24, 417–441, 1933.CrossRefGoogle Scholar
  8. 8.
    M. Turk and A. Pentland, “Face Recognition Using Eigenfaces,” Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 586–591, 1991.Google Scholar
  9. 9.
    M. Tipping, C. Bishop, “Mixtures of Probabilistic Principal Component Analyzers,” Neural Computation, vol. 11, 443–482, 1999.CrossRefGoogle Scholar
  10. 10.
    R. Jacobs, M. Jordan, S. Nowlan, G. Hinton, “Adaptive mixtures of local experts,” Neural Computation, vol. 3, 79–87, 1991.CrossRefGoogle Scholar
  11. 11.
    M. Jordan, R. Jacobs, “Hierarchical mixtures of experts and the EM algorithm,” Neural Computation, vol. 6,no. 5, 181–214, 1994.CrossRefGoogle Scholar
  12. 12.
    G. Hinton, P. Dayan, M. Revow, “Modeling the manifolds of images of handwritten digits,” IEEE Transactions on Neural Networks, vol. 8,no. 1, 65–74, 1997.CrossRefGoogle Scholar
  13. 13.
    P. Dempster, N. Laird, D. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” Journal of the Royal Statistical Society: series-B, vol. 39,no. 4, 1–38, 1977.zbMATHMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Sangyoun Lee
    • 1
  • Hyun-Chul Kim
    • 2
  • Daijin Kim
    • 2
  • YoungSik Choi
    • 3
  1. 1.Service Development Laboratory Korea TelecomSeocho-Gu, SeoulKorea
  2. 2.Department of Computer Science and EngineeringPohang University of Science and TechnologyNam-Gu, PohangKorea
  3. 3.Department of Computer Science and EngineeringHankuk Aviation UniversityKoyang-city, Kyonggi-doKorea

Personalised recommendations