Video Based Face Recognition Using Graph Matching

  • Gayathri Mahalingam
  • Chandra Kambhamettu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6494)


In this paper, we propose a novel graph based approach for still-to-video based face recognition, in which the temporal and spatial information of the face from each frame of the video is utilized. The spatial information is incorporated using a graph based face representation. The graphs contain information on the appearance and geometry of facial feature points and are labeled using the feature descriptors of the feature points. The temporal information is captured using an adaptive probabilistic appearance model. The recognition is performed in two stages where in the first stage a Maximum a Posteriori solution based on PCA is computed to prune the search space and select fewer candidates. A simple deterministic algorithm which exploits the topology of the graph is used for matching in the second stage. The experimental results on the UTD database and our dataset show that the adaptive matching and the graph based representation provides robust performance in recognition.


Feature Point Face Recognition Video Sequence Face Image Gaussian Mixture Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chellappa, R., Wilson, C.L., Sirohey, S.: Human and machine recognition of faces: a survey. Proceedings of the IEEE 83, 705–741 (1995)CrossRefGoogle Scholar
  2. 2.
    Wang, H., Wang, Y., Cao, Y.: Video-based face recognition: A survey. World Academy of Science, Engineering and Technology 60 (2009)Google Scholar
  3. 3.
    Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey (2000)Google Scholar
  4. 4.
    Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 71–86 (1991)CrossRefGoogle Scholar
  5. 5.
    Etemad, K., Chellappa, R.: Discriminant analysis for recognition of human face images. Journal of the Optical Society of America 14, 1724–1733 (1997)CrossRefGoogle Scholar
  6. 6.
    Moghaddam, B., Nastar, C., Pentland, A.: Bayesian face recognition using deformable intensity surfaces. In: Proceedings of Computer Vision and Pattern Recognition, pp. 638–645 (1996)Google Scholar
  7. 7.
    Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video. In: Computer Vision and Image Understanding, vol. 91, pp. 214–245 (2003)Google Scholar
  8. 8.
    Manjunath, B.S., Chellappa, R., Malsburg, C.: A feature based approach to face recognition (1992)Google Scholar
  9. 9.
    Ersi, E.F., Zelek, J.S.: Local feature matching for face recognition. In: Proceedings of the 3rd Canadian Conference on Computer and Robot Vision (2006)Google Scholar
  10. 10.
    Wiskott, L., Fellous, J.M., Kruger, N., Malsburg, C.V.D.: Face recognition by elastic bunch graph matching. IEEE Trans. on Pattern Analysis and Machine Intelligence 19, 775–779 (1997)CrossRefGoogle Scholar
  11. 11.
    Ersi, E.F., Zelek, J.S., Tsotsos, J.K.: Robust face recognition through local graph matching. Journal of Multimedia, 31–37 (2007)Google Scholar
  12. 12.
    Zhou, S., Krueger, V., Chellappa, R.: Face recognition from video: A condensation approach. In: Proc. of Fifth IEEE Internation Conference on Automatic Face and Gesture Recognition, pp. 221–228 (2002)Google Scholar
  13. 13.
    Li, Y.: Dynamic face models: construction and applications. Ph.D. Thesis, University of London (2001)Google Scholar
  14. 14.
    Kim, M., Kumar, S., Pavlovic, V., Rowley, H.A.: Face tracking and recognition with visual constraints in real-world videos. In: CVPR (2008)Google Scholar
  15. 15.
    Stallkamp, J., Ekenel, H.K.: Video-based face recognition on real-world data (2007)Google Scholar
  16. 16.
    Liu, X., Chen, T.: Video-based face recognition using adaptive hidden markov models. In: CVPR (2003)Google Scholar
  17. 17.
    Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding 99, 303–331 (2005)CrossRefGoogle Scholar
  18. 18.
    Park, U., Jain, A.K.: 3D model-based face recognition in video. In: Lee, S.-W., Li, S.Z. (eds.) ICB 2007. LNCS, vol. 4642, pp. 1085–1094. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  19. 19.
    Wu, Y., Roy-Chowdhury, A., Patel, K.: Integrating illumination, motion and shape models for robust face recognition in video. EURASIP Journal of Advances in Signal Processing: Advanced Signal Processing and Pattern Recognition Methods for Biometrics (2008)Google Scholar
  20. 20.
    Ojala, T., Pietikainen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognition, 51–59 (1996)Google Scholar
  21. 21.
    Ojala, T., Pietikainen, M., Maenpaa, T.: A generalized local binary pattern operator for multiresolution gray scale and rotation invariant texture classification. In: Second International Conference on Advances in Pattern Recognition, Rio de Janeiro, Brazil, pp. 397–406 (2001)Google Scholar
  22. 22.
    Penev, P., Atick, J.: Local feature analysis: A general statistical theory for object representation. Network: Computation in Neural Systems 7, 477–500 (1996)CrossRefzbMATHGoogle Scholar
  23. 23.
    Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Müller, K.R.: Fisher discriminant analysis with kernels (1999)Google Scholar
  24. 24.
    McLachlam, J., Peel, D.: Finite mixture models (2000)Google Scholar
  25. 25.
    Redner, R.A., Walker, H.F.: Mixture densities, maximum likelihood and the em algorithm. SIAM Review 26, 195–239 (1984)MathSciNetCrossRefzbMATHGoogle Scholar
  26. 26.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 91–110 (2004)CrossRefGoogle Scholar
  27. 27.
    O’Toole, A., Harms, J., Hurst, S.L., Pappas, S.R., Abdi, H.: A video database of moving faces and people. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 812–816 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Gayathri Mahalingam
    • 1
  • Chandra Kambhamettu
    • 1
  1. 1.Video/Image Modeling and Synthesis (VIMS) Laboratory, Department of Computer and Information SciencesUniversity of DelawareNewarkUSA

Personalised recommendations