Integrating Face Profile and Gait at a Distance

Part of the Advances in Pattern Recognition book series (ACVPR)


Human recognition from arbitrary views is an important task for many applications, such as visual surveillance, covert security and access control. It has been found to be difficult in reality, especially when a person is walking at a distance in real-world outdoor conditions. For optimal performance, the system should use as much information as possible from the observations. In this chapter, we introduce a video based system which combines cues of face profile and gait silhouette from the single camera video sequences. It is difficult to get reliable face profile information directly from a low-resolution video frame because of limited resolution. To overcome this problem, we first construct a high-resolution face profile image from multiple adjacent low-resolution frames for each video sequence. Then, we extract face features from the high-resolution profile image. Finally, dynamic time warping (DTW) is used as the matching method to compute the similarity of two face profiles based on the absolute values of curvature. For gait, we use gait energy image (GEI), a spatio-temporal compact representation, to characterize human walking properties. Gait recognition is carried out based on the direct GEI matching. Several schemes are considered for fusion of face profile and gait. A number of dynamic video sequences are tested to evaluate the performance of our system. Experimental results are compared and discussed.


Video Sequence Video Frame Dynamic Time Warping Fusion System Fiducial Point 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 2.
    Akimoto, T., Suenaga, Y., Wallace, R.S.: Automatic creation of 3d facial models. IEEE Trans. Comput. Graph. Appl. 13, 16–22 (1993) CrossRefGoogle Scholar
  2. 16.
    Bhanu, B., Zhou, X.: Face recognition from face profile using dynamic time warping. In: Proceedings of International Conference on Pattern Recognition, vol. 4, pp. 499–502 (2004) Google Scholar
  3. 26.
    Campos, J.C., Linney, A.D., Moss, J.P.: The analysis of facial profiles using scale space techniques. Pattern Recognit. 26, 819–824 (1993) CrossRefGoogle Scholar
  4. 38.
    Dariush, B., Kang, S.B., Waters, K.: Spatiotemporal analysis of face profiles: detection, segmentation, and registration. In: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, pp. 248–253 (1998) Google Scholar
  5. 48.
    Galton, F.: Numeralised profiles for classification and recognition. Nature 83, 127–130 (1910) CrossRefGoogle Scholar
  6. 60.
    Han, J., Bhanu, B.: Performance prediction for individual recognition by gait. Pattern Recognit. Lett. 26(5), 615–624 (2005) CrossRefGoogle Scholar
  7. 61.
    Han, J., Bhanu, B.: Individual recognition using gait energy image. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 316–322 (2006) CrossRefGoogle Scholar
  8. 63.
    Harmon, L.D., Hunt, W.F.: Automatic recognition of human face profiles. Comput. Graph. Image Process. 6, 135–156 (1977) CrossRefGoogle Scholar
  9. 64.
    Harmon, L.D., Khan, M.K., Lasch, R., Ramig, P.F.: Machine identification of human faces. Pattern Recognit. 13, 97–110 (1981) CrossRefGoogle Scholar
  10. 66.
    Hewitt, P.A., Dobberfuhl, D.: The science and art of proportionality. Sci. Scope 27, 30–31 (2004) Google Scholar
  11. 75.
    Irani, M., Peleg, S.: Motion analysis for image enhancement: resolution, occlusion, and transparency. J. Vis. Commun. Image Represent 4, 324–335 (1993) CrossRefGoogle Scholar
  12. 84.
    Kale, A., Roy-chowdhury, A., Chellappa, R.: Fusion of gait and face for human identification. In: Proceedings of Acoustics, Speech, and Signal Processing, vol. 5, pp. 901–904 (2004) Google Scholar
  13. 86.
    Keogh, E.: Exact indexing of dynamic time warping. In: Proceedings of Conference on Very Large Data Bases (2002) Google Scholar
  14. 88.
    Kittler, J., Hatef, M., Duin, R., Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20(3), 226–239 (1998) CrossRefGoogle Scholar
  15. 123.
    Needleman, S.B., Wunsch, C.D.: A general method applicable to the search for similarities in the amino acid sequences of two proteins. J. Mol. Biol. 48, 443–453 (1977) CrossRefGoogle Scholar
  16. 127.
    O’Mara, D.: Automated facial metrology. PhD Thesis, The University of Western Australia Google Scholar
  17. 153.
    Shakhnarovich, G., Darrell, T.: On probabilistic combination of face and gait cues for identification. In: Proceedings of Automatic Face and Gesture Recognition, vol. 5, pp. 169–174 (2002) Google Scholar
  18. 154.
    Shakhnarovich, G., Lee, L., Darrell, T.: Integrated face and gait recognition from multiple views. In: Proceedings of IEEE Workshop on Visual Motion, vol. 1, pp. 439–446 (2001) Google Scholar
  19. 169.
    Tsai, R.Y., Huang, T.S.: Multiframe Image Restoration and Registration, vol. 1. JAI Press, London (1984) Google Scholar
  20. 211.
    Zhou, X., Bhanu, B., Han, J.: Human recognition at a distance in video by integrating face profile and gait. In: Proceedings of Audio- and Video-Based Biometric Person Authentication, pp. 533–543 (2005) Google Scholar
  21. 213.
    Zuev, Y., Ivanon, S.: The voting as a way to increase the decision reliability. J. Franklin Inst. 336(2), 361–378 (1999) MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2010

Authors and Affiliations

  1. 1.Bourns College of EngineeringUniversity of CaliforniaRiversideUSA
  2. 2.Lawrence Berkeley National LaboratoryUniversity of CaliforniaBerkeleyUSA

Personalised recommendations