Factorial Hidden Markov Models for Gait Recognition

  • Changhong Chen
  • Jimin Liang
  • Haihong Hu
  • Licheng Jiao
  • Xin Yang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4642)


Gait recognition is an effective approach for human identification at a distance. During the last decade, the theory of hidden Markov models (HMMs) has been used successfully in the field of gait recognition. However the potentials of some new HMM extensions still need to be exploited. In this paper, a novel alternative gait modeling approach based on Factorial Hidden Markov Models (FHMMs) is proposed. FHMMs are of a multiple layer structure and provide an interesting alternative to combining several features without the need of collapse them into a single augmented feature. We extracted irrelated features for different layers and iteratively trained its parameters through the Expectation Maximization (EM) algorithm and Viterbi algorithm. The exact Forward-Backward algorithm is used in the E-step of EM algorithm. The performances of the proposed FHMM-based gait recognition method are evaluated using the CMU MoBo database and compared with that of HMMs based methods.


gait recognition FHMMs HMMs parallel HMMs frieze wavelet 


  1. 1.
    Kale, A., Cuntoor, N., Chellappa, R.: A framework for activity-specific human identification. In: Proc. of the Int. Conf. on Acoustics, Speech and Signal Processing (May 2002)Google Scholar
  2. 2.
    Sundaresan, A., RoyChowdhury, A., Chellappa, R.: A Hidden Markov Model Based Framework for Recognition of Humans from Gait Sequences. In: Proceedings of IEEE International Conference on Image Processing, IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
  3. 3.
    Liu, Z., Malave, L., Sarkar, S.: Studies on Silhouette Quality and Gait Recognition. In: CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
  4. 4.
    Iwamoto, K., Sonobe, K., Komatsu, N.: A Gait Recognition Method using HMM. In: SICE Annual Conference in Fukui, Japan (2003)Google Scholar
  5. 5.
    Chen, C., Liang, J., Zhao, H., Hu, H.: Gait Recognition Using Hidden Markov Model. In: Jiao, L., Wang, L., Gao, X., Liu, J., Wu, F. (eds.) ICNC 2006. LNCS, vol. 4221, pp. 399–407. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    Ghahramani, Z., Jordan, M.: Factorial Hidden Markov Models. Computational Cognitive Science Technical Report 9502 (revised) (July 1996)Google Scholar
  7. 7.
    Brand, M.: Coupled hidden Markov models for modeling interacting processes. MIT Media Lab Perceptual Computing/Learning and Common Sense Techincal Report 405 (revised) (June 1997)Google Scholar
  8. 8.
    Gross, R., Shi, J.: The Cmu Motion of Body (mobo) Database. Technical report, Robotics Institute (2001)Google Scholar
  9. 9.
    Logan, B., Moreno, J.: Factorial Hidden Markov Models for Speech Recognition:Preliminary Experiments. Cambrige Research Laboratory Technical Research Series (September 1997)Google Scholar
  10. 10.
    Liu, Y., Collins, T., Tsin, Y.: Gait Sequence Analysis using Frieze Patterns, CMU-RI-TR-01-38Google Scholar
  11. 11.
    Logan, B., Moreno, P.: Factorial HMMs for Acoustic Modeling, Acoustics Speech and Signal[C]. Proceedings of the IEEE International Conference 2 (S), 813–816 (1998)Google Scholar
  12. 12.
    Zhang, R., Vogler, C., Metaxas, D.: Human Gait Recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, IEEE Computer Society Press, Los Alamitos (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Changhong Chen
    • 1
  • Jimin Liang
    • 1
  • Haihong Hu
    • 1
  • Licheng Jiao
    • 1
  • Xin Yang
    • 2
  1. 1.Life Science Research Center, School of Electronic Engineering, Xidian University, Xi’an, Shaanxi 710071China
  2. 2.Center for Biometrics and Security Research, Key Laboratory of Complex Systems and Intelligence Science, Institute of Automation, Chinese Academy of Sciences, P.O. Box 2728, Beijing 100080China

Personalised recommendations