Fully Automatic Methodology for Human Action Recognition Incorporating Dynamic Information

  • Ana González
  • Marcos Ortega Hortas
  • Manuel G. Penedo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7042)

Abstract

In this paper, a star-skeleton-based methodology is described for analyzing the motion of a human target in a video sequence. Star skeleton is a fast skeletonization technique by connecting centroid of target object to its contour extremes. We represent the skeleton as a five-dimensional vector, which includes information about the positions of head and four limbs of a human shape in a given frame. In this manner, an action is composed of a sequence of star skeletons. With the purpose of use an HMM which allows model the actions, a posture codebook is built integrating star skeleton and motion information. With this last information we can distinct better between actions. Supervised (manual) and No-supervised methods (clustering-based methodology) have been used to create the posture codebook. The codebook is dependently of the actions to represent (We choose four actions as example: walk, jump, wave and jack). Obtained results show, firstly, including motion information is important to get a correctly differentiation between actions. On the other hand, using a clustering methodology to create the codebook causes a substantial improvement in results.

Keywords

Human action recognition Star skeleton Clustering Hidden Markov Models 

References

  1. 1.
    Chen, H.-S., Chen, H.-T., Chen, Y.-W., Lee, S.-Y.: Human Action Recognition Using Star Skeleton. In: Proc. VSSN 2006, Santa Barbara, CA, USA, pp. 171–178 (October 2006)Google Scholar
  2. 2.
    Fujiyoshi, H., Lipton, J., Kanade, T.: Real-Time Human Motion Analysis by Image Skeletonization. IEICE Transactions on Information and Systems E87-d(1), 113–119 (2004)Google Scholar
  3. 3.
    Aggarwal, J.K., Cai, Q.: Human motion analysis: A review. Computer Vision Image Understanding 73(3), 428–440 (1999)CrossRefGoogle Scholar
  4. 4.
    Aloysius, L.H.W., Dong, G., Huang, Z., Tan, T.: Human Posture Recognition in Video Sequence using Pseudo 2-D Hidden Markov Models. In: Proc. International Conference on Control, Automation, Robotics and Vision Conference, vol. 1, pp. 712–716 (2004)Google Scholar
  5. 5.
    Kellokumpu, V., Pietikäinen, M., Heikkilä, J.: Human Activity Recognition Using Sequences of Postures. In: Proc. IAPR Conference on Machine Vision Application, pp. 570–573 (2005)Google Scholar
  6. 6.
    Yamato, J., Ohya, J., Ishii, K.: Recognizing Human Action in Time-Sequential Images using Hidden Markov Model. In: Proc. IEEE International Conference on Computer Vision and Pattern Recognition, pp. 379–385 (1992)Google Scholar
  7. 7.
    Cucchiara, R., Grana, C., Prati, A., Vezzani, R.: Probabilistic posture classification for Human-behavior analysis. IEEE Transactions on Systems, Man and Cybernetics 35(1), 42–54 (2005)CrossRefGoogle Scholar
  8. 8.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Ana González
    • 1
  • Marcos Ortega Hortas
    • 1
  • Manuel G. Penedo
    • 1
  1. 1.VARPA groupUniversity of A CoruñaA CoruñaSpain

Personalised recommendations