n-Grams of Action Primitives for Recognizing Human Behavior

  • Christian Thurau
  • Václav Hlaváč
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4673)


This paper presents a novel approach for behavior recognition from video data. A biologically inspired action representation is derived by applying a clustering algorithm to sequences of motion images. To obey the temporal context, we express behaviors as sequences of n-grams of basic actions. Novel video sequences are classified by comparing histograms of action n-grams to stored histograms of known behaviors. Experimental validation shows a high accuracy in behavior recognition.


Video Sequence IEEE Computer Society Action Recognition Temporal Context Sport Video 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ghahramani, Z.: Building blocks of movement. Nature 407, 682–683 (2000)CrossRefGoogle Scholar
  2. 2.
    Schack, T., Mechsner, F.: Representation of motor skills in human long-term memory. Neuroscience Letters 391, 77–81 (2006)CrossRefGoogle Scholar
  3. 3.
    Wolpert, D.M., Ghahramani, Z., Flanagan, J.R.: Perspectives and problems in motor learning. TRENDS in Cognitive Sciences 5(11), 487–494 (2001)CrossRefGoogle Scholar
  4. 4.
    Fod, A., Matarić, M., Jenkins, O.: Automated Derivation of Primitives for Movement Classification. Autonomous Robots 12(1), 39–54 (2002)zbMATHCrossRefGoogle Scholar
  5. 5.
    Thoroughman, K., Shadmehr, R.: Learning of action through adaptive combination of motor primitives. Nature 407, 742–747 (2000)CrossRefGoogle Scholar
  6. 6.
    Thurau, C., Bauckhage, C., Sagerer, G.: Synthesizing Movements for Computer Game Characters. In: Rasmussen, C.E., Bülthoff, H.H., Schölkopf, B., Giese, M.A. (eds.) Pattern Recognition. LNCS, vol. 3175, pp. 179–186. Springer, Heidelberg (2004)Google Scholar
  7. 7.
    Moeslund, T., Reng, L., Granum, E.: Finding Motion Primitives in Human Body Gestures. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 133–144. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Moeslund, T., Fihl, P., Holte, M.: Action Recognition using Motion Primitives. In: The 15th Danish conference on pattern recognition and image analysis (2006)Google Scholar
  9. 9.
    Ogale, A.S., Karapurkar, A., Aloimonos, Y.: View-invariant modeling and recognition of human actions using grammars. In: ICCV Workshop on Dynamical Vision (2005)Google Scholar
  10. 10.
    Guerra-Filho, G., Aloimonos, Y.: A Sensory-Motor Language for Human Activity Understanding. In: HUMANOIDS 2006. 6th IEEE-RAS International Conference on Humanoid Robots, pp. 69–75. IEEE Computer Society Press, Los Alamitos (2006)Google Scholar
  11. 11.
    Hamid, R., Johnson, A., Batta, S., Bobick, A., Isbell, C., Coleman, G.: Detection and Explanation of Anomalous Activities: Representing Activities as Bags of Event n-Grams. In: CVPR 2005. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005, IEEE, NJ, New York (2005)Google Scholar
  12. 12.
    Goldenberg, R., Kimmel, R., Rivlin, E., Rudzsky, M.: Behavior classification by eigendecomposition of periodic motions. Pattern Recognition 38, 1033–1043 (2005)CrossRefGoogle Scholar
  13. 13.
    Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, R.: Actions as Space-Time Shapes. In: Tenth IEEE International Conference on Computer Vision, IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  14. 14.
    Ward, J.H.J.: Hierarchical grouping to optimize an objective function. J. Am. Stat. Assoc. 58, 236–244 (1963)CrossRefGoogle Scholar
  15. 15.
    Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Computing Surveys 31(3), 264–323 (1999)CrossRefGoogle Scholar
  16. 16.
    Rieck, K., Laskov, P., Sonnenburg, S.: Computation of Similarity Measures for Sequential Data using Generalized Suffix Trees. In: Advances in Neural Information Processing Systems, vol. 19 (2007)Google Scholar
  17. 17.
    Thurau, C., Hettenhausen, T., Bauckhage, C.: Classification of Team Behaviors in Sports Video Games. In: Proc. Int. Conf. on Pattern Recognition, pp. 1188–1191. IEEE, Los Alamitos (2006)Google Scholar
  18. 18.
    Dalal, N., Triggs, B.: Histograms of Oriented Gradients for Human Detection. In: CVPR 2005. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005, IEEE Computer Society Press, Los Alamitos (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Christian Thurau
    • 1
  • Václav Hlaváč
    • 1
  1. 1.Czech Technical University, Faculty of Electrical Engineering, Department for Cybernetics, Center for Machine Perception, 121 35 Prague 2, Karlovo náměstíCzech Republic

Personalised recommendations