Abstract
Human behavior understanding from visual data has applications such as threat recognition. A lot of approaches are restricted to limited time actions, which we call short-term actions. Long-term behaviors are sequences of short-term actions that are more extended in time. Our hypothesis is that they usually present some structure that can be exploited to improve recognition of short-term actions. We present an approach to model long-term behaviors using a syntactic approach. Behaviors to be recognized are hand-crafted into the model in the form of grammar rules. This is useful for cases when few (or no) training data is available such as in threat recognition. We use a stochastic parser so we handle noisy inputs. The proposed method succeeds in recognizing a set of predefined long-term interactions in the CAVIAR dataset. Additionally, we show how imposing prior knowledge about the structure of the long-term behavior improves the recognition of short-term actions with respect to standard statistical approaches.
Chapter PDF
Similar content being viewed by others
Keywords
References
Blunsden, S., Andrade, E.L., Fisher, R.B.: Non Parametric Classification of Human Interaction. In: MartĂ, J., BenedĂ, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4478, pp. 347–354. Springer, Heidelberg (2007)
Brdiczka, O., Yuen, P.C., Zaidenberg, S., Reignier, P., Crowley, J.L.: Automatic acquisition of context models and its application to video surveillance. In: ICPR, pp. 1175–1178 (2006)
Burghouts, G.J., Marck, J.W.: Reasoning about threats: From observables to situation assessment. IEEE Transactions on Systems, Man, and Cybernetics, Part C 41(5), 608–616 (2011)
Burghouts, G., Schutte, K.: Correlations between 48 human actions improve their detection. In: ICPR (2012)
Fernández-Caballero, A., Castillo, J.C., RodrĂguez-Sánchez, J.M.: Human activity monitoring by local and global finite state machines. Expert Syst. Appl. 39(8), 6982–6993 (2012)
Hays, D.G.: Chomsky hierarchy. In: Encyclopedia of Computer Science, pp. 210–211. John Wiley and Sons Ltd., Chichester
Ivanov, Y.A., Bobick, A.F.: Recognition of visual activities and interactions by stochastic parsing. Pattern Anal. Mach. Intell. 22(8), 852–872 (2000)
Kasteren, T.L., Englebienne, G., Kröse, B.J.: An activity monitoring system for elderly care using generative and discriminative models. Personal Ubiquitous Comput. 14(6), 489–498 (2010)
Kitani, K.M., Sato, Y., Sugimoto, A.: Recovering the basic structure of human activities from a video-based symbol string. In: WMVC, p. 9 (2007)
Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vision 40(2), 99–121 (2000)
Stolcke, A.: An efficient probabilistic context-free parsing algorithm that computes prefix probabilities. Comput. Linguist. 21(2), 165–201 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sanromà , G., Burghouts, G., Schutte, K. (2012). Recognition of Long-Term Behaviors by Parsing Sequences of Short-Term Actions with a Stochastic Regular Grammar. In: Gimel’farb, G., et al. Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2012. Lecture Notes in Computer Science, vol 7626. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34166-3_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-34166-3_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34165-6
Online ISBN: 978-3-642-34166-3
eBook Packages: Computer ScienceComputer Science (R0)