Abstract
This contribution aims at assisting video surveillance operators with automatic understanding of situations in videos. The situations comprise many different agents interacting in groups. To this end we extended an existing situation recognition framework based on Situation Graph Trees and Fuzzy Metric Temporal Logic. Non-parametric mean-shift clustering is utilized to support the logic-based inference process for such group-based situations, namely to improve efficiency. Additionally, the underlying knowledge base was augmented to also handle multi-agent queries and the situation inference was adapted to also handle inference for group-based situations. For evaluation the publicly available BEHAVE video dataset was used consisting of partially annotated real video data of persons. The results show that the proposed system is capable of correctly and efficiently understanding such group-based situations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Arens, M., Gerber, R., Nagel, H.H.: Conceptual representations between video signals and natural language descriptions. IVC 26(1), 53–66 (2008)
Blunsden, S., Fisher, R.: The behave video dataset: ground truthed video for multi-person behavior classification. Annals of the BMVA 2010(4), 1–12 (2010)
González, J., Rowe, D., Varona, J., Roca, F.X.: Understanding dynamic scenes based on human sequence evaluation. IVC 27(10), 1433–1444 (2009)
Michaelsen, E., Doktorski, L., Arens, M.: Shortcuts in production-systems. In: PRIA, vol. 2, pp. 30–38 (2008)
Münch, D., Jüngling, K., Arens, M.: Towards a Multi-purpose Monocular Vision-based High-Level Situation Awareness System. In: International Workshop on Behaviour Analysis and Video Understanding (ICVS 2011), p. 10 (2011)
Nagel, H.H.: Steps toward a cognitive vision system. AI Mag. 25(2), 31–50 (2004)
Naish, L.: Higher-order logic programming in prolog. Tech. rep. Workshop on Multi–Paradigm Logic Programming (1996)
Oh, S., et al.: A large-scale benchmark dataset for event recognition in surveillance video. In: CVPR, pp. 3153–3160 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Münch, D., Michaelsen, E., Arens, M. (2012). Supporting Fuzzy Metric Temporal Logic Based Situation Recognition by Mean Shift Clustering. In: Glimm, B., Krüger, A. (eds) KI 2012: Advances in Artificial Intelligence. KI 2012. Lecture Notes in Computer Science(), vol 7526. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33347-7_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-33347-7_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33346-0
Online ISBN: 978-3-642-33347-7
eBook Packages: Computer ScienceComputer Science (R0)