Abstract
Activity recognition consists of two fundamental tasks: tracking the features/objects of interest, and recognizing the activities. In this paper, we show that these two tasks can be integrated within the framework of a dynamical feedback system. In our proposed method, the recognized activity is continuously adapted based on the output of the tracking algorithm, which in turn is driven by the identity of the recognized activity. A non-linear, non-stationary stochastic dynamical model on the “shape” of the objects participating in the activities is used to represent their motion, and forms the basis of the tracking algorithm. The tracked observations are used to recognize the activities by comparing against a prior database. Measures designed to evaluate the performance of the tracking algorithm serve as a feedback signal. The method is able to automatically detect changes and switch between activities happening one after another, which is akin to segmenting a long sequence into homogeneous parts. The entire process of tracking, recognition, change detection and model switching happens recursively as new video frames become available. We demonstrate the effectiveness of the method on real-life video and analyze its performance based on such metrics as detection delay and false alarm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bar-Shalom, Y., Fortmann, T.E.: Tracking and Data Association. Academic Press, London (1988)
Cham, T.-J., Rehg, J.M.: A multiple hypothesis approach to figure tracking. In: Computer Vision and Pattern Recognition (1999)
Doucet, A., Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, Heidelberg (2001)
Dryden, I., Mardia, K.: Statistical Shape Analysis. John Wiley and Sons, Chichester (1998)
Grimson, W., Lee, L., Romano, R., Stauffer, C.: Using Adaptive Tracking to Classify and Monitor Activities in a Site. In: Computer Vision and Pattern Recognition, pp. 22–31 (1998)
Harville, M., Li, D.: Fast, integrated person tracking and activity recognition with plan-view templates from a single stereo camera. In: Computer Vision and Pattern Recognition, pp. 398–405 (2004)
Hu, W., Tan, T., Wang, L., Maybank, S.: A survey on visual surveillance of object motion and behaviors. IEEE Trans. on Systems, Man, Cybernetics - Part C: Applications and Reviews 34(3) (2004)
Isard, M., Blake, A.: Condensation: Conditional Density Propagation for Visual Tracking. In: International Journal of Computer Vision, pp. 5–28 (1998)
Jackson, J., Yezzi, A., Soatto, S.: Tracking deformable moving objects under severe occlusions. In: IEEE Conference on Decision and control (December 2004)
Li, Y., Boult, T.: Understanding Images of Graphical User Interfaces: A new approach to activity recognition for visual surveillance. In: ACM UIST (2003)
Liao, L., Fox, D., Kautz, H.: Location-based activity recognition using relational markov networks. In: Proc. of the International Joint Conference on Artificial Intelligence (2005)
Niethammer, M., Tannenbaum, A.: Dynamic level sets for visual tracking. In: IEEE Conference on Decision and Control (2004)
North, B., Blake, A., Isard, M., Rittscher, J.: Learning and classification of complex dynamics. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(9), 1016–1034 (2000)
Rathi, Y., Vaswani, N., Tannenbaum, A., Yezzi, A.: Particle Filtering for Geometric Active Contours with Application to Tracking Moving and Deforming Objects. In: Computer Vision and Pattern Recognition (2005)
Rittscher, J., Blake, A.: Classification of human body motion. In: International Conf. on Computer Vision, vol. 2, pp. 634–639 (1999)
Vaswani, N.: Change Detection in Partially Observed Nonlinear Dynamic Systems with Unknown Change Parameters. In: American Control Conference (2004)
Vaswani, N., Chellappa, R.: NonStationary Shape Activities. In: Proc. of IEEE Conf. on Decision and Control (2005)
Vaswani, N., Roy-Chowdhury, A., Chellappa, R.: Shape Activities: A Continuous State HMM for Moving/Deforming Shapes with Application to Abnormal Activity Detection. IEEE Trans. on Image Processing (October 2005)
Zhai, Y., Shah, M.: A general framework for temporal video scene segmentation. In: International Conf. on Computer Vision (2005)
Zhou, S., Chellappa, R., Moghaddam, B.: Visual Tracking and Recognition Using Appearance-Adaptive Models in Particle Filters. IEEE Trans. on Image Processing 13(11), 1491–1506 (2004)
Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video. Computer Vision and Image Understanding 91, 214–245 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Song, B., Roy-Chowdhury, A.K., Vaswani, N. (2006). Integrated Tracking and Recognition of Human Activities in Shape Space. In: Kalra, P.K., Peleg, S. (eds) Computer Vision, Graphics and Image Processing. Lecture Notes in Computer Science, vol 4338. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11949619_42
Download citation
DOI: https://doi.org/10.1007/11949619_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68301-8
Online ISBN: 978-3-540-68302-5
eBook Packages: Computer ScienceComputer Science (R0)