Abstract
This paper presents a cognitive vision approach to recognize a set of interesting activities of daily living (ADLs) for elderly at home. The proposed approach is composed of a video analysis component and an activity recognition component.
A video analysis component contains person detection, person tracking and human posture recognition. A human posture recognition is composed of a set of postures models and a dedicated human posture recognition algorithm.
Activity recognition component contains a set of video event models and a dedicated video event recognition algorithm.
In this study, we collaborate with medical experts (gerontologists from Nice hospital) to define and model a set of scenarios related to the interesting activities of elderly. Some of these activities require to detect a fine description of human body such as postures. For this purpose, we propose ten 3D key human postures usefull to recognize a set of interesting human activities regardless of the environment. Using these 3D key human postures, we have modeled thirty four video events, simple ones such as “a person is standing” and composite ones such as “a person is feeling faint”. We have also adapted a video event recognition algorithm to detect in real time some activities of interest by adding posture.
The novelty of our approach is the proposed 3D key postures and the set of activity models of elderly person living alone in her/his own home.
To validate our proposed models, we have performed a set of experiments in the Gerhome laboratory which is a realistic site reproducing the environment of a typical apartment. For these experiments, we have acquired and processed ten video sequences with one actor. The duration of each video sequence is about ten minutes and each video contains about 4800 frames.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Boulay, B., Bremond, F., Thonnat, M.: Applying 3d human model in a posture recognition system. Pattern Recognition Letter (2006)
Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: Real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 780–785 (1997)
Fujiyoshi, H., Lipton, A.J., Kanade, T.: Real-time human motion analysis by image skeletonisation. IEICE Trans. Inf. & Syst. (January 2004)
Tao, Z., Ram, N.: Tracking multiple humans in complex situations. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(9) (September 2004)
Agarwal, A., Triggs, B.: Recovering 3d human pose from monocular images. IEEE Transactions on Patten Analysis and Machine Intelligence 28(1) (January 2006)
Ayers, D., Shah, M.: Monitoring human behavior from video taken in an office environment. Image and Vision Computing (2001)
Yacoob, Y., Black, M.J.: Parameterized modeling and recognition of activities. In: ICCV (1998)
Jebara, T., Pentland, A.: Action reaction learning: Analysis and synthesis of human behavior. In: IEEE Workshop on the Interpretation of Visual Motion (1998)
Aggarwal, J.K., Cai, Q.: Human motion analysis: A review. In: Computer Vision and Image Understanding (1999)
Moore, D.J., Essa, I.A., Hayes, M.H.: Exploiting human actions and object context for recognition tasks. In: ICCV (1999)
Chomat, O., Crowley, J.: Probabilistic recognition of activity using local appearance. In: International Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, Canada (June 1999)
Intille, S., Bobick, A.: Recognizing planned, multi-person action. Computer Vision and Image Understanding (2001)
Hoey, J., Bertoldi, A.V., Poupart, P., Mihailidis, A.: Assisting persons with dementia during handwashing using a partially observable markov decision process. In: International Conference on Computer Vision Systems (ICVS), Germany (March 2007)
Ivanov, Y., Bobick, A.: Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Patterns Analysis and Machine Intelligence (2000)
Vu, V., Bremond, F., Thonnat, M.: Automatic video interpretation: A novel algorithm based for temporal scenario recognition. In: The Eighteenth International Joint Conference on Artificial Intelligence, September 9-15 (2003)
Avanzi, A., Bremond, F., Tornieri, C., Thonnat, M.: Design and assessement of an intelligent activity monitoring platform. EURASIP Journal on Applied Signal Processing, Special Issue on Advances in Intelligent Vision Systems: Methods and Applications (August 2005)
Allen, J.F.: Maintaining knowledge about temporal intervals. Communications of the ACM (1983)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zouba, N., Boulay, B., Bremond, F., Thonnat, M. (2008). Monitoring Activities of Daily Living (ADLs) of Elderly Based on 3D Key Human Postures. In: Caputo, B., Vincze, M. (eds) Cognitive Vision. ICVW 2008. Lecture Notes in Computer Science, vol 5329. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92781-5_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-92781-5_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92780-8
Online ISBN: 978-3-540-92781-5
eBook Packages: Computer ScienceComputer Science (R0)