Abstract
This paper addresses the problem of accurate and robust tracking of 3D human body pose from depth image sequences. Recovering the large number of degrees of freedom in human body movements from depth image sequence is challenging due to the need to resolve depth ambiguity caused by self-occlusions and difficulty to recover from tracking failure. Human body poses could be estimated with a high accuracy based on local optimization using dense correspondences between 3D depth data and the vertices in an articulated human model. However, it cannot recover from tracking failure. This paper presents a method to reconstruct human pose by detecting and tracking human body anatomical landmarks (key-points) from depth images. The proposed method is robust and recovers from tracking failure when a body part is re-detected. However, its pose estimation accuracy depends solely on image-based localization accuracy of key-points. To address these limitations, we present a flexible Bayesian method for integrating pose estimation results obtained by methods based on key-points and local optimization. Experimental results are shown and performance comparison is presented to demonstrate the effectiveness of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Grest, D., Woetzel, J., Koch, R.: Nonlinear body pose estimation from depth images. In: Kropatsch, W.G., Sablatnig, R., Hanbury, A. (eds.) DAGM 2005. LNCS, vol. 3663, pp. 285–292. Springer, Heidelberg (2005)
Knoop, S., Vacek, S., Dillmann, R.: Sensor fusion for 3d human body tracking with an articulated 3d body model. In: ICRA, pp. 1686–1691 (2006)
Ziegler, J., Nickel, K., Stiefelhagen, R.: Tracking of the articulated upper body on multi-view stereo image sequences. CVPR 1, 774–781 (2006)
Zhu, Y., Fujimura, K.: Constrained optimization for human pose estimation from depth sequences. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part I. LNCS, vol. 4843, pp. 408–418. Springer, Heidelberg (2007)
Sminchisescu, C., Triggs, B.: Kinematic jump processes for monocular 3d human tracking. CVPR 1, 18–20 (2003)
Lee, M.W., Cohen, I.: Proposal maps driven mcmc for estimating human body pose in static images. CVPR 2, 334–341 (2004)
Besl, P., McKay, N.: A method for registration of 3-d shapes. PAMI 14(2), 239–256 (1992)
Lewis, J.P., Cordner, M., Fong, N.: Pose space deformations: A unified approach to shape interpolation and skeleton-driven deoformation. In: SIGGRAPH, pp. 165–172 (2000)
Zhu, Y., Dariush, B., Fujimura, K.: Controlled human pose estimation from depth image streams. In: CVPR time-of-flight workshop (2008)
Cham, T.J., Rehg, J.: A multiple hypothesis approach to figure tracking. CVPR 2, 239–245 (1999)
Demirdjian, D., Taycher, L., Shakhnarovich, G., Grauman, K., Darrell, T.: Avoiding the ‘streetlight effect’: Tracking by exploring likelihood modes. ICCV 1, 357–364 (2005)
Morris, D., Rehg, J.: Singularity analysis for articulated object tracking. In: CVPR, pp. 189–196 (1998)
SwissRanger: online time-of-flight camera information from, http://www.mesa-imaging.ch/prodviews.php
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhu, Y., Fujimura, K. (2010). Bayesian 3D Human Body Pose Tracking from Depth Image Sequences. In: Zha, H., Taniguchi, Ri., Maybank, S. (eds) Computer Vision – ACCV 2009. ACCV 2009. Lecture Notes in Computer Science, vol 5995. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12304-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-12304-7_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12303-0
Online ISBN: 978-3-642-12304-7
eBook Packages: Computer ScienceComputer Science (R0)