Hierarchical 3D Pose Estimation for Articulated Human Body Models from a Sequence of Volume Data
This contribution describes a camera-based approach to fully automatically extract the 3D motion parameters of persons using a model based strategy. In a first step a 3D body model of the person to be tracked is constructed automatically using a calibrated setup of sixteen digital cameras and a monochromatic background. From the silhouette images the 3D shape of the person is determined using the shape-from-silhouette approach. This model is segmented into rigid body parts and a dynamic skeleton structure is fit. In the second step the resulting movable, personalized body template is exploited to estimate the 3D motion parameters of the person in arbitrary poses. Using the same camera setup and the shape-from-silhouette approach a sequence of volume data is captured to which the movable body template is fit. Using a modified ICP algorithm the fitting is performed in a hierarchical manner along the the kinematic chains of the body model. The resulting sequence of motion parameters for the articulated body model can be used for gesture recognition, control of virtual characters or robot manipulators.
KeywordsMotion Estimation Kinematic Chain Model Skeleton Silhouette Image Lower Torso
Unable to display preview. Download preview PDF.
- 1.W. Niem, H. Broszio: Mapping texture from multiple camera views onto 3D-object models for computer animation. In: Proceed. Internat. Workshop on Stereoscopic and Three Dimensional Imaging, Santorini, Greece, (1995). 30Google Scholar
- 3.L. Dekker, I. Douros, B. F. Buston, P. Treleaven: Building symbolic information for 3D human body modeling from range data. 2nd Internat. Conf. on 3D Digital Imaging and Modeling, Ottawa, Ont., Canada, (4–8 Oct. 1999). 30Google Scholar
- 5.P. J. Besl, N. D. McKay: A method for registration of 3D shapes. IEEE Trans. on Pattern Analysis and Machine Intelligence, 14 (1992) No.2. 32Google Scholar
- 6.D. A. Simon, M. Hebert, T. Kanade: Real-time 3D pose estimation using a highspeed range sensor. In: Proceed. IEEE Internat. Conf. on Robotics and Automation, Vol. 3 (1994) 2235–2240.Google Scholar
- 8.S. Weik, O. Niemeyer: Three-dimensional motion estimation for articulated human templates using a sequence of stereoscopic image pairs. In: SPIE Proceed. of Visual Communications and Image Processing, VCIP99, SPIE-3653 (1999). 31Google Scholar