Abstract
In this paper we present an approach for capturing 3D body motion and inferring human body posture from detected silhouettes. We show that the integration of two or more silhouettes allows us to perform a 3D body reconstruction while each silhouette can be used for identifying human body postures. The 3D reconstruction is based on the representation of body parts using Generalized Cylinders providing an estimation of the 3D shape of the human body. The 3D shape description is refined by fitting an articulated body model using a particle filter technique. Identifying human body posture from the 2D silhouettes can reduce the complexity of the particle filtering by reducing the search space. We present an appearance-based learning method that uses a shape descriptor of the 2D silhouette for classifying and identifying human posture. The proposed method does not require an articulated body model fitted onto the reconstructed 3D geometry of the human body: It complements the articulated body model since we can define a mapping between the observed shape and the learned descriptions for inferring the articulated body model.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
R. Basri, L. Costa, D. Geiger, and D. Jacobs. Determining the similarity of deformable shapes. Vision Research, (38):2365–2385, 1998.
S. Belongie, J. Malik, and J. Puzicha. Matching shapes. In IEEE Proceedings of the International Conference on Computer Vision, Vancouver, Canada, July 2001.
T. Binford. Visual perception by computer. In IEEE Conference on Systems Science and Cybernetics, 1971.
I. Cohen, N. Ayache, and P. Sulger. Tracking points on deformable objects using curvature information. In Proceedings of the Second European Conference on Computer Vision, Santa Margherita Ligure, Italy, May 1992.
I. Cohen and I. Herlin. Curves matching using geodesic paths. In IEEE Proceedings of Computer Vision and Pattern Recognition, Santa Barbara, June 1998.
J. Deutscher, A. Blake, and I. Reid. Articulated body motion capture by annealed particle filtering. In IEEE Proceedings of Computer Vision and Pattern Recognition, Hilton-Head, 2000.
D. DiFranco, T. Cham, and J. Rehg. Reconstruction of 3d figure motion from 2d correspondences. In IEEE Proceedings of Computer Vision and Pattern Recognition, December 2001.
S. Iwasawa et al. Human body postures from trinocular camera images. In International Conference on Automatic Face and Gesture Recognition, pages 326–331, 2000.
J. Gluckman and S. K. Nayar. Rectifying transformations that minimize resampling effects. In IEEE Proceedings of Computer Vision and Pattern Recognition, Kauai, December 2001.
A. Hilton and P. Fua. Modeling people toward vision-based understanding of a person’s shape, appearance, and movement. Computer Vision and Image Understanding, 81(3):227–230, 2001.
K. Ikeuchi, T. Shakunaga, M. Wheeler, and T. Yamazaki. Invariant histograms and deformable template matching for sar target recognition. In IEEE Proceedings of Computer Vision and Pattern Recognition, 1996.
M. Isard and A. Blake. Visual tracking by stochastic propagation of conditional density. In Proceedings of the European Conference on Computer Vision, pages 343–356, 1996.
A. E. Johnson and M. Hebert. Using spin-images for efficient multiple model recognition in cluttered 3-D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5):433–449, 1999.
I.A. Kakadiaris and D. Metaxas. Three-dimensional human body model acquisition from multiple views. International Journal of Computer Vision, 30(3):227–230, 1998.
T. Kanade, H. Saito, and S. Vedula. The 3D room: Digitizing time-varying 3D events by synchronized multiple video streams. Technical report, CMU-RI, 1998.
R. J. Prokop and A. P. Reeves. A survey of moment-based techniques for unoccluded object representation and recognition. CVGIP: Graphics Models and Image Processsing, 54(5):438–460, 1992.
K. Siddiqi, A. Shokoufandeh, S. J. Dickinson, and S. W. Zucker. Shock graphs and shape matching. Computer Vision, pages 222–229, 1998.
C. Sminchisescu and B. Triggs. Covariance scaled sampling for monocular 3d body tracking. In IEEE Proceedings of Computer Vision and Pattern Recognition, December 2001.
F. Solina and R. Bajcsy. Recovery of parametric models from range images: The case for superquadrics with global deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990.
M. Turk and G. Robertson. Perceptual user interfaces. Communications of the ACM, March 2000.
V.N. Vapnik. Statistical Learning Theory. Wiley, New York, 1998.
K. Wu and M. Levine. Recovering parametrics geons from multiview range data. In IEEE Proceedings of Computer Vision and Pattern Recognition, pages 159–166, June 1994.
I. Young, J. Walker, and J. Bowie. An analysis technique for biological shape. Computer Graphics and Image Processing, (25):357–370, 1974.
D. Zhang and M. Hebert. Harmonic maps and their applications in surface matching. In IEEE Proceedings of Computer Vision and Pattern Recognition, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cohen, I., Lee, M.W. (2002). 3D Body Reconstruction for Immersive Interaction. In: Perales, F.J., Hancock, E.R. (eds) Articulated Motion and Deformable Objects. AMDO 2002. Lecture Notes in Computer Science, vol 2492. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36138-3_10
Download citation
DOI: https://doi.org/10.1007/3-540-36138-3_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00149-2
Online ISBN: 978-3-540-36138-1
eBook Packages: Springer Book Archive