Abstract
In this paper we address the problem of aligning 3-D data with articulated shapes. This problem resides at the core of many motion tracking methods with applications in human motion capture, action recognition, medical-image analysis, etc. We describe an articulated and bending surface representation well suited for this task as well as a method which aligns (or registers) such a surface to 3-D data. Articulated objects, e.g., humans and animals, are covered with clothes and skin which may be seen as textured surfaces. These surfaces are both articulated and deformable and one realistic way to model them is to assume that they bend in the neighborhood of the shape’s joints. We will introduce a surface-bending model as a function of the articulated-motion parameters. This combined articulated-motion and surface-bending model better predicts the observed phenomena in the data and therefore is well suited for surface registration. Given a set of sparse 3-D data (gathered with a stereo camera pair) and a textured, articulated, and bending surface, we describe a register-and-fit method that proceeds as follows. First, the data-to-surface registration problem is formalized as a classifier and is carried out using an EM algorithm. Second, the data-to-surface fitting problem is carried out by minimizing the distance from the registered data points to the surface over the joint variables. In order to illustrate the method we applied it to the problem of hand tracking. A hand model with 27 degrees of freedom is successfully registered and fitted to a sequence of 3-D data points gathered with a stereo camera pair.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Gavrila, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73, 82–98 (1999)
Plaenkers, R., Fua, P.: Articulated soft objects for multi-view shape and motion capture. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 (2003)
Herda, L., Urtasun, R., Fua, P.: Hierarchical implicit surface joint limits for human body tracking. Computer Vision and Image Understanding 99, 189–209 (2005)
Deutscher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filtering. Computer Vision and Pattern Recognition, 2126–2133 (2000)
Sminchisescu, C., Triggs, B.: Estimating articulated human motion with covariance scaled sampling. International Journal of Robotics Research 22, 371–379 (2003)
Delamarre, Q., Faugeras, O.: 3d articulated models and multi-view tracking with physical forces. Computer Vision and Image Understanding 81, 328–357 (2001)
Dewaele, G., Devernay, F., Horaud, R.: Hand motion from 3d point trajectories and a smooth surface model. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 495–507. Springer, Heidelberg (2004)
Athitsos, V., Sclaroff, S.: Estimating 3D hand pose from a cluttered image. In: CVPR 2003: Proceedings of Conference in Computer Vision and Pattern Recognition (2003)
Zhang, Z.: Iterative point matching for registration of free-form curves and surfaces. International Journal on Computer Vision 13, 119–152 (1994)
Ferrie, F.P., Lagarde, J., Whaite, P.: Darboux Frames, Snakes, and Super-Quadrics:Geometry from the Bottom Up. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 771–784 (1993)
Gold, S., Rangarajan, A.: A Graduated Assignment Algorithm for Graph Matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 18, 377–388 (1996)
Rangarajan, A., Chui, H., Bookstein, F.L.: The softassign procrustes matching algorithm. In: Duncan, J.S., Gindi, G. (eds.) IPMI 1997. LNCS, vol. 1230, pp. 29–42. Springer, Heidelberg (1997)
Chui, H., Rangarajan, A.: A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding 89, 114–141 (2003)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood estimation from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, Series B 39, 1–38 (1977)
Cross, A.D.J., Hancock, E.R.: Graph Matching With a Dual-Step EM Algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 1236–1253 (1998)
Luo, B., Hancock, E.: A unified framework for alignment and correspondence. CVIU 92, 26–55 (2003)
Granger, S., Pennec, X.: Multi-scale em-icp: A fast and robust approach for surface registration. In: ECCV 2002. LNCS, vol. 2353, pp. 418–432. Springer, Heidelberg (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dewaele, G., Devernay, F., Horaud, R., Forbes, F. (2006). The Alignment Between 3-D Data and Articulated Shapes with Bending Surfaces. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3953. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744078_45
Download citation
DOI: https://doi.org/10.1007/11744078_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33836-9
Online ISBN: 978-3-540-33837-6
eBook Packages: Computer ScienceComputer Science (R0)