Abstract
We propose a method to estimate the detailed 3D shape of a person from images of that person wearing clothing. The approach exploits a model of human body shapes that is learned from a database of over 2000 range scans. We show that the parameters of this shape model can be recovered independently of body pose. We further propose a generalization of the visual hull to account for the fact that observed silhouettes of clothed people do not provide a tight bound on the true 3D shape. With clothed subjects, different poses provide different constraints on the possible underlying 3D body shape. We consequently combine constraints across pose to more accurately estimate 3D body shape in the presence of occluding clothing. Finally we use the recovered 3D shape to estimate the gender of subjects and then employ gender-specific body models to refine our shape estimates. Results on a novel database of thousands of images of clothed and “naked” subjects, as well as sequences from the HumanEva dataset, suggest the method may be accurate enough for biometric shape analysis in video.
Chapter PDF
References
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: Shape completion and animation of people. SIGGRAPH 24, 408–416 (2005)
Bălan, A.O., Sigal, L., Black, M.J., Davis, J.E., Haussecker, H.W.: Detailed human shape and pose from images. In: CVPR (2007)
Bălan, A.O., Black, M.J., Sigal, L., Haussecker, H.W.: Shining a light on human pose: On shadows, shading and the estimation of pose and shape. In: ICCV (2007)
Mündermann, L., Corazza, S., Andriacchi, T.: Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. In: CVPR (2007)
Cheung, K.M., Baker, S., Kanade, T.: Visual hull alignment and refinement across time: A 3D reconstruction algorithm combining shape-from-silhouette with stereo. In: CVPR, vol. 2, pp. 375–382 (2003)
Laurentini, A.: The visual hull concept for silhouette-based image understanding. PAMI 16, 150–162 (1994)
Rosenhahn, B., Kersting, U., Powell, K., Klette, R., Klette, G., Seidel, H.P.: A system for articulated tracking incorporating a clothing model. Machine Vision and Applications (MVA) 18, 25–40 (2007)
Salzmann, M., Pilet, J., Ilic, S., Fua, P.: Surface deformation models for nonrigid 3D shape recovery. PAMI 29, 1481–1487 (2007)
White, R., Crane, K., Forsyth, D.: Capturing and animating occluded cloth. In: ACM Transactions on Graphics (TOG), SIGGRAPH (2007)
de Aguiar, E., Theobalt, C., Stoll, C., Seidel, H.P.: Marker-less deformable mesh tracking for human shape and motion capture. In: CVPR, pp. 2502–2509 (2007)
Stark, J., Hilton, A.: Surface capture for performance-based animation. IEEE Comp. Graphics and Applications 27, 21–31 (2007)
Franco, J.S., Lapierre, M., Boyer, E.: Visual shapes of silhouette sets. In: Proc. 3rd Int. Symp. on 3D Data Processing, Visualization and Transmission (2006)
Cheung, K.M., Baker, S., Kanade, T.: Shape-from-silhouette across time: Part II: Applications to human modeling and markerless motion tracking. IJCV 63, 225–245 (2005)
Grauman, K., Shakhnarovich, G., Darrell, T.: A Bayesian approach to image-based visual hull reconstruction. In: CVPR, vol. 1, pp. 187–194 (2003)
Grauman, K., Shakhnarovich, G., Darrell, T.: Inferring 3D structure with a statistical image-based shape model. In: ICCV, pp. 641–648 (2003)
Moghaddam, B., Yang, M.: Learning gender with support faces. PAMI 24, 707–711 (2002)
Li, X., Maybank, S., Yan, S., Tao, D., Xu, D.: Gait components and their application to gender recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38, 145–155 (2008)
Bouguet, J.Y.: Camera calibration toolbox for Matlab. Technical report (CalTech)
Sigal, L., Black, M.J.: HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion. Technical Report CS-06-08, Brown University (2006)
Brand, M.: Incremental singular value decomposition of uncertain data with missing values. In: ECCV, pp. 707–720 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Electronic Supplementary Material
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bălan, A.O., Black, M.J. (2008). The Naked Truth: Estimating Body Shape Under Clothing. In: Forsyth, D., Torr, P., Zisserman, A. (eds) Computer Vision – ECCV 2008. ECCV 2008. Lecture Notes in Computer Science, vol 5303. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88688-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-88688-4_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88685-3
Online ISBN: 978-3-540-88688-4
eBook Packages: Computer ScienceComputer Science (R0)