Abstract
In this paper we propose a probabilistic framework that models shape variations and infers dense and detailed 3D shapes from a single silhouette. We model two types of shape variations, the object phenotype variation and its pose variation using two independent Gaussian Process Latent Variable Models (GPLVMs) respectively. The proposed shape variation models are learnt from 3D samples without prior knowledge about object class, e.g. object parts and skeletons, and are combined to fully span the 3D shape space. A novel probabilistic inference algorithm for 3D shape estimation is proposed by maximum likelihood estimates of the GPLVM latent variables and the camera parameters that best fit generated 3D shapes to given silhouettes. The proposed inference involves a small number of latent variables and it is computationally efficient. Experiments on both human body and shark data demonstrate the efficacy of our new approach.
Chapter PDF
References
Prasad, M., Zisserman, A., Fitzgibbon, A.: Single view reconstruction of curved surfaces. In: CVPR, pp. 1345–1354 (2006)
Hoiem, D., Efros, A., Hebert, M.: Automatic photo pop-up. In: SIGGRAPH (2005)
Han, F., Zhu, S.: Bayesian reconstruction of 3D shapes and scenes from a single image. In: Proc. IEEE Int. Workshop on Higher-Level Knowledge (2003)
Rother, D., Sapiro, G.: Seeing 3D objects in a single 2D image. In: ICCV (2009)
Sumner, R., Popovic, J.: Deformation Transfer for Triangle Meshes. In: SIGGRAPH, pp. 399–405 (2004)
Deutscher, J., Reid, I.: Articulated body motion capture by stochastic search. IJCV 61(2), 185–205 (2004)
Corazza, S., Mundermann, L., Chaudhari, A., Demattio, T., Cobelli, C., Andriacchi, T.: A markerless motion capture system to study musculoskeletal biomechanics: Visual hull and simulated annealing approach. Annals Biomed. Eng. 34(6) (2006)
Kakadiaris, I., Metaxas, D.: 3D human model acquisition from multiple views. IJCV 30(3), 191–218 (1998)
Navaratnam, R., Fitzgibbon, A., Cipolla, R.: Semi-supervised Joint Manifold Learning for Multi-valued Regression. In: ICCV (2007)
Salzmann, M., Urtasun, R., Fua, P.: Local deformation models for monocular 3D shape recovery. In: CVPR (2008)
Blanz, V., Vetter, T.: A Morphable model for the synthesis of 3D faces. In: SIGGRAPH, pp. 187–194 (1999)
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J.: Shape completion and animation of people. In: SIGGRAPH, pp. 408–416 (2005)
Balan, A., Sigal, L., Black, M., Davis, J., Haussecker, H.: Detailed Human Shape and Pose from Images. In: CVPR (2007)
Sigal, L., Balan, A., Black, M.: Combined discriminative and generative articulated pose and non-rigid shape estimation. In: NIPS (2007)
Guan, P., Weiss, A., Balan, A., Black, M.: Estimating human shape and pose from a single image. In: ICCV (2009)
Chen, Y., Kim, T.-K., Cipolla, R.: Inferring 3D Shapes and Deformations from Single Views, Technical Report, CUED/F-INFENG/TR.654 (2010)
Criminisi, A., Reid, I., Zisserman, A.: Single view metrology. IJCV 40(2), 123–148 (2000)
Saxena, A., Chung, S., Ng, A.: 3-D depth reconstruction from a single still image. IJCV 76(1), 53–69 (2008)
Hassner, T., Basri, R.: Example based 3D reconstruction from single 2D images. In: Beyond Patches Workshop at CVPR, p. 15 (2006)
Liu, J., Cao, L., Li, Z., Tang, X.: Plane-based optimization for 3D object reconstruction from single line drawings. IEEE Trans. PAMI 30(2), 315–327 (2008)
Torresani, L., Hertzmann, A., Bregier, C.: Nonrigid structure-from-motion, Estimating shape and motion with hierachical priors. IEEE Trans. PAMI 30(5) (2008)
Lawrence, N.: Gaussian process latent variable models for visualisation of high dimensional data. In: NIPS, vol. 16, pp. 329–336 (2004)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. PAMI 24(24), 509–522 (2002)
Besl, P., Mckey, N.: A method for registration of 3-D shapes. IEEE Trans. PAMI 14(2), 239–256 (1992)
Rother, C., Kolmogorov, V., Blake, A.: GrabCut – interactive foreground extraction using iterated graph cuts. In: SIGGRAPH, pp. 309–314 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
1 Electronic Supplementary Material
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, Y., Kim, TK., Cipolla, R. (2010). Inferring 3D Shapes and Deformations from Single Views. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6313. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15558-1_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-15558-1_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15557-4
Online ISBN: 978-3-642-15558-1
eBook Packages: Computer ScienceComputer Science (R0)