Abstract
In this paper, we aim to recover the 3D shape of a human face using a single image. We use a combination of symmetric shape from shading by Zhao and Chellappa and statistical approach for facial shape reconstruction by Atick, Griffin and Redlich. Given a single frontal image of a human face under a known directional illumination from a side, we represent the solution as a linear combination of basis shapes and recover the coefficients using a symmetry constraint on a facial shape and albedo. By solving a single least-squares system of equations, our algorithm provides a closed-form solution which satisfies both symmetry and statistical constraints in the best possible way. Our procedure takes only a few seconds, accounts for varying facial albedo, and is simpler than the previous methods. In the special case of horizontal illuminant direction, our algorithm runs even as fast as matrix-vector multiplication.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Horn, B.K.P.: Shape from Shading: A Method for Obtaining the Shape of a Smooth Opaque Object from One View. MIT AI-TR-232 (1970)
Zhang, R., Tsai, P.S., Cryer, J.E., Shah, M.: Shape from Shading: A Survey. IEEE Trans. on PAMI 21(8), 690–706 (1999)
Shimshoni, I., Moses, Y., Lindenbaum, M.: Shape Reconstruction of 3D Bilaterally Symmetric Surfaces. IJCV 39(2), 97–110 (2000)
Zhao, W., Chellappa, R.: Robust Face Recognition using Symmetric Shape-from-Shading. University of Maryland, CARTR-919 (1999)
Zhao, W., Chellappa, R.: Illumination-Insensitive Face Recognition using Symmetric Shape-from-Shading. In: Proc. of CVPR, pp. 286–293 (2000)
Lee, C.H., Rosenfeld, A.: Albedo estimation for scene segmentation. Pattern Recognition Letters 1(3), 155–160 (1982)
Tsai, P.S., Shah, M.: Shape from Shading with Variable Albedo. In: Optical Engineering, pp. 1212–1220 (1998)
Nandy, D., Ben-Arie, J.: Shape from Recognition and Learning: Recovery of 3-D Face Shapes. In: Proc. of CVPR, vol. 2, pp. 2–7 (1999)
Nandy, D., Ben-Arie, J.: Shape from Recognition and Learning: Recovery of 3-D Face Shapes. IEEE Trans. On Image Processing 10(2), 206–218 (2001)
Ononye, A.E., Smith, P.W.: Estimating the Shape of A Surface with Non-Constant Reflectance from a Single Color Image. In: Proc. BMVC, pp. 163–172 (2002)
Atick, J.J., Griffin, P.A., Redlich, A.N.: Statistical Approach to Shape from Shading: Reconstruction of Three-Dimensional Face Surfaces from Single Two- Dimensional Images. Neural Computation 8(6), 1321–1340 (1996)
Blanz, V., Vetter, T.A.: A morphable model for the synthesis of 3d faces. In: Proc. of SIGGRAPH, pp. 187–194 (1999)
Romdhani, S., Blanz, V., Vetter, T.: Face Identification by Fitting a 3D Morphable Model using Linear Shape and Texture Error Functions. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 3–19. Springer, Heidelberg (2002)
Blanz, V., Romdhani, S., Vetter, T.: Face Identification across different Poses and Illuminations with a 3D Morphable Model. In: Proc. of the IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 202–207 (2002)
Romdhani, S., Vetter, T.: Efficient, Robust and Accurate Fitting of a 3D Morphable Model. In: Proc. of ICCV, pp. 59–66 (2003)
Pentland, A.P.: Finding the Illuminant Direction. JOSA 72, 448–455 (1982)
Liu, Y., Schmidt, K., Cohn, J., Mitra, S.: Facial Asymmetry Quantification for Expression Invariant Human Identification. Computer Vision and Image Understanding 91(1/2), 138–159 (2003)
Basri, R., Jacobs, D.W.: Photometric Stereo with General, Unknown Lighting. In: Proc. of CVPR, pp. 374–381 (2001)
Yilmaz, A., Shah, M.: Estimation of Arbitrary Albedo and Shape from Shading for Symmetric Objects. In: Proc. of BMVC, pp. 728–736 (2002)
Pentland, A.P.: Linear Shape from Shading. IJCV 4(2), 153–162 (1990)
Cryer, J., Tsai, P., Shah, M.: Combining shape from shading and stereo using human vision model. University of Central Florida, CSTR-92-25 (1992)
Jacobs, D.W., Belhumeur, P.N., Basri, R.: Comparing images under variable illumination. In: Proc. of CVPR, pp. 610–617 (1998)
Zauderer, E.: Partial Differential Equations of Applied Mathematics, 2nd edn. John Wiley and Sons, Chichester (1983)
Jollife, I.T.: Principal Component Analysis. Springer, New York (1986)
Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)
USF DARPA Human-ID 3D Face Database, Courtesy of Prof. Sudeep Sarkar, University of South Florida, Tampa, FL, http://marthon.csee.usf.edu/HumanID/
Lee, D.D., Seung, H.S.: Learning the Parts of Objects by Non-Negative Matrix Factorization. Nature 401, 788–791 (1999)
Hyvaerinen, A., Oja, E.: Independent Component Analysis: Algorithms and Applications. Neural Networks 13(4), 411–430 (2000)
Bartlett, M.S., Movellan, J.R., Sejnowski, T.J.: Face recognition by independent component analysis. IEEE Trans. on Neural Networks 13(6), 1450–1464 (2002)
Cheng, C.M., Lai, S.H.: A PDM Based Approach to Recovering 3D Face Pose and Structure from Video. In: Proc. of Int. Conf. on Information Technology, pp. 238–242 (2003)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From Few To Many: Generative Models For Recognition Under Variable Pose and Illumination. In: Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 277–284 (2000)
Jin, H., Favaro, P., Soatto, S.: Real-Time Feature Tracking and Outlier Rejection with Changes in Illumination. In: Proc. of ICCV, pp. 684–689 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dovgard, R., Basri, R. (2004). Statistical Symmetric Shape from Shading for 3D Structure Recovery of Faces. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24671-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-540-24671-8_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21983-5
Online ISBN: 978-3-540-24671-8
eBook Packages: Springer Book Archive