Abstract
Face recognition under varying pose is a challenging problem, especially when illumination variations are also present. Under Lambertian model, spherical harmonics representation has proved to be effective in modelling illumination variations for a given pose. In this paper, we extend the spherical harmonics representation to encode pose information. More specifically, we show that 2D harmonic basis images at different poses are related by close-form linear combinations. This enables an analytic method for generating new basis images at a different pose which are typically required to handle illumination variations at that particular pose. Furthermore, the orthonormality of the linear combinations is utilized to propose an efficient method for robust face recognition where only one set of front-view basis images per subject is stored. In the method, we directly project a rotated testing image onto the space of front-view basis images after establishing the image correspondence. Very good recognition results have been demonstrated using this method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barsi, R., Jacobs, D.: Lambertian Reflectance and Linear Subspaces. IEEE Trans. PAMI 25(2), 218–233 (2003)
Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. PAMI 19, 711–720 (1997)
Beyme, B.: Face Recognition Under Varying Pose. Tech. Report 1461, MIT AI Lab (1993)
Blanz, V., Vetter, T.: Face Recognition based on Fitting a 3D Morphable Model. IEEE Trans. PAMI 25(9), 1063–1074 (2003)
Dovgard, R., Basri, R.: Statistical Symmetric Shape from Shading for 3D Structure Recovery of Faces. In: ECCV (2004)
Freeman, W., Tenenbaum, J.: Learning Bilinear Models for Two-Factor Problems in Vision. In: Proceedings, IEEE Conference on CVPR, Puerto Rico, pp. 554–560 (June 1997)
Geoghiades, A., Belhumeur, P., Kriegman, D.: Illumination-Based Image Synthesis: Creating Novel Images of Human Faces Under Differing Pose and Lighting. In: Proceedings, Workshop on Multi-View Modeling and Analysis of Visual Scenes, pp. 47–54 (1999)
Pentland, A., Moghaddam, B., Starner, T.: View-based and Modular Eigenspaces for Face Recognition. In: Proceedings, IEEE Conf. on CVPR, pp. 84–91 (June 1994)
Ramamoorthi, R.: Analytic PCA Construction for theoretical Analysis of Lighting Variability in Images of A Lambertian Object. IEEE. PAMI 24(10), 1322–1333 (2002)
Sim, T., Kanade, T.: Illuminating the Face. Tech. Report CMU-RI-TR-01-31, Robotics Institute, CMU (2001)
Sim, T., Baker, S., Bsat, M.: The CMU Pose, Illumination, and Expression (PIE) Database of Human Faces. In: AFGR, pp. 46–51 (2002)
Yue, Z., Chellappa, R.: Pose-Normailzed View Synthesis of a Symmetric Object Using a Single Image. In: ACCV (2004)
Zhang, L., Samaras, D.: Face Recognition Under Variable Lighting Using Harmonic Image Examplars. In: CVPR, vol. I, pp. 19–25 (2003)
Zhang, L., Wang, S., Samaras, D.: Face Synthesis and Recognition from a Single Image under Arbitrary Unknown Lighting using a Spherical Harmonic Basis Morphable Model. In: CVPR (2005) (to appear)
Zhao, W., Chellappa, R.: SFS Based View Synthesis for Robust Face Recognition. In: Int. Conf. on Automatic Face and Gesture Recognition (2000)
Zhao, W., Chellappa, R.: Symmetric Shape-from-Shading Using Self-ratio Image. Int. Journal Computer Vision 45, 55–75 (2001)
Zhao, W., Chellappa, R., Phillips, J., Rosenfeld, A.: Face Recognition: A Literature Survey. ACM Computing Surveys (December 2003)
Zhou, S., Chellappa, R., Jacobs, D.: Characterization of human faces under illumination variations using rank, integrability, and symmetry constraints. In: ECCV (2004)
3DFS-100 3 Dimensional Face Space Library, 3rd version, University of Freiburg (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yue, Z., Zhao, W., Chellappa, R. (2005). Pose-Encoded Spherical Harmonics for Robust Face Recognition Using a Single Image. In: Zhao, W., Gong, S., Tang, X. (eds) Analysis and Modelling of Faces and Gestures. AMFG 2005. Lecture Notes in Computer Science, vol 3723. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564386_18
Download citation
DOI: https://doi.org/10.1007/11564386_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29229-6
Online ISBN: 978-3-540-32074-6
eBook Packages: Computer ScienceComputer Science (R0)