Abstract
For robust face recognition, the problem of lighting variation is considered as one of the greatest challenges. Since the nine points of light (9PL) subspace is an appropriate low-dimensional approximation to the illumination cone, it yielded good face recognition results under a wide range of difficult lighting conditions. However building the 9PL subspace for a subject requires 9 gallery images under specific lighting conditions, which are not always possible in practice. Instead, we propose a statistical model for performing face recognition under variable illumination. Through this model, the nine basis images of a face can be recovered via maximum-a-posteriori (MAP) estimation with only one gallery image of that face. Furthermore, the training procedure requires only some real images and avoids tedious processing like SVD decomposition or the use of geometric (3D) or albedo information of a surface. With the recovered nine dimensional lighting subspace, recognition experiments were performed extensively on three publicly available databases which include images under single and multiple distant point light sources. Our approach yields better results than current ones. Even under extreme lighting conditions, the estimated subspace can still represent lighting variation well. The recovered subspace retains the main characteristics of 9PL subspace. Thus, the proposed algorithm can be applied to recognition under variable lighting conditions.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Guo, X., Leung, M.: Face recognition using line edge map. IEEE Trans. Pattern Recognition and Machine Intelligence 24(6), 764–799 (2002)
Shashua, A., Tammy, R.: The quotient images: class-based rendering and recognition with varying illuminations. IEEE Trans. Pattern Recognition and Machine Intelligence 23(2), 129–139 (2001)
Gross, R., Brajovic, V.: An image processing algorithm for illumination invariant face recognition. In: 4th International Conference on Audio and Video Based Biometric Person Authentication, pp. 10–18 (2003)
Wang, H., Li, S.Z., Wang, Y.: Generalized quotient image. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2004)
Hallinan, P.: A low-dimensional representation of human faces for arbitrary lighting conditions. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 995–999 (1994)
Nayar, S., Murase, H.: Dimensionality of illumination in appearance matching. In: Proc. IEEE Conf. Robotics and Automation, pp. 1326–1332 (1996)
Belhumeur, P., Kriegman, D.J.: What is set of images of an object under all possible lighting conditions? In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 270–277 (1996)
Georghiads, A., Belhumeur, P., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Recognition and Machine Intelligence 23(6), 643–660 (2001)
Yuille, A., Snow, D., Epstein, R., Belhumeur, P.: Determing generative models of objects under varying illumination: shape and albedo from multiple images using SVD and integrability. International Journal of Computer Vision 35(3), 203–222 (1999)
Ramamoorthi, R., Hanrahan, P.: On the relationship between radiance and irradiance: determine the illumination from images of a convex Lambertian object. J. Optical. Soc. Am. A 18(10), 2448–2459 (2001)
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Recognition and Machine Intelligence 25(2), 218–233 (2003)
Zhang, L., Samaras, D.: Face recognition under variable lighting using harmonic image exemplars. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2003)
Wen, Z., Liu, Z., Huang, T.: Face relighting with radiance environment map. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2003)
Zhang, L., Wang, S., Samaras, D.: Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2005)
Lee, J., Moghaddam, B., Pfister, H., Machiraju, R.: A bilinear illumination model for robust face recognition. In: Proc. IEEE International Conference on Computer Vision (2005)
Wang, Y., Liu, Z., Hua, G., et al.: Face re-lighting from a single image under harsh lighting conditions. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2007)
Chen, H.F., Belhumeur, P.N., Jacobs, D.W.: In search of illumination invariants. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2000)
Zhou, S., Chellappa, R.: Illuminating light field: image-based face recognition across illuminations and poses. In: Proc. IEEE Intl. Conf. on Automatic Face and Gesture Recognition (May 2004)
Lee, K., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Recognition and Machine Intelligence 27(5), 684–698 (2005)
Sim, T., Kanade, T.: Combining models and exemplars for face recognition: an illumination example. In: Proc. Of Workshop on Models versus Exemplars in Computer Vision, CVPR 2001 (2001)
Adini, Y., Moses, Y., Ullman, S.: Face recognition: the problem of compensating for changes in illumination directions. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 721–733 (1997)
Atkenson, C., Moore, A., Schaal, S.: Locally weighted learning. Artificial Intelligence Review (1996)
Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression (pie) database. In: Proc. IEEE International Conference on Automatic Face and Gesture Recognition (May 2002)
Martinez, A.M., Benavente, R.: The AR face database. CVC Tech. Report No.24 (1998)
Scharf, L.: Statistical signal processing: detection, estimation and time series analysis, p. 54. Addison-Wesley, Reading (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, X., Kong, Y.O., Huang, J., Zhao, R., Zhang, Y. (2008). Learning from Real Images to Model Lighting Variations for Face Images. In: Forsyth, D., Torr, P., Zisserman, A. (eds) Computer Vision – ECCV 2008. ECCV 2008. Lecture Notes in Computer Science, vol 5305. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88693-8_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-88693-8_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88692-1
Online ISBN: 978-3-540-88693-8
eBook Packages: Computer ScienceComputer Science (R0)