Advertisement

Learning from Real Images to Model Lighting Variations for Face Images

  • Xiaoyue Jiang
  • Yuk On Kong
  • Jianguo Huang
  • Rongchun Zhao
  • Yanning Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5305)

Abstract

For robust face recognition, the problem of lighting variation is considered as one of the greatest challenges. Since the nine points of light (9PL) subspace is an appropriate low-dimensional approximation to the illumination cone, it yielded good face recognition results under a wide range of difficult lighting conditions. However building the 9PL subspace for a subject requires 9 gallery images under specific lighting conditions, which are not always possible in practice. Instead, we propose a statistical model for performing face recognition under variable illumination. Through this model, the nine basis images of a face can be recovered via maximum-a-posteriori (MAP) estimation with only one gallery image of that face. Furthermore, the training procedure requires only some real images and avoids tedious processing like SVD decomposition or the use of geometric (3D) or albedo information of a surface. With the recovered nine dimensional lighting subspace, recognition experiments were performed extensively on three publicly available databases which include images under single and multiple distant point light sources. Our approach yields better results than current ones. Even under extreme lighting conditions, the estimated subspace can still represent lighting variation well. The recovered subspace retains the main characteristics of 9PL subspace. Thus, the proposed algorithm can be applied to recognition under variable lighting conditions.

Keywords

Face Recognition Face Image Real Image Basis Image Cast Shadow 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Guo, X., Leung, M.: Face recognition using line edge map. IEEE Trans. Pattern Recognition and Machine Intelligence 24(6), 764–799 (2002)CrossRefGoogle Scholar
  2. 2.
    Shashua, A., Tammy, R.: The quotient images: class-based rendering and recognition with varying illuminations. IEEE Trans. Pattern Recognition and Machine Intelligence 23(2), 129–139 (2001)CrossRefGoogle Scholar
  3. 3.
    Gross, R., Brajovic, V.: An image processing algorithm for illumination invariant face recognition. In: 4th International Conference on Audio and Video Based Biometric Person Authentication, pp. 10–18 (2003)Google Scholar
  4. 4.
    Wang, H., Li, S.Z., Wang, Y.: Generalized quotient image. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2004)Google Scholar
  5. 5.
    Hallinan, P.: A low-dimensional representation of human faces for arbitrary lighting conditions. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 995–999 (1994)Google Scholar
  6. 6.
    Nayar, S., Murase, H.: Dimensionality of illumination in appearance matching. In: Proc. IEEE Conf. Robotics and Automation, pp. 1326–1332 (1996)Google Scholar
  7. 7.
    Belhumeur, P., Kriegman, D.J.: What is set of images of an object under all possible lighting conditions? In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 270–277 (1996)Google Scholar
  8. 8.
    Georghiads, A., Belhumeur, P., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Recognition and Machine Intelligence 23(6), 643–660 (2001)CrossRefGoogle Scholar
  9. 9.
    Yuille, A., Snow, D., Epstein, R., Belhumeur, P.: Determing generative models of objects under varying illumination: shape and albedo from multiple images using SVD and integrability. International Journal of Computer Vision 35(3), 203–222 (1999)CrossRefGoogle Scholar
  10. 10.
    Ramamoorthi, R., Hanrahan, P.: On the relationship between radiance and irradiance: determine the illumination from images of a convex Lambertian object. J. Optical. Soc. Am. A 18(10), 2448–2459 (2001)CrossRefMathSciNetGoogle Scholar
  11. 11.
    Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Recognition and Machine Intelligence 25(2), 218–233 (2003)CrossRefGoogle Scholar
  12. 12.
    Zhang, L., Samaras, D.: Face recognition under variable lighting using harmonic image exemplars. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2003)Google Scholar
  13. 13.
    Wen, Z., Liu, Z., Huang, T.: Face relighting with radiance environment map. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2003)Google Scholar
  14. 14.
    Zhang, L., Wang, S., Samaras, D.: Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2005)Google Scholar
  15. 15.
    Lee, J., Moghaddam, B., Pfister, H., Machiraju, R.: A bilinear illumination model for robust face recognition. In: Proc. IEEE International Conference on Computer Vision (2005)Google Scholar
  16. 16.
    Wang, Y., Liu, Z., Hua, G., et al.: Face re-lighting from a single image under harsh lighting conditions. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2007)Google Scholar
  17. 17.
    Chen, H.F., Belhumeur, P.N., Jacobs, D.W.: In search of illumination invariants. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2000)Google Scholar
  18. 18.
    Zhou, S., Chellappa, R.: Illuminating light field: image-based face recognition across illuminations and poses. In: Proc. IEEE Intl. Conf. on Automatic Face and Gesture Recognition (May 2004)Google Scholar
  19. 19.
    Lee, K., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Recognition and Machine Intelligence 27(5), 684–698 (2005)CrossRefGoogle Scholar
  20. 20.
    Sim, T., Kanade, T.: Combining models and exemplars for face recognition: an illumination example. In: Proc. Of Workshop on Models versus Exemplars in Computer Vision, CVPR 2001 (2001)Google Scholar
  21. 21.
    Adini, Y., Moses, Y., Ullman, S.: Face recognition: the problem of compensating for changes in illumination directions. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 721–733 (1997)CrossRefGoogle Scholar
  22. 22.
    Atkenson, C., Moore, A., Schaal, S.: Locally weighted learning. Artificial Intelligence Review (1996)Google Scholar
  23. 23.
    Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression (pie) database. In: Proc. IEEE International Conference on Automatic Face and Gesture Recognition (May 2002)Google Scholar
  24. 24.
    Martinez, A.M., Benavente, R.: The AR face database. CVC Tech. Report No.24 (1998)Google Scholar
  25. 25.
    Scharf, L.: Statistical signal processing: detection, estimation and time series analysis, p. 54. Addison-Wesley, Reading (1991)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Xiaoyue Jiang
    • 1
    • 2
  • Yuk On Kong
    • 3
  • Jianguo Huang
    • 1
  • Rongchun Zhao
    • 1
  • Yanning Zhang
    • 1
  1. 1.School of Computer ScienceNorthwestern Polytechnical UniversityXi’anChina
  2. 2.School of PsychologyUniversity of BirminghamBirminghamUK
  3. 3.Department of Electronics and InformaticsVrije Universiteit BrusselBrusselsBelgium

Personalised recommendations