Abstract
The performance of appearance based face recognition algorithms is adversely affected by illumination variations. Illumination normalization can greatly improve their performance. We present a novel algorithm for illumination normalization of color face images. Face Albedo is estimated from a single color face image and its co-registered 3D image (pointcloud). Unlike existing approaches, our algorithm takes into account both Lambertian and specular reflections as well as attached and cast shadows. Moreover, our algorithm is invariant to facial pose and expression and can effectively handle the case of multiple extended light sources. The approach is based on Phong’s lighting model. The parameters of the Phong’s model and the number, direction and intensities of the dominant light sources are automatically estimated. Specularities in the face image are used to estimate the directions of the dominant light sources. Next, the 3D face model is ray-casted to find the shadows of every light source. The intensities of the light sources and the parameters of the lighting model are estimated by fitting Phong’s model onto the skin data of the face. Experiments were performed on the challenging FRGC v2.0 data and satisfactory results were achieved (the mean fitting error was 6.3% of the maximum color value).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chen, H., Belhumuer, P., Jacobs, D.: In Search of Illumination Invariants. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 254–261 (2000)
Adini, Y., Moses, Y., Ullman, S.: Face Recognition: The Problem Of Compensating For Changes In Illumination Direction. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 721–732 (1997)
Lowe, D.G.: bject Recognition from Local Scale-invariant Features. In: International Conference on Computer Vision, pp. 1150–1157 (1999)
Gao, Y., Leung, M.: Face Recognition Using Line Edge Map. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 24(6), 764–779 (2002)
Moghaddam, B., Pentland, A.: Probabalistic Visual Learning for Object Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 19(7), 694–710 (1997)
Weiss, Y.: Deriving Intrinsic Images from Sequences. In: Proc. of Int. Conf. Computer Vision (2001)
Jacobs, D., Belhumeur, P., Basri, R.: Comparing Images under Variable Illumination. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 610–617 (1998)
Liu, C., Wechsler, H.: A Gabor Feature Classifier for Face Recognition. In: Proc. of Int. Conf. Computer Vision (2001)
Duc, B., Fischer, S., Bigun, J.: Face authentication with Gabor information on deformable graphs. IEEE Transactions On Image Processing 8(4), 504–516 (1999)
Lyons, M., Budynek, J., Akamatsu, S.: Automatic classification of single facial images. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 21(12), 1357–1362 (1999)
Georghiades, A., Belhumeur, P., Kriegman, D.: From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose. EEE Transactions on Pattern Analysis and Machine Intelligence Pami 23(6), 643–660 (2001)
and, What is the Set of Images of an Object under all Possible Illumination Conditions? International Journal of Computer Vision 28(3), 245–260 (1998)
Ramamoorthi, R., Hanrahan, P.: On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. Journal- Optical Society of America A 18(10), 2448–2459 (2001)
Basri, R., Jacobs, D.: Lambertian Reflectance and Linear Subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 25(2), 218–232 (2003)
and, Adaptive Histogram Equalization and its variations. Computer Vision, Graphics, and Image Processing 39(3), 355–368 (1987)
Bovik, A.: Handbook of image and video processing. Academic Press, London (2000)
Shan, S., Gao, W., Cao, B., Zhao, D.: Illumination Normalization for Robust Face Recognition Against Varying Lighting Conditions. In: IEEE Workshop on AMFG (2003)
Lee, C., Moghaddam, B.: A Practical Face Relighting Method for Directional Light Normalization. In: Zhao, W., Gong, S., Tang, X. (eds.) AMFG 2005. LNCS, vol. 3723, Springer, Heidelberg (2005)
Riklin-Raviv, Shashua, A.: The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 23(2), 129–139 (2001)
Shafer, S.: Using Color to Separate Reflection Components. COLOR Research and Applications 10(4), 210–218 (1985)
Phong, B.: Illumination for computer generated images. Comm. ACM 18(6), 311–317 (1975)
Foley, J., Dam, A., Feiner, S., Hughes, J.: Computer Graphics: Principles and Practice. Addison-Wesley, Reading (1990)
Wang, J., Yang, W., Acharya, R.: Color clustering techniques for color-content-based image retrieval from image databases. IEEE International Conference on Multimedia Computing and Systems, 442–449 (1997)
Sobottka, K., Pitas, I.: A Novel Method for Automatic Face Segmentation, Facial Feature Extraction and Tracking. Signal Processing: Image Comm. 12(3), 263–281 (1998)
Phung, S., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 27(1), 148–154 (2005)
Jain, A., Murty, M., Flynn, P.: Data Clustering: A Review. Computing Surveys 31(3), 264–323 (1999)
Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the Face Recognition Grand Challenge. IEEE Computer Vision and Pattern Recognition 1, 947–954 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Al-Osaimi, F.R., Bennamoun, M., Mian, A. (2006). Illumination Normalization for Color Face Images. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2006. Lecture Notes in Computer Science, vol 4291. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11919476_10
Download citation
DOI: https://doi.org/10.1007/11919476_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-48628-2
Online ISBN: 978-3-540-48631-2
eBook Packages: Computer ScienceComputer Science (R0)