Abstract
This paper presents a novel 3D face shape capture device suitable for practical face recognition applications. A new surface fitting based face alignment algorithm is then presented to normalise the pose in preparation for recognition. The 3D data capture consists of a photometric stereo rig capable of acquiring four images, each with a different light source direction, in just 15ms. This high-speed data acquisition process allows all images to be taken without significant movement between images, a previously highly restrictive disadvantage of photometric stereo. The alignment algorithm is based on fitting bivariate polynomials to the reconstructed faces and calculating the pitch, roll and yaw from the resulting polynomial parameters. Successful experiments are performed on a range of faces and pose variations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zhao, W., Chellappa, R. (eds.): Face Processing: Advanced Modeling and Methods. Elsevier, Amsterdam (2006)
Bowyer, K.W., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Comp. Vis. Im. Understanding 101, 1–15 (2006)
Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Optical Engineering 19, 139–144 (1980)
Besl, P.J., McKay, N.D.: A method for registration of 3D shapes. IEEE Trans. Patt. Anal. Mach. Intell. 14, 239–256 (1992)
Kee, S.C., Lee, K.M., Lee, S.U.: Illumination invariant face recognition using photometric stereo. In: IEICE Trans. Inf. and Syst., vol. E83-D, pp. 1466–1474 (2000)
Zhou, S., Chellappa, R., Jacobs, D.: Characterization of human faces under illumination variations using rank, integrability, and symmetry constraints. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 588–601. Springer, Heidelberg (2004)
Zhou, S., Aggarwal, G., Chellappa, R., Jacobs, D.: Appearance characterization of linear lambertian objects, generalized photometric stereo, and illumination-invariant face recognition. IEEE Trans. Patt. Anal. Mach. Intell. 29, 230–245 (2007)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Patt. Anal. Mach. Intell. 23, 643–660 (2001)
Lienhart, R., Maydt, J.: An extended set of Haar-like features for rapid object detection. In: IEEE ICIP, pp. 900–903 (2002)
Forsyth, D.A., Ponce, J.: Computer Vision, A Modern Approach. Prentice-Hall, Upper Saddle River (2003)
Frankot, R.T., Chellappa, R.: A method for enforcing integrability in shape from shading algorithms. IEEE Trans. Patt. Anal. Mach. Intell. 10, 439–451 (1988)
Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D-3D hybrid approach to automatic face recognition. IEEE Trans. Patt. Anal. Mach. Intell. 29, 1927–1943 (2007)
Watt, A.H., Policarpo, F.: The Computer Image. Addison-Wesley, Reading (1998)
http://www.3dmd.com/3dmdface.html (February 26, 2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Atkinson, G.A., Farooq, A.R., Smith, M.L., Smith, L.N. (2009). Facial Reconstruction and Alignment Using Photometric Stereo and Surface Fitting. In: Araujo, H., Mendonça, A.M., Pinho, A.J., Torres, M.I. (eds) Pattern Recognition and Image Analysis. IbPRIA 2009. Lecture Notes in Computer Science, vol 5524. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02172-5_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-02172-5_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02171-8
Online ISBN: 978-3-642-02172-5
eBook Packages: Computer ScienceComputer Science (R0)