Abstract
Three-dimensional human facial surface information is a powerful biometric modality that has potential to improve the identification and/or verification accuracy of face recognition systems under challenging situations. In the presence of illumination, expression and pose variations, traditional 2D image-based face recognition algorithms usually encounter problems. With the availability of three-dimensional (3D) facial shape information, which is inherently insensitive to illumination and pose changes, these complications can be dealt with efficiently.
In this chapter, an extensive coverage of state-of-the-art 3D face recognition systems is given, together with discussions on recent evaluation campaigns and currently available 3D face databases. Later on, a fast Iterative Closest Point-based 3D face recognition reference system developed during the BioSecure project is presented. The results of identification and verification experiments carried out on the 3D-RMA database are provided for comparative analysis.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
The BJUT-3D Large-Scale Chinese Face Database, MISKL-TR-05-FMFR-001, 2005.
B. Achermann and H. Bunke. Classifying range images of human faces with Hausdorff distance. In Proc. Int. Conf. on Pattern Recognition, pages 809–813, 2000.
B. Achermann, X. Jiang, and H. Bunke. Face recognition using range images. In Proc. Int. Conf. on Virtual Systems and MultiMedia, pages 129–136, 1997.
H. Çinar Akakin, A.A. Salah, L. Akarun, and B. Sankur. 2d/3d facial feature extraction. In Proc. SPIE Conference on Electronic Imaging, 2006.
S. Arca, P. Campadelli, and R. Lanzarotti. A face recognition system based on automatically determined facial fiducial points. Pattern Recognition, 39:432–443, 2006.
V.R. Ayyagari, F. Boughorbel, A. Koschan, and M.A. Abidi. A new method for automatic 3d face registration. In IEEE Conference on Computer Vision and Pattern Recognition, 2005.
J. Batlle, E. Mouaddib, and J. Salvi. Recent progress in coded structured light as a technique to solve the correspondence problem: a survey. Pattern Recognition, 31(7):963–982, 1998.
C. BenAbdelkader and P.A. Griffin. Comparing and combining depth and texture cues for face recognition. Image and Vision Computing, 23(3):339–352, 2005.
P. Besl and N. McKay. A method for registration of 3-d shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239–256, 1992.
C. Beumier and M. Acheroy. Automatic 3d face authentication. Image and Vision Computing, 18(4):315–321, 2000.
C. Beumier and M. Acheroy. Face verification from 3d and grey level cues. Pattern Recognition Letters, 22:1321–1329, 2001.
F. Blais. Review of 20 years of range sensor development. Journal of Electronic Imaging, 13(1):231–240, 2004.
V. Blanz and T. Vetter. Face recognition based on fitting a 3d morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9):1063–1074, 2003.
C. Boehnen and T. Russ. A fast multi-modal approach to facial feature detection. In Proc. 7 th IEEE Workshop on Applications of Computer Vision, pages 135–142, 2005.
F.L. Bookstein. Principal warps: thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11:567–585, 1989.
K. Bowyer, Chang K., and P. Flynn. A survey of approaches and challenges in 3d and multimodal 3d + 2d face recognition. Computer Vision and Image Understanding, 101:1–15, 2006.
A.M. Bronstein, M.M. Bronstein, and R. Kimmel. Expression-invariant 3d face recognition. In J. Kittler and M.S. Nixon, editors, Proc. of. Audio- and Video-Based Person Authentication, pages 62–70, 2003.
J.Y. Cartoux, J.T. LaPreste, and M. Richetin. Face authentication or recognition by profile extraction from range images. In Proc. of the Workshop on Interpretation of 3D Scenes, pages 194–199, 1989.
Face Recognition Grand Challenge-FRGC-2.Url: http://face.nist.gov/frgc/.
K. Chang, K. Bowyer, and P. Flynn. Multi-modal 2d and 3d biometrics for face recognition. In Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, 2003.
Y. Chang, M. Vieira, M. Turk, and L. Velho. Automatic 3d facial expression analysis in videos. In Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, 2005.
Y. Chen and G. Medioni. Object modeling by registration of multiple range images. Image and Vision Computing, 10(3):145–155, 1992.
C.S. Chua, F. Han, and Y.K. Ho. 3d human face recognition using point signature. In Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pages 233–238, 2000.
D. Colbry, X. Lu, A. Jain, and G. Stockman. Technical Report MSU-CSE-04-39: 3D face feature extraction for recognition, 2004.
D. Colbry, G. Stockman, and A.K. Jain. Detection of anchor points for 3d face verification. In Proc. IEEE Workshop on Advanced 3D Imaging for Safety and Security, 2005.
C. Conde, A. Serrano, L.J. Rodríguez-Aragón, and E. Cabello. 3d facial normalization with spin images and influence of range data calculation over face verification. In IEEE Conf. Computer Vision and Pattern Recognition, 2005.
D RMA database. http://www.sic.rma.ac.be/~beumier/DB/3d_rma.html.
FERET database. Url: http://www.itl.nist.gov/iad/humanid/feret.
PIE Database. Url: http://www.ri.cmu.edu/projects/project_418_text.html.
UND database. Url: http://www.nd.edu/
T.G. Dietterich. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computations, 10:18951923, 1998.
H.K. Ekenel, H. Gao, and R. Stiefelhagen. 3-d face recognition using local appearance-based models. IEEE Trans. Information Forensics and Security, 2(3/2):630–636, 2007.
T. Faltemier, K. Bowyer, and P. Flynn. 3d face recognition with region committee voting. In Proc. Third Int. Symp. on 3D Data Processing Visualization and Transmission, pages 318–325, 2006.
The BioSecure Benchmarking Framework for Biometrics. http://share.int-evry.fr/svnview-eph/.
J. Forest and J. Salvi. A review of laser scanning three dimensional digitisers. Intelligent Robots and Systems, pages 73–78, 2002.
E. Garcia, J.L. Dugelay, and H. Delingette. Low cost 3d face acquisition and modeling. In Proc. International Conference on Information Technology: Coding and Computing, pages 657–661, 2001.
B. Gökberk and L. Akarun. Selection and extraction of patch descriptors for 3d face recognition. In Proc. of Computer and Information Sciences LNCS, volume 3733, pages 718–727, 2005.
B. Gökberk and L. Akarun. Comparative analysis of decision-level fusion algorithms for 3d face recognition. In Proc. of International Conference on Pattern Recognition, 2006.
B. Gökberk, H. Dutağaci, Aydin Ulaş, L. Akarun, and B. Sankur. Representation plurality and fusion for 3d face recognition. IEEE Transactions on Systems Man and Cybernetics-Part B: Cybernetics, 38(1), 2008.
B. Gökberk, M.O. İrfanoğlu, and L. Akarun. 3d shape-based face representation and feature extraction for face recognition. Image and Vision Computing, 24(8):857–869, 2006.
B. Gökberk, A.A. Salah, and L. Akarun. Rank-based decision fusion for 3d shape-based face recognition. In T. Kanade, A. Jain, and N.K. Ratha, editors, Lecture Notes in Computer Science, volume 3546, pages 1019–1028, 2005.
G. Gordon. Face recognition based on depth and curvature features. In SPIE Proc.: Geometric Methods in Computer Vision, volume 1570, pages 234–247, 1991.
C. Gu, B. Yin, Y. Hu, and S. Cheng. Resampling based method for pixel-wise correspondence between 3d faces. In Proc. International Conference on Information Technology: Coding and Computing, volume 1, pages 614–619, 2004.
T. Heseltine, N. Pears, and J. Austin. Three-dimensional face recognition using combinations of surface feature map subspace components. Image and Vision Computing, 26:382–396, 2008.
C. Hesher, A. Srivastava, and G. Erlebacher. A novel technique for face recognition using range imaging. In Proc. 7 th Int. Symposium on Signal Processing and Its Applications, pages 201–204, 2003.
M. Hüsken, M. Brauckmann, S. Gehlen, and C. von der Malsburg. Strategies and benefits of fusion of 2d and 3d face recognition. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
IV2: Identification par l'Iris et le Visage via la Vidéo. http://iv2.ibisc.fr/PageWeb-IV2.html.
A4vision Inc. http://www.a4vision.com/.
Cyberware Inc. http://www.cyberware.com/products/scanners/ps.html.
Genex Technologies Inc. http://www.genextech.com/.
Geometrics Inc. http://www.geometrics.com/.
M.O. İrfanoğlu, B. Gökberk, and L. Akarun. 3d shape-based face recognition using automatically registered facial surfaces. In Proc. Int. Conf. on Pattern Recognition, volume 4, pages 183–186, 2004.
I. Kakadiaris, G. Passalis, G. Toderici, N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis. 3d face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Analysis and Machine Intelligence, 29(4):640–649, 2007.
J. Kittler, A. Hilton, M. Hamouz, and J. Illingworth. 3d assisted face recognition: A survey of 3d imaging, modelling and recognition approaches. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
S. Lao, Y. Sumi, M. Kawade, and F. Tomita. 3d template matching for pose invariant face recognition using 3d facial model built with iso-luminance line based stereo vision. In Proc. Int. Conf. on Pattern Recognition, volume 2, pages 911–916, 2000.
J. Lee, B. Moghaddam, H. Pfister, and R. Machiraju. Silhouette-Based 3D Face Shape Recovery, 2003.
Y. Lee, K. Park, J. Shim, and T. Yi. 3d face recognition using statistical multiple features for the local depth information. In Proc. ICVI, 2003.
X. Lu, D. Colbry, and A.K. Jain. Three-dimensional model based face recognition. In Proc. Int. Conf. on Pattern Recognition, 2004.
X. Lu and A.K. Jain. Deformation analysis for 3d face matching. In Proc. IEEE WACV, 2005.
X. Lu and A.K. Jain. Multimodal Facial Feature Extraction for Automatic 3D Face Recognition Technical Report MSU-CSE-05-22, 2005.
X. Lu, A.K. Jain, and D. Colbry. Matching 2.5d face scans to 3d models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(1), 2006.
S. Malassiotis and M.G. Strintzis. Pose and illumination compensation for 3d face recognition. In Proc. International Conference on Image Processing, 2004.
T. Maurer, D. Guigonis, I. Maslov, B. Pesenti, A. Tsaregorodtsev, D. West, and G. Medioni. Performance of Geometrix Activeid 3d face recognition engine on the FRGC data. In Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, 2005.
G. Medioni and R. Waupotitsch. Face recognition and modeling in 3d. In IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, pages 232–233, 2003.
K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre. XM2VTSDB: The extended M2VTS database. In Proc. 2 nd International Conference on Audio and Video-based Biometric Person Authentication, 1999.
Ajmal S. Mian, Mohammed Bennamoun, and Robyn Owens. An efficient multimodal 2d-3d hybrid approach to automatic face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(11):1927–1943, 2007.
A.S. Mian, M. Bennamoun, and R. Owens. Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans. Pattern Analysis and Machine Intelligence, 28(10):1584–1601, 2006.
A.B. Moreno and Á. Sánchez. Gavabdb: A 3d face database. In Proc. 2 nd COST275 Workshop on Biometrics on the Internet, 2004.
A.B. Moreno, Á. Sánchez, J.F. Vélez, and F.J. Díaz. Face recognition using 3d surface-extracted descriptors. In Proc. IMVIPC, 2003.
T. Nagamine, T. Uemura, and I. Masuda. 3d facial image analysis for human identification. In Proc. Int. Conf. on Pattern Recognition, pages 324–327, 1992.
Minolta Vivid 910 non-contact 3D laser scanner. http://www.minoltausa.com/vivid/.
University of York 3D Face Database. http://www-users.cs.york.ac.uk/~tomh/3dfacedatabase.html.
G. Pan, Y. Wu, Z. Wu, and W. Liu. 3d face recognition by profile and surface matching. In Proc. IJCNN, volume 3, pages 2169–2174, 2003.
G. Pan and Z. Wu. 3d face recognition from range data. Int. Journal of Image and Graphics, 5(3):573–583, 2005.
T. Papatheodorou and D. Rueckert. Evaluation of automatic 4d face recognition using surface and texture registration. In Proc. AFGR, pages 321–326, 2004.
G. Passalis, I.A. Kakadiaris, T. Theoharis, G. Toderici, and N. Murtuza. Evaluation of 3d face recognition in the presence of facial expressions: an annotated deformable model approach. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
D. Petrovska-Delacrétaz, S. Lelandais, J. Colineau, L. Chen, B. Dorizzi, E. Krichen, M.A. Mellakh, A. Chaari, S. Guerfi, J. DHose, M. Ardabilian, and B. Ben Amor. The iv2 multimodal (2d, 3d, stereoscopic face, talking face and iris) biometric database, and the iv2 2007 evaluation campaign. In proc. IEEE Second International Conference on Biometrics: Theory, Applications (BTAS), Washington DC USA, September 2008.
P. Jonathon Phillips, W. Todd Scruggs, Alice J. OToole, Patrick J. Flynn, Kevin W. Bowyer, Cathy L. Schott, and Matthew Sharpe. FRVT 2006 and ICE 2006 Large-Scale Results (NISTIR 7408), March 2007.
P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, and W. Worek. Preliminary face recognition grand challenge results. In Proceedings 7th International Conference on Automatic Face and Gesture Recognition, pages 15–24, 2006.
P.J. Phillips, P.J. Flynn, W.T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W.J. Worek. Overview of the face recognition grand challenge. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, volume 1, pages 947–954, 2005.
D. Riccio and J.L. Dugelay. Asymmetric 3d/2d processing: a novel approach for face recognition. In 13th Int. Conf. on Image Analysis and Processing LNCS, volume 3617, pages 986–993, 2005.
S. Rusinkiewicz and M. Levoy. Efficient variants of the ICP algorithm. In Proc. of 3DIM01, pages 145–152, 2001.
A. A. Salah and L. Akarun. 3d facial feature localization for registration. In Proc. Int. Workshop on Multimedia Content Representation, Classification and Security LNCS, volume 4105/2006, pages 338–345, 2006.
A.A. Salah, N. Alyüz, and L. Akarun. Registration of 3d face scans with average face models. Journal of Electronic Imaging, 17(1), 2008.
J. Salvi, C. Matabosch, D. Fofi, and J. Forest. A review of recent range image registration methods with accuracy evaluation. Image and Vision Computing, 25(5):578–596, 2007.
A. Srivastava, X. Liu, and C. Hesher. Face recognition using optimal linear components of range images. Image and Vision Computing, 24:291–299, 2006.
H. Tanaka, M. Ikeda, and H. Chiaki. Curvature-based face surface recognition using spherical correlation. In Proc. ICFG, pages 372–377, 1998.
R. Y. Tsai. An efficient and accurate camera calibration technique for 3d machine vision. In IEEE Computer Vision and Pattern Recognition, pages 364–374, 1987.
F. Tsalakanidou, S. Malassiotis, and M. Strinzis. Integration of 2d and 3d images for enhanced face authentication. In Proc. AFGR, pages 266–271, 2004.
F. Tsalakanidou, D. Tzovaras, and M. Strinzis. Use of depth and colour eigenfaces for face recognition. Pattern Recognition Letters, 24:1427–1435, 2003.
S. Tsutsumi, S. Kikuchi, and M. Nakajima. Face identification using a 3d gray-scale image-a method for lessening restrictions on facial directions. In Proc. AFGR, pages 306–311, 1998.
M. B. Vieira, L. Velho, A. Sa, and P.C. Carvalho. A camera-projector system for real-time 3d video. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, page 96, 2005.
Y. Wang, C. Chua, and Y. Ho. Facial feature detection and face recognition from 2d and 3d images. Pattern Recognition Letters, 23(1191–1202), 2002.
Y. Wang and C.-S. Chua. Face recognition from 2d and 3d images using 3d Gabor filters. Image and Vision Computing, 23(11):1018–1028, 205.
B. Weyrauch, J. Huang, B. Heisele, and V. Blanz. Component-based face recognition with 3d morphable models. In Proc. First IEEE Workshop on Face Processing in Video, 2004.
L. Wiskott, J.-M Fellous, N. Krüger, and C. von der Malsburg. Face recognition by elastic bunch graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):775–779, 1997.
K. Wong, K. Lam, and W. Siu. An efficient algorithm for human face detection and facial feature extraction under different conditions. Pattern Recognition, 34:1993–2004, 2001.
C. Xu, Y. Wang, T. Tan, and L. Quan. Automatic 3d face recognition combining global geometric features with local shape variation information. In Proc. AFGR, pages 308–313, 2004.
C. Xu, Y. Wang, T. Tan, and L. Quan. A new attempt to face recognition using eigenfaces. In Proc. of the Sixth Asian Conf. on Computer Vision, volume 2, pages 884–889, 2004.
Y. Yacoob and L. S. Davis. Labeling of human face components from range data. CVGIP: Image Understanding, 60(2):168–178, 1994.
L. Zhang and D. Samaras. Face recognition under variable lighting using harmonic image exemplars. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, volume 1, pages 19–25, 2003.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag London Limited
About this chapter
Cite this chapter
Gökberk, B., Ali Salah, A., Akarun, L., Etheve, R., Riccio, D., Dugelay, JL. (2009). 3D Face Recognition. In: Petrovska-Delacrétaz, D., Dorizzi, B., Chollet, G. (eds) Guide to Biometric Reference Systems and Performance Evaluation. Springer, London. https://doi.org/10.1007/978-1-84800-292-0_9
Download citation
DOI: https://doi.org/10.1007/978-1-84800-292-0_9
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84800-291-3
Online ISBN: 978-1-84800-292-0
eBook Packages: Computer ScienceComputer Science (R0)