Skip to main content

Abstract

Three-dimensional human facial surface information is a powerful biometric modality that has potential to improve the identification and/or verification accuracy of face recognition systems under challenging situations. In the presence of illumination, expression and pose variations, traditional 2D image-based face recognition algorithms usually encounter problems. With the availability of three-dimensional (3D) facial shape information, which is inherently insensitive to illumination and pose changes, these complications can be dealt with efficiently.

In this chapter, an extensive coverage of state-of-the-art 3D face recognition systems is given, together with discussions on recent evaluation campaigns and currently available 3D face databases. Later on, a fast Iterative Closest Point-based 3D face recognition reference system developed during the BioSecure project is presented. The results of identification and verification experiments carried out on the 3D-RMA database are provided for comparative analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. The BJUT-3D Large-Scale Chinese Face Database, MISKL-TR-05-FMFR-001, 2005.

    Google Scholar 

  2. B. Achermann and H. Bunke. Classifying range images of human faces with Hausdorff distance. In Proc. Int. Conf. on Pattern Recognition, pages 809–813, 2000.

    Google Scholar 

  3. B. Achermann, X. Jiang, and H. Bunke. Face recognition using range images. In Proc. Int. Conf. on Virtual Systems and MultiMedia, pages 129–136, 1997.

    Google Scholar 

  4. H. Çinar Akakin, A.A. Salah, L. Akarun, and B. Sankur. 2d/3d facial feature extraction. In Proc. SPIE Conference on Electronic Imaging, 2006.

    Google Scholar 

  5. S. Arca, P. Campadelli, and R. Lanzarotti. A face recognition system based on automatically determined facial fiducial points. Pattern Recognition, 39:432–443, 2006.

    Article  MATH  Google Scholar 

  6. V.R. Ayyagari, F. Boughorbel, A. Koschan, and M.A. Abidi. A new method for automatic 3d face registration. In IEEE Conference on Computer Vision and Pattern Recognition, 2005.

    Google Scholar 

  7. J. Batlle, E. Mouaddib, and J. Salvi. Recent progress in coded structured light as a technique to solve the correspondence problem: a survey. Pattern Recognition, 31(7):963–982, 1998.

    Article  Google Scholar 

  8. C. BenAbdelkader and P.A. Griffin. Comparing and combining depth and texture cues for face recognition. Image and Vision Computing, 23(3):339–352, 2005.

    Article  Google Scholar 

  9. P. Besl and N. McKay. A method for registration of 3-d shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239–256, 1992.

    Article  Google Scholar 

  10. C. Beumier and M. Acheroy. Automatic 3d face authentication. Image and Vision Computing, 18(4):315–321, 2000.

    Article  Google Scholar 

  11. C. Beumier and M. Acheroy. Face verification from 3d and grey level cues. Pattern Recognition Letters, 22:1321–1329, 2001.

    Article  MATH  Google Scholar 

  12. F. Blais. Review of 20 years of range sensor development. Journal of Electronic Imaging, 13(1):231–240, 2004.

    Article  Google Scholar 

  13. V. Blanz and T. Vetter. Face recognition based on fitting a 3d morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9):1063–1074, 2003.

    Article  Google Scholar 

  14. C. Boehnen and T. Russ. A fast multi-modal approach to facial feature detection. In Proc. 7 th IEEE Workshop on Applications of Computer Vision, pages 135–142, 2005.

    Google Scholar 

  15. F.L. Bookstein. Principal warps: thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11:567–585, 1989.

    Article  MATH  Google Scholar 

  16. K. Bowyer, Chang K., and P. Flynn. A survey of approaches and challenges in 3d and multimodal 3d + 2d face recognition. Computer Vision and Image Understanding, 101:1–15, 2006.

    Article  Google Scholar 

  17. A.M. Bronstein, M.M. Bronstein, and R. Kimmel. Expression-invariant 3d face recognition. In J. Kittler and M.S. Nixon, editors, Proc. of. Audio- and Video-Based Person Authentication, pages 62–70, 2003.

    Google Scholar 

  18. J.Y. Cartoux, J.T. LaPreste, and M. Richetin. Face authentication or recognition by profile extraction from range images. In Proc. of the Workshop on Interpretation of 3D Scenes, pages 194–199, 1989.

    Google Scholar 

  19. Face Recognition Grand Challenge-FRGC-2.Url: http://face.nist.gov/frgc/.

  20. K. Chang, K. Bowyer, and P. Flynn. Multi-modal 2d and 3d biometrics for face recognition. In Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, 2003.

    Google Scholar 

  21. Y. Chang, M. Vieira, M. Turk, and L. Velho. Automatic 3d facial expression analysis in videos. In Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, 2005.

    Google Scholar 

  22. Y. Chen and G. Medioni. Object modeling by registration of multiple range images. Image and Vision Computing, 10(3):145–155, 1992.

    Article  Google Scholar 

  23. C.S. Chua, F. Han, and Y.K. Ho. 3d human face recognition using point signature. In Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pages 233–238, 2000.

    Google Scholar 

  24. D. Colbry, X. Lu, A. Jain, and G. Stockman. Technical Report MSU-CSE-04-39: 3D face feature extraction for recognition, 2004.

    Google Scholar 

  25. D. Colbry, G. Stockman, and A.K. Jain. Detection of anchor points for 3d face verification. In Proc. IEEE Workshop on Advanced 3D Imaging for Safety and Security, 2005.

    Google Scholar 

  26. C. Conde, A. Serrano, L.J. Rodríguez-Aragón, and E. Cabello. 3d facial normalization with spin images and influence of range data calculation over face verification. In IEEE Conf. Computer Vision and Pattern Recognition, 2005.

    Google Scholar 

  27. D RMA database. http://www.sic.rma.ac.be/~beumier/DB/3d_rma.html.

  28. FERET database. Url: http://www.itl.nist.gov/iad/humanid/feret.

  29. PIE Database. Url: http://www.ri.cmu.edu/projects/project_418_text.html.

  30. UND database. Url: http://www.nd.edu/

  31. T.G. Dietterich. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computations, 10:18951923, 1998.

    Article  Google Scholar 

  32. H.K. Ekenel, H. Gao, and R. Stiefelhagen. 3-d face recognition using local appearance-based models. IEEE Trans. Information Forensics and Security, 2(3/2):630–636, 2007.

    Article  Google Scholar 

  33. T. Faltemier, K. Bowyer, and P. Flynn. 3d face recognition with region committee voting. In Proc. Third Int. Symp. on 3D Data Processing Visualization and Transmission, pages 318–325, 2006.

    Google Scholar 

  34. The BioSecure Benchmarking Framework for Biometrics. http://share.int-evry.fr/svnview-eph/.

  35. J. Forest and J. Salvi. A review of laser scanning three dimensional digitisers. Intelligent Robots and Systems, pages 73–78, 2002.

    Google Scholar 

  36. E. Garcia, J.L. Dugelay, and H. Delingette. Low cost 3d face acquisition and modeling. In Proc. International Conference on Information Technology: Coding and Computing, pages 657–661, 2001.

    Google Scholar 

  37. B. Gökberk and L. Akarun. Selection and extraction of patch descriptors for 3d face recognition. In Proc. of Computer and Information Sciences LNCS, volume 3733, pages 718–727, 2005.

    Google Scholar 

  38. B. Gökberk and L. Akarun. Comparative analysis of decision-level fusion algorithms for 3d face recognition. In Proc. of International Conference on Pattern Recognition, 2006.

    Google Scholar 

  39. B. Gökberk, H. Dutağaci, Aydin Ulaş, L. Akarun, and B. Sankur. Representation plurality and fusion for 3d face recognition. IEEE Transactions on Systems Man and Cybernetics-Part B: Cybernetics, 38(1), 2008.

    Google Scholar 

  40. B. Gökberk, M.O. İrfanoğlu, and L. Akarun. 3d shape-based face representation and feature extraction for face recognition. Image and Vision Computing, 24(8):857–869, 2006.

    Article  Google Scholar 

  41. B. Gökberk, A.A. Salah, and L. Akarun. Rank-based decision fusion for 3d shape-based face recognition. In T. Kanade, A. Jain, and N.K. Ratha, editors, Lecture Notes in Computer Science, volume 3546, pages 1019–1028, 2005.

    Google Scholar 

  42. G. Gordon. Face recognition based on depth and curvature features. In SPIE Proc.: Geometric Methods in Computer Vision, volume 1570, pages 234–247, 1991.

    Google Scholar 

  43. C. Gu, B. Yin, Y. Hu, and S. Cheng. Resampling based method for pixel-wise correspondence between 3d faces. In Proc. International Conference on Information Technology: Coding and Computing, volume 1, pages 614–619, 2004.

    Google Scholar 

  44. T. Heseltine, N. Pears, and J. Austin. Three-dimensional face recognition using combinations of surface feature map subspace components. Image and Vision Computing, 26:382–396, 2008.

    Article  Google Scholar 

  45. C. Hesher, A. Srivastava, and G. Erlebacher. A novel technique for face recognition using range imaging. In Proc. 7 th Int. Symposium on Signal Processing and Its Applications, pages 201–204, 2003.

    Google Scholar 

  46. M. Hüsken, M. Brauckmann, S. Gehlen, and C. von der Malsburg. Strategies and benefits of fusion of 2d and 3d face recognition. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.

    Google Scholar 

  47. IV2: Identification par l'Iris et le Visage via la Vidéo. http://iv2.ibisc.fr/PageWeb-IV2.html.

  48. A4vision Inc. http://www.a4vision.com/.

  49. Cyberware Inc. http://www.cyberware.com/products/scanners/ps.html.

  50. Genex Technologies Inc. http://www.genextech.com/.

  51. Geometrics Inc. http://www.geometrics.com/.

  52. M.O. İrfanoğlu, B. Gökberk, and L. Akarun. 3d shape-based face recognition using automatically registered facial surfaces. In Proc. Int. Conf. on Pattern Recognition, volume 4, pages 183–186, 2004.

    Google Scholar 

  53. I. Kakadiaris, G. Passalis, G. Toderici, N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis. 3d face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Analysis and Machine Intelligence, 29(4):640–649, 2007.

    Article  Google Scholar 

  54. J. Kittler, A. Hilton, M. Hamouz, and J. Illingworth. 3d assisted face recognition: A survey of 3d imaging, modelling and recognition approaches. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.

    Google Scholar 

  55. S. Lao, Y. Sumi, M. Kawade, and F. Tomita. 3d template matching for pose invariant face recognition using 3d facial model built with iso-luminance line based stereo vision. In Proc. Int. Conf. on Pattern Recognition, volume 2, pages 911–916, 2000.

    Google Scholar 

  56. J. Lee, B. Moghaddam, H. Pfister, and R. Machiraju. Silhouette-Based 3D Face Shape Recovery, 2003.

    Google Scholar 

  57. Y. Lee, K. Park, J. Shim, and T. Yi. 3d face recognition using statistical multiple features for the local depth information. In Proc. ICVI, 2003.

    Google Scholar 

  58. X. Lu, D. Colbry, and A.K. Jain. Three-dimensional model based face recognition. In Proc. Int. Conf. on Pattern Recognition, 2004.

    Google Scholar 

  59. X. Lu and A.K. Jain. Deformation analysis for 3d face matching. In Proc. IEEE WACV, 2005.

    Google Scholar 

  60. X. Lu and A.K. Jain. Multimodal Facial Feature Extraction for Automatic 3D Face Recognition Technical Report MSU-CSE-05-22, 2005.

    Google Scholar 

  61. X. Lu, A.K. Jain, and D. Colbry. Matching 2.5d face scans to 3d models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(1), 2006.

    Google Scholar 

  62. S. Malassiotis and M.G. Strintzis. Pose and illumination compensation for 3d face recognition. In Proc. International Conference on Image Processing, 2004.

    Google Scholar 

  63. T. Maurer, D. Guigonis, I. Maslov, B. Pesenti, A. Tsaregorodtsev, D. West, and G. Medioni. Performance of Geometrix Activeid 3d face recognition engine on the FRGC data. In Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, 2005.

    Google Scholar 

  64. G. Medioni and R. Waupotitsch. Face recognition and modeling in 3d. In IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, pages 232–233, 2003.

    Google Scholar 

  65. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre. XM2VTSDB: The extended M2VTS database. In Proc. 2 nd International Conference on Audio and Video-based Biometric Person Authentication, 1999.

    Google Scholar 

  66. Ajmal S. Mian, Mohammed Bennamoun, and Robyn Owens. An efficient multimodal 2d-3d hybrid approach to automatic face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(11):1927–1943, 2007.

    Article  Google Scholar 

  67. A.S. Mian, M. Bennamoun, and R. Owens. Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans. Pattern Analysis and Machine Intelligence, 28(10):1584–1601, 2006.

    Article  Google Scholar 

  68. A.B. Moreno and Á. Sánchez. Gavabdb: A 3d face database. In Proc. 2 nd COST275 Workshop on Biometrics on the Internet, 2004.

    Google Scholar 

  69. A.B. Moreno, Á. Sánchez, J.F. Vélez, and F.J. Díaz. Face recognition using 3d surface-extracted descriptors. In Proc. IMVIPC, 2003.

    Google Scholar 

  70. T. Nagamine, T. Uemura, and I. Masuda. 3d facial image analysis for human identification. In Proc. Int. Conf. on Pattern Recognition, pages 324–327, 1992.

    Google Scholar 

  71. Minolta Vivid 910 non-contact 3D laser scanner. http://www.minoltausa.com/vivid/.

  72. University of York 3D Face Database. http://www-users.cs.york.ac.uk/~tomh/3dfacedatabase.html.

  73. G. Pan, Y. Wu, Z. Wu, and W. Liu. 3d face recognition by profile and surface matching. In Proc. IJCNN, volume 3, pages 2169–2174, 2003.

    Google Scholar 

  74. G. Pan and Z. Wu. 3d face recognition from range data. Int. Journal of Image and Graphics, 5(3):573–583, 2005.

    Article  Google Scholar 

  75. T. Papatheodorou and D. Rueckert. Evaluation of automatic 4d face recognition using surface and texture registration. In Proc. AFGR, pages 321–326, 2004.

    Google Scholar 

  76. G. Passalis, I.A. Kakadiaris, T. Theoharis, G. Toderici, and N. Murtuza. Evaluation of 3d face recognition in the presence of facial expressions: an annotated deformable model approach. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.

    Google Scholar 

  77. D. Petrovska-Delacrétaz, S. Lelandais, J. Colineau, L. Chen, B. Dorizzi, E. Krichen, M.A. Mellakh, A. Chaari, S. Guerfi, J. DHose, M. Ardabilian, and B. Ben Amor. The iv2 multimodal (2d, 3d, stereoscopic face, talking face and iris) biometric database, and the iv2 2007 evaluation campaign. In proc. IEEE Second International Conference on Biometrics: Theory, Applications (BTAS), Washington DC USA, September 2008.

    Google Scholar 

  78. P. Jonathon Phillips, W. Todd Scruggs, Alice J. OToole, Patrick J. Flynn, Kevin W. Bowyer, Cathy L. Schott, and Matthew Sharpe. FRVT 2006 and ICE 2006 Large-Scale Results (NISTIR 7408), March 2007.

    Google Scholar 

  79. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, and W. Worek. Preliminary face recognition grand challenge results. In Proceedings 7th International Conference on Automatic Face and Gesture Recognition, pages 15–24, 2006.

    Google Scholar 

  80. P.J. Phillips, P.J. Flynn, W.T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W.J. Worek. Overview of the face recognition grand challenge. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, volume 1, pages 947–954, 2005.

    Google Scholar 

  81. D. Riccio and J.L. Dugelay. Asymmetric 3d/2d processing: a novel approach for face recognition. In 13th Int. Conf. on Image Analysis and Processing LNCS, volume 3617, pages 986–993, 2005.

    Google Scholar 

  82. S. Rusinkiewicz and M. Levoy. Efficient variants of the ICP algorithm. In Proc. of 3DIM01, pages 145–152, 2001.

    Google Scholar 

  83. A. A. Salah and L. Akarun. 3d facial feature localization for registration. In Proc. Int. Workshop on Multimedia Content Representation, Classification and Security LNCS, volume 4105/2006, pages 338–345, 2006.

    Google Scholar 

  84. A.A. Salah, N. Alyüz, and L. Akarun. Registration of 3d face scans with average face models. Journal of Electronic Imaging, 17(1), 2008.

    Google Scholar 

  85. J. Salvi, C. Matabosch, D. Fofi, and J. Forest. A review of recent range image registration methods with accuracy evaluation. Image and Vision Computing, 25(5):578–596, 2007.

    Article  Google Scholar 

  86. A. Srivastava, X. Liu, and C. Hesher. Face recognition using optimal linear components of range images. Image and Vision Computing, 24:291–299, 2006.

    Article  Google Scholar 

  87. H. Tanaka, M. Ikeda, and H. Chiaki. Curvature-based face surface recognition using spherical correlation. In Proc. ICFG, pages 372–377, 1998.

    Google Scholar 

  88. R. Y. Tsai. An efficient and accurate camera calibration technique for 3d machine vision. In IEEE Computer Vision and Pattern Recognition, pages 364–374, 1987.

    Google Scholar 

  89. F. Tsalakanidou, S. Malassiotis, and M. Strinzis. Integration of 2d and 3d images for enhanced face authentication. In Proc. AFGR, pages 266–271, 2004.

    Google Scholar 

  90. F. Tsalakanidou, D. Tzovaras, and M. Strinzis. Use of depth and colour eigenfaces for face recognition. Pattern Recognition Letters, 24:1427–1435, 2003.

    Article  MATH  Google Scholar 

  91. S. Tsutsumi, S. Kikuchi, and M. Nakajima. Face identification using a 3d gray-scale image-a method for lessening restrictions on facial directions. In Proc. AFGR, pages 306–311, 1998.

    Google Scholar 

  92. M. B. Vieira, L. Velho, A. Sa, and P.C. Carvalho. A camera-projector system for real-time 3d video. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, page 96, 2005.

    Google Scholar 

  93. Y. Wang, C. Chua, and Y. Ho. Facial feature detection and face recognition from 2d and 3d images. Pattern Recognition Letters, 23(1191–1202), 2002.

    Article  Google Scholar 

  94. Y. Wang and C.-S. Chua. Face recognition from 2d and 3d images using 3d Gabor filters. Image and Vision Computing, 23(11):1018–1028, 205.

    Article  Google Scholar 

  95. B. Weyrauch, J. Huang, B. Heisele, and V. Blanz. Component-based face recognition with 3d morphable models. In Proc. First IEEE Workshop on Face Processing in Video, 2004.

    Google Scholar 

  96. L. Wiskott, J.-M Fellous, N. Krüger, and C. von der Malsburg. Face recognition by elastic bunch graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):775–779, 1997.

    Article  Google Scholar 

  97. K. Wong, K. Lam, and W. Siu. An efficient algorithm for human face detection and facial feature extraction under different conditions. Pattern Recognition, 34:1993–2004, 2001.

    Article  MATH  Google Scholar 

  98. C. Xu, Y. Wang, T. Tan, and L. Quan. Automatic 3d face recognition combining global geometric features with local shape variation information. In Proc. AFGR, pages 308–313, 2004.

    Google Scholar 

  99. C. Xu, Y. Wang, T. Tan, and L. Quan. A new attempt to face recognition using eigenfaces. In Proc. of the Sixth Asian Conf. on Computer Vision, volume 2, pages 884–889, 2004.

    Google Scholar 

  100. Y. Yacoob and L. S. Davis. Labeling of human face components from range data. CVGIP: Image Understanding, 60(2):168–178, 1994.

    Article  Google Scholar 

  101. L. Zhang and D. Samaras. Face recognition under variable lighting using harmonic image exemplars. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, volume 1, pages 19–25, 2003.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Berk Gökberk .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag London Limited

About this chapter

Cite this chapter

Gökberk, B., Ali Salah, A., Akarun, L., Etheve, R., Riccio, D., Dugelay, JL. (2009). 3D Face Recognition. In: Petrovska-Delacrétaz, D., Dorizzi, B., Chollet, G. (eds) Guide to Biometric Reference Systems and Performance Evaluation. Springer, London. https://doi.org/10.1007/978-1-84800-292-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-1-84800-292-0_9

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84800-291-3

  • Online ISBN: 978-1-84800-292-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics