Skip to main content
SpringerLink
Log in

3D Assisted Face Recognition: A Survey

  • Chapter
Book cover 3D Imaging for Safety and Security

Part of the book series: Computational Imaging and Vision ((CIVI,volume 35))

Abstract

3D face recognition has lately been attracting ever increasing attention. In this chapter we review the full spectrum of 3D face processing technology, from sensing to recognition. The review covers 3D face modelling, 3D to 3D and 3D to 2D registration, 3D based recognition and 3D assisted 2D based recognition. The fusion of 2D and 3D modalities is also addressed. The chapter complements other reviews in the face biometrics area by focusing on the sensor technology, and by detailing the efforts in 3D face modelling and 3D assisted 2D face matching. A detailed evaluation of a typical state-of-the-art 3D face registration algorithm is discussed and conclusions drawn.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A.-N. Ansari and M. Abdel-Mottaleb. 3D face modeling using two orthogonal views and a generic face model. In ICME 03, Proceedings of International Conference on Multimedia and Expo, 3:289-92, 2003.

    Google Scholar 

  2. R. Basri and D. W. Jacobs. Lambertian Reflectance and Linear Subspaces. IEEE Trans. Pattern Anal. Mach. Intell., 25(2):218-233, 2003.

    Article  Google Scholar 

  3. V. Blanz and T. Vetter. Face Recognition Based on Fitting a 3D Morphable Model. IEEE Trans. Pattern Anal. Mach. Intell., 25(9):1063-1074, 2003.

    Article  Google Scholar 

  4. F. Bookstein. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE PAMI, 2(6):567-585, June 1989.

    Google Scholar 

  5. K. W. Bowyer, K. Chang, and P. Flynn. A Survey Of Approaches To Three-Dimensional Face Recognition. In Proc. of 17th International Conference on Pattern Recognition (ICPR’04), 1:358-361, 2004.

    Article  Google Scholar 

  6. A. M. Bronstein, M. M. Bronstein, and R. Kimmel. Expression-Invariant 3D Face Recognition. In Proc. 4th Int. Conf. on Audio- and Video-based Biometric Person Authentication, pp. 62-69, 2003.

    Google Scholar 

  7. K. I. Chang, K. W. Bowyer, and P. J. Flynn. An Evaluation of Multimodal 2D+3D Face Biometrics. IEEE Trans. Pattern Anal. Mach. Intell., 27(4):619-624, 2005.

    Article  Google Scholar 

  8. C. Chua, F. Han, and Y. Ho. 3D human face recognition using point signature. In Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 233-238, 2000.

    Google Scholar 

  9. C. Chua and R. Jarvis. Point Signatures: A New Representation for 3D Object Recognition. Int. J. Comput. Vision, 25(1):63-85, 1997.

    Article  Google Scholar 

  10. D. Colbry, X. Lu, A. Jain, and G. Stockman. 3D face feature extraction for recognition. Technical Report MSU-CSE-04-39, Michigan State University, East Lansing, Michigan, 2004.

    Google Scholar 

  11. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active Appearance Models. In Proc. of European Conference of Computer Vision, 2:484-498, 1998.

    Google Scholar 

  12. D. DeCarlo, D. Metaxas, and M. Stone. An Anthropometric Face Model using Variational Techniques. In SIGGRAPH ‘98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pages 67-74, 1998.

    Google Scholar 

  13. M. Everingham and A. Zisserman. Automated Visual Identification of Characters in Situation Comedies. In Proc. of 17th International Conference on Pattern Recognition, (ICPR’04), pp. 983-986, 2004.

    Google Scholar 

  14. P. Fua. Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data. International Journal of Computer Vision, 38(2):153–171, 2000.

    Article  MATH  Google Scholar 

  15. R. Garimella and B. Swartz. Curvature estimation for unstructured triangulations of surfaces. Technical report, Los Alamos National Laboratory, 2002.

    Google Scholar 

  16. G. G. Gordon. Face recognition based on depth and curvature features. In Proceedings CVPR ‘92, pp. 808-810, 1992.

    Google Scholar 

  17. N. Grammalidis, N. Sarris, C. Varzokas, and M.G. Strintzis, Generation of 3-D head models from multiple images using ellipsoid approximation for the rear part. In International Conference on Image Processing, 1:284-287, 2000.

    Google Scholar 

  18. T. Heseltine, N. Pears, and J. Austin. Three-Dimensional Face Recognition Using Surface Space Combinations. In Proc. of British Machine Vision Conference (BMVC’04), pages 527-536, 2004.

    Google Scholar 

  19. J. Huang, B. Heisele, and V. Blanz. Component-based Face Recognition with 3D Morphable Models. In Proc. 4th Int. Conf. on Audio- and Video-based Biometric Person Authentication, pp. 27-34, 2003.

    Google Scholar 

  20. T.J. Hutton, B. F. Buxton, and P. Hammond. Dense Surface Point Distribution Models of the Human Face. In Proceedings of IEEE Workshop on Mathematical Methods in Biomedical Image Analysis, MMBIA 2001, pp. 153-160, 2001.

    Google Scholar 

  21. M. R. Kaus, V. Pekar, C. Lorenz, R. Truyen, S. Lobregt, and J. Weese. Automated 3-D PDM construction from segmented images using deformable models. IEEE Transactions on Medical Imaging, 22(8):1005-1013, August 2003.

    Article  Google Scholar 

  22. T. Kim and J. Kittler. Locally Linear Discriminant Analysis for Multimodally Distributed Classes for Face Recognition with a Single Model Image. IEEE Trans. Pattern Anal. Mach. Intell., 27(3):318-327, 2005.

    Article  Google Scholar 

  23. J. C. Lee and E. Milios. Matching range images of human faces. In Proceedings of ICCV, pp.722-726, 1990.

    Google Scholar 

  24. Y. Lee, D. Terzopoulos, and K. Waters. Realistic Modeling for Facial Animation. In Proceedings of ACM SIGGRAPH, pages 55-62, 1995.

    Google Scholar 

  25. M. D. Levine and A. Rajwade. 3D View-Invariant Face Recognition Using a Hierarchical Pose-Normalization Strategy. Technical Report http://www.cim.mcgill.ca/∼levine/, Center of Intelligent Machines, McGill University, 2004.

    Google Scholar 

  26. Y. Li, S. Gong, and H. Lidell. Support Vector Regression and Classification Based Multi-view Face Detection and Recognition. In Proc. of IEEE Int. Conference on Face and Gesture Recognition, pp. 300-305, 2000.

    Google Scholar 

  27. X. Lu, D. Colbry, and A. K. Jain. Three-Dimensional Model Based Face Recognition. In Proc. of 17th International Conference on Pattern Recognition, (ICPR’04), Volume 1:362-366, 2004.

    Article  Google Scholar 

  28. Z. Mao, P. Siebert, P. Cockshott, and A. Ayoub. Constructing dense correspondences to analyze 3d facial change. In Proc. ICPR 04, pages 144-148, August 2004.

    Google Scholar 

  29. K. Messer, J. Kittler, M. Sadeghi, M. Hamouz, A. Kostin, S. Marcel, S. Bengio, F. Cardinaux, C. Sanderson, N. Poh, Y. Rodriguez, K. Kryszzcuk, J. Czyz, L. Vandendorpe, J. Ng, H. Cheung, and B. Tang. Face authentication competition on the Banca database. In D Zhang and A K Jain, editors, Proc First International Conference on Biometric Authentication, pages 8-15, Springer, July 2004.

    Google Scholar 

  30. F.I. Parke and K. Waters. Computer Facial Animation. A.K. Peters, 1996.

    Google Scholar 

  31. P. J. Phillips, P. J. Flynn, T. Scruggs, K. W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek. Overview of the face recognition grand challenge. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 947-954, 2005.

    Google Scholar 

  32. P. J. Phillips, P. Grother, R. Micheals, D.M. Blackburn, E. Tabassi, and M. Bone. Face recognition vendor test 2002: Evaluation Report. Technical Report IR 6965, http://www.itl.nist.gov/iad/894.03/face/face.html, National Institute of Standards and Technology, 2004.

    Google Scholar 

  33. B. T. Phong. Illumination for computer generated pictures. Commun. ACM, 18(6):311-317, 1975.

    Article  Google Scholar 

  34. M. Proesmans and L. VanGool. Active Acquisition of 3D Shape for Moving Objects. In ICIP, pages 647-650, 1996.

    Google Scholar 

  35. S. Rusinkiewicz, O. Hall-Holt, and M. Levoy. Real-Time 3D Model Acquisition. In SIGGRAPH ‘02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pages 438-446, 2002.

    Google Scholar 

  36. J. Short, J. Kittler, and K. Messer. Comparison of Photometric Normalisation Algorithms for Face Verification. In Proc. 6th Int. Conf. on Automatic Face and Gesture Recognition (FGR 2004), pp. 254-259, 2004.

    Google Scholar 

  37. J. P. Siebert and C. W. Urquhart. C3D: a Novel Vision-Based 3D Data Acquisition. In Proc. Mona Lisa European Workshop, Combined Real and Synthetic Image Processing for Broadcast and Video Production, Hamburg, Germany, 1994.

    Google Scholar 

  38. H. T. Tanaka, M. Ikeda, and H. Chiaki. Curvature-based face surface recognition using spherical correlation. Principal directions for curved object recognition. In Proceedings of The Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 372-377, 1998.

    Google Scholar 

  39. Y. Wang, X. Huang, C. Lee, S. Zhang, Z. Li, D. Samaras, D. N. Metaxas, A. Elgammal, and P. Huang. High resolution acquisition, learning and transfer of dynamic 3d facial expressions. Comput. Graph. Forum, 23(3):677-686, 2004.

    Article  Google Scholar 

  40. Y. Wang, C. Chua, and Y. Ho. Facial feature detection and face recognition from 2D and 3D images. Pattern Recognition Letters, 23(10):1191-1202, 2002.

    Article  MATH  Google Scholar 

  41. C. Xu, Y. Wang, T. Tan, and L. Quan. Three-dimensional face recognition using geometric model. In Proc. SPIE Vol. 5404, pp. 304-315, 2004.

    Google Scholar 

  42. M. Yang, D. J. Kriegman, and N. Ahuja. Detecting Faces in Images: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1):34-58, 2002.

    Article  Google Scholar 

  43. L. Yin and M. T. Yourst. 3D face recognition based on high-resolution 3D face modeling from frontal and profile views. In WBMA ‘03: Proceedings of the 2003 ACM SIGMM workshop on Biometrics methods and applications, pages 1-8. ACM Press, 2003.

    Google Scholar 

  44. I.A. Ypsilos, A. Hilton, and S. Rowe. Video-rate Capture of Dynamic Face Shape and Appearance. In Proc. 6th Int. Conf. on Automatic Face and Gesture Recognition (FGR 2004), pages 117-122, 2004.

    Google Scholar 

  45. L. Zhang and D. Samaras. Pose Invariant Face Recognition under Arbitrary Unknown Lighting using Spherical Harmonics. In Proc. Biometric Authentication Workshop 2004, (in conjunction with ECCV2004), pp. 10-23, 2004.

    Google Scholar 

  46. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz. Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graph., 23(3):548-558, 2004.

    Article  Google Scholar 

  47. Z. Zhang, Z. Liu, D. Adler, M.F. Cohen, E. Hanson, and Y. Shan. Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach. International Journal of Computer Vision, 58(1):93-119, 2004.

    Article  Google Scholar 

  48. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld. Face recognition: A literature survey. ACM Comput. Surv., 35(4):399-458, 2003.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford, GU2 7XH, United Kingdom

    M. Hamouz, J. R. Tena, J. Kittler, A. Hilton & J. Illingworth

Authors
  1. M. Hamouz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. R. Tena
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Kittler
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. A. Hilton
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. J. Illingworth
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. The University of Tennessee, Knoxville, TN, USA

    Andreas Koschan  & Mongi Abidi  & 

  2. University of North Carolina at Chapel Hill, NC, USA

    Marc Pollefeys

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer

About this chapter

Cite this chapter

Hamouz, M., Tena, J.R., Kittler, J., Hilton, A., Illingworth, J. (2007). 3D Assisted Face Recognition: A Survey. In: Koschan, A., Pollefeys, M., Abidi, M. (eds) 3D Imaging for Safety and Security. Computational Imaging and Vision, vol 35. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-6182-0_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4020-6182-0_1

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-6181-3

  • Online ISBN: 978-1-4020-6182-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation