2D and 3D Multimodal Hybrid Face Recognition

  • Ajmal Mian
  • Mohammed Bennamoun
  • Robyn Owens
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3953)


We present a 2D and 3D multimodal hybrid face recognition algorithm and demonstrate its performance on the FRGC v1.0 data. We use hybrid (feature-based and holistic) matching for the 3D faces and a holistic matching approach on the 2D faces. Feature-based matching is performed by offline segmenting each 3D face in the gallery into three regions, namely the eyes-forehead, the nose and the cheeks. The cheeks are discarded to avoid facial expressions and hair. During recognition, each feature in the gallery is automatically matched, using a modified ICP algorithm, with a complete probe face. The holistic 3D and 2D face matching is performed using PCA. Individual matching scores are fused after normalization and the results are compared to the BEE baseline performances in order to provide some answers to the first three conjectures of the FRGC. Our multimodal hybrid algorithm substantially outperformed others by achieving 100% verification rate at 0.0006 FAR.


Face Recognition Face Match Skin Detection Face Recognition Algorithm Face Recognition Grand Challenge 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Besl, P.J., McKay, N.D.: Reconstruction of Real-world Objects via Simultaneous Registration and Robust Combination of Multiple Range Images. IEEE TPAMI 14(2), 239–256 (1992)Google Scholar
  2. 2.
    Boehnen, C., Russ, T.: A Fast Multi-Modal Approach to Facial Feature Detection. In: IEEE WACV (2005)Google Scholar
  3. 3.
    Boussaid, F., Chai, D., Bouzerdoum, A.: A Current-mode VLSI Architecture for Skin Detection. ISSPA 1, 629–632 (2003)Google Scholar
  4. 4.
    Bowyer, K.W., Chang, K., Flynn, P.: A Survey Of Approaches to Three-Dimensional Face Recognition. In: IEEE ICPR, pp. 358–361 (2004)Google Scholar
  5. 5.
    Chang, K.I., Bowyer, K.W., Flynn, P.J.: Face Recognition Using 2D and 3D Facial Data. In: MMUA, pp. 25–32 (2003)Google Scholar
  6. 6.
    Huang, J., Heisele, B., Blanz, V.: Component-based Face Recognition with 3D Morphable Models. In: AVBPA (2003)Google Scholar
  7. 7.
    Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. IEEE TCSVT 14(1), 4–20 (2004)Google Scholar
  8. 8.
    Lu, X., Jain, A.K., Colbry, D.: Matching 2.5D Face Scans to 3D Models. IEEE TPAMI 28(1), 31–43 (2006)Google Scholar
  9. 9.
    Mian, A.S., Bennamoun, M., Owens, R.A.: Region-based Matching for Robust 3D Face Recognition. BMVC 1, 199–208 (2005)Google Scholar
  10. 10.
    Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the Face Recognition Grand Challenge. In: IEEE CVPR (2005)Google Scholar
  11. 11.
    Taubin, G.: Curve and Surface Smoothing without Shrinkage. In: ICCV, pp. 852–857 (1995)Google Scholar
  12. 12.
    Turk, M., Pentland, A.: Eigenfaces for Recognition. JOCN 3 (1991)Google Scholar
  13. 13.
    Viola, P., Jones, M.J.: Robust Real-Time Face Detection. IJCV 57(2), 137–154 (2004)CrossRefGoogle Scholar
  14. 14.
    Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face Recognition: A Literature Survey. In: ACM Computing Survey, pp. 399–458 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ajmal Mian
    • 1
  • Mohammed Bennamoun
    • 1
  • Robyn Owens
    • 1
  1. 1.School of Computer Science and Software EngineeringThe University of Western AustraliaCrawleyAustralia

Personalised recommendations