On Decomposing an Unseen 3D Face into Neutral Face and Expression Deformations

  • Faisal R. Al-Osaimi
  • Mohammed Bennamoun
  • Ajmal Mian
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5558)


This paper presents a technique for decomposing an unseen 3D face under any facial expression into an estimated 3D neutral face and expression deformations (the shape residue between the non-neutral and the estimated neutral 3D face). We show that this decomposition gives a robust facial expression classification and improves the accuracy of an off-the-shelf 3D face recognition system. The proposed decomposition system is a multistage data-driven process in which training expression residues and neutral faces reciprocally guide the decomposition of the 3D face. A plausible decomposition was achieved. The shapes and the normals of the expression residue are used for expression classification while the neutral face estimates are used for expression robust face recognition. Experiments were performed on a large number of non-neutral scans and significant expression classification rates were achieved. Moreover, 6% increase in face recognition rate was achieved for probes with severe facial expressions.


Facial Expression Face Recognition Facial Expression Recognition Neutral Face Face Recognition System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Al-Osaimi, F., Bennamoun, M., Mian, A.: An Expression Deformation Approach to Non-rigid 3D Face Recognition. IJCV (2009)Google Scholar
  2. 2.
    Abboud, B., Davoine, F.: Bilinear factorisation for facial expression analysis and synthesis. Vision, Image and Signal Processing (2005)Google Scholar
  3. 3.
    Chandrasiri, N.P., Naemura, T., Harashima, H.: Interactive analysis and synthesis of facial expressions based on personal facial expression space. In: IEEE Conference on Automatic Face and Gesture Recognition (2004)Google Scholar
  4. 4.
    Chang, K., Bowyer, K., Flynn, P.: Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition. In: CVPR (2005)Google Scholar
  5. 5.
    Chen, Y., Medioni, G.: Object modeling by registration of multiple range images. In: ICRA (1991)Google Scholar
  6. 6.
    Chua, C., Han, F., Ho, Y.: 3D Human Face Recognition Using Point Signature. In: IEEE Conference on Automatic Face and Gesture Recognition (2000)Google Scholar
  7. 7.
    Faltemier, T., Bowyer, K., Flynn, P.: Using a Multi-Instance Enrollment Representation to Improve 3D Face Recognition. In: IEEE BTAS (2007)Google Scholar
  8. 8.
    Jollife, I.: Principal Component Analysis. Springer, Heidelberg (1986)Google Scholar
  9. 9.
    Lee, J., Lee, J.H., Kim, H., Moon, Y.: Automatic Synthesis of Realistic Facial Expressions. In: IEEE Symposium on Signal Processing and Information Technology (2007)Google Scholar
  10. 10.
    Matsugu, M., Mori, K., Mitari, Y., Kaneda, Y.: Subject independent facial expression recognition with robust face detection using a convolutional neural network. International Journal of Neural Networks (2003)Google Scholar
  11. 11.
    Mian, A., Bennamoun, M., Owens, R.: An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition. In: IEEE PAMI (2007)Google Scholar
  12. 12.
    Mpiperis, I., Malassiotis, S., Strintzis, M.: Bilinear Models for 3D Face and Facial Expression Recognition. IEEE Transactions on Information Forensics and Security (2008)Google Scholar
  13. 13.
    Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the Face Recognition Grand Challenge. In: CVPR (2005)Google Scholar
  14. 14.
    Ramachandran, M., Zhou, S., Jhalani, D., Chellappa, R.: A method for converting a smiling face to a neutral face with applications to face recognition. In: IEEE ICASSP (2005)Google Scholar
  15. 15.
    Ramanathan, S., Kassim, A., Venkatesh, Y., Wah, W.: Human Facial Expression Recognition using a 3D Morphable Model. In: IEEE Conference on Image Processing (2006)Google Scholar
  16. 16.
    Samper, S., Favreliere, H., Vacher, P., Coudert, T.: 3D measurement and synthesis of facial expressions. In: Symposium on 3D Analysis of Human Movement (2006)Google Scholar
  17. 17.
    Tang, H., Huang, T.: 3D facial expression recognition based on automatically selected features. In: IEEE Computer Vision and Pattern Recognition Workshops (2008)Google Scholar
  18. 18.
    Wang, H., Ahuja, N.: Facial Expression Decomposition. In: ICCV (2003)Google Scholar
  19. 19.
    Wang, S., Gu, X., Qin, H.: Automatic non-rigid registration of 3D dynamic data for facial expression synthesis and transfer. In: CVPR (2008)Google Scholar
  20. 20.
    Wang, J., Yin, L.: Static topographic modeling for facial expression recognition and analysis. Computer Vision ans Image Understanding (2007)Google Scholar
  21. 21.
    Zhan, Y., Ye, J., Niu, D., Cao, P.: Facial Expression Recognition Based on Gabor Wavelet Transformation and Elastic Templates Matching. In: International Conference on Image and Graphics (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Faisal R. Al-Osaimi
    • 1
  • Mohammed Bennamoun
    • 1
  • Ajmal Mian
    • 1
  1. 1.The University of Western AustraliaCrawleyAustralia

Personalised recommendations