A Fast and Robust Feature Set for Cross Individual Facial Expression Recognition

  • Rodrigo Araujo
  • Yun-Qian Miao
  • Mohamed S. Kamel
  • Mohamed Cheriet
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7594)


This paper presents a new simple and robust set of features to classify emotional states in sequences of facial images. The proposed method is derived from simple geometric-based features that deliver a fast, highly discriminative, low-dimensional, and robust classification across individuals. The proposed method was compared to other state-of-the-art methods such as Gabor, LBP and AAM-based features. They were all compared using four different classifiers and experimental results based on these classifiers have shown that the proposed features are more stable in “leave-same-sequence-image-out” (LSSIO) environments, less computational intense and faster when compared to others.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ahonen, T., Hadid, A., Pietikäinen, M.: Face description with local binary patterns: Application to face recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 28(12), 2037–2041 (2006)CrossRefGoogle Scholar
  2. 2.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)CrossRefGoogle Scholar
  3. 3.
    Koelstra, S., Pantic, M., Patras, I.: A dynamic texture-based approach to recognition of facial actions and their temporal models. IEEE Trans. Pattern Analysis and Machine Intelligence 32(11), 1940–1954 (2010)CrossRefGoogle Scholar
  4. 4.
    Li, P., Phung, S.L., Bouzerdoum, A., Tivive, F.H.C.: Improved facial expression recognition with trainable 2-d filters and support vector machines. In: 20th International Conference on Pattern Recognition, pp. 3732–3735 (August 2010)Google Scholar
  5. 5.
    Lucey, P., Cohn, J., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended cohn-kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101 (June 2010)Google Scholar
  6. 6.
    Maalej, A., Amor, B.B., Daoudi, M., Srivastava, A., Berretti, S.: Local 3d shape analysis for facial expression recognition. In: 20th International Conference on Pattern Recognition, pp. 4129–4132 (August 2010)Google Scholar
  7. 7.
    Pantic, M., Rothkrantz, L.: Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 1424–1445 (2000)CrossRefGoogle Scholar
  8. 8.
    Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: A comprehensive study. Image Vision Comput. 27(6), 803–816 (2009)CrossRefGoogle Scholar
  9. 9.
    Tian, Y.I., Kanade, T., Cohn, J.: Recognizing action units for facial expression analysis. IEEE Trans. Pattern Analysis and Machine Intelligence 23(2), 97–115 (2001)CrossRefGoogle Scholar
  10. 10.
    Tian, Y.I., Kanade, T., Cohn, J.: Evaluation of gabor-wavelet-based facial action unit recognition in image sequences of increasing complexity. In: Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 229–234 (May 2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Rodrigo Araujo
    • 1
  • Yun-Qian Miao
    • 1
  • Mohamed S. Kamel
    • 1
  • Mohamed Cheriet
    • 2
  1. 1.Center for Pattern Analysis and Machine Intelligence, Electrical & Computer EngineeringUniversity of WaterlooCanada
  2. 2.Department of Automated Manufacturing EngineeringÉcole de Technologie SupérieureCanada

Personalised recommendations