Facial Feature Model for Emotion Recognition Using Fuzzy Reasoning

  • Renan Contreras
  • Oleg Starostenko
  • Vicente Alarcon-Aquino
  • Leticia Flores-Pulido
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6256)


In this paper we present a fuzzy reasoning system that can measure and recognize the intensity of basic or non-prototypical facial expressions. The system inputs are the encoded facial deformations described either in terms of Ekman´s Action Units (AUs) or Facial Animation Parameters (FAPs) of MPEG-4 standard. The proposed fuzzy system uses a knowledge base implemented on knowledge acquisition and ontology editor Protégé. It allows the modeling of facial features obtained from geometric parameters coded by AUs - FAPs and also the definition of rules required for classification of measured expressions. This paper also presents the designed framework for fuzzyfication of input variables for fuzzy classifier based on statistical analysis of emotions expressed in video records of standard Cohn-Kanade’s and Pantic´s MMI face databases. The proposed system has been tested in order to evaluate its capability for detection, classifying, and interpretation of facial expressions.


Emotion recognition facial features knowledge-based framework rules-based fuzzy classifier 


  1. 1.
    Young-Joong, K., Myo-Taeg, L.: Near-Optimal Fuzzy Systems Using Polar Clustering: Application. In: Khosla, R., Howlett, R.J., Jain, L.C. (eds.) KES 2005. LNCS (LNAI), vol. 3684, pp. 518–524. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  2. 2.
    Yamakawa, T.: Stabilization of an inverted pendulum by a high-speed fuzzy logic controller hardware system, J. Fuzzy Sets and Sys. 32(2), 161–180 (1989)CrossRefGoogle Scholar
  3. 3.
    Mufti, M., Khanam, A.: Fuzzy Rule Based Facial Expression Recognition, Computational Intelligence for Modeling, Control and Automation (2006)Google Scholar
  4. 4.
    Esau, N., Wetzel, E.L.: Real-Time Facial Expression Recognition Using a Fuzzy Emotion Model. In: IEEE Fuzzy Systems Conf., pp. 1–6 (2007)Google Scholar
  5. 5.
    Pantic, M.: An Expert System for Multiple Emotional Classification of Facial Expressions. In: 11th IEEE Int. Conf. on Tools with Artif. Intel., p. 113 (1999)Google Scholar
  6. 6.
    Akamatsu, L.S.: Coding facial expressions with Gabor wavelets. McGraw Hill, N.Y. (1998)Google Scholar
  7. 7.
    Kyoung, S.C., Yong-Guk, K., Yang-Bok, L.: Real-Time Expression Recog. Using Active Appearance Model. In: Int. Conf. Comp. Intelligence and Security, China, pp. 1–8 (2006)Google Scholar
  8. 8.
    Lin, D.T.: Facial Expression Classification Using PCA and Hierarchical Radial Basis Function Network. J. Inf. Science and Eng. 22, 1033–1046 (2006)Google Scholar
  9. 9.
    Black, M.J.: Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion. J. of Comp. Vision 25(1), 23–48 (1998)CrossRefGoogle Scholar
  10. 10.
    Kharat, G.U., Dudul, S.V.: Neural Network Classifier for Human Emotion Recognition. In: 1-st Int. Conf. on Emerging Trends in Eng. and Techn., Iran, pp. 1–6 (2008)Google Scholar
  11. 11.
    Cohen, I., Garg, A., Huang, T.S.: Emotion Recognition from Facial Expressions using Multilevel HMM. Neural Information Processing Systems, London (2000)Google Scholar
  12. 12.
    Plutchik, R.: The nature of emotions. J. American Scientist 89, 344 (2001)CrossRefGoogle Scholar
  13. 13.
    Contreras, R., Starostenko, O.: A Knowledge-base Framework for Analysis of Facial Expressions. In: 10th Conf. on Pat. Recog. and Inf. Proces., Belarus, pp. 251–256 (2009)Google Scholar
  14. 14.
    Ekman, P., Friesen, W.: Facial Action Coding System (FACS). Consulting Psychologists Press, Palo Alto (1978)Google Scholar
  15. 15.
    ISO/IEC14496-2:2001(E), International Standard, Information technology - Coding of audio-visual objects - Part 2, 2nd Ed. (2001)Google Scholar
  16. 16.
    Kanade T., Cohn J.: Comprehensive database for facial expression analysis. In: 4-th IEEE Conf. on Autom. Face and Gesture Recog. France, pp. 46–53 (2000) Google Scholar
  17. 17.
    Pantic, M., Valstar, M.F., Rademaker, R.: Web-based Database for Facial Expression Analysis. In: IEEE Conf. Multmedia and Expo., Netherlands, pp. 1–6 (2005)Google Scholar
  18. 18.
    Ontology editor Protégé (2009),

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Renan Contreras
    • 1
  • Oleg Starostenko
    • 1
  • Vicente Alarcon-Aquino
    • 1
  • Leticia Flores-Pulido
    • 1
  1. 1.CENTIA, Department of Computing, Electronics and MechatronicsUniversidad de las AméricasPueblaMéxico

Personalised recommendations