Appearance-Based Smile Intensity Estimation by Cascaded Support Vector Machines

  • Keiji Shimada
  • Tetsu Matsukawa
  • Yoshihiro Noguchi
  • Takio Kurita
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6468)


Facial expression recognition is one of the most challenging research area in the image recognition field and has been studied actively for a long time. Especially, we think that smile is important facial expression to communicate well between human beings and also between human and machines. Therefore, if we can detect smile and also estimate its intensity at low calculation cost and high accuracy, it will raise the possibility of inviting many new applications in the future. In this paper, we focus on smile in facial expressions and study feature extraction methods to detect a smile and estimate its intensity only by facial appearance information (Facial parts detection, not required). We use Local Intensity Histogram (LIH), Center-Symmetric Local Binary Pattern (CS-LBP) or features concatenated LIH and CS-LBP to train Support Vector Machine (SVM) for smile detection. Moreover, we construct SVM smile detector as a cascaded structure both to keep the performance and reduce the calculation cost, and estimate the smile intensity by posterior probability. As a consequence, we achieved both low calculation cost and high performance with practical images and we also implemented the proposed methods to the PC demonstration system.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ekman, P., Friesen, W.V.: Unmasking the face. A guide to recognizing emotions from facial cues. Prentice-Hall, Englewood Cliffs (1975)Google Scholar
  2. 2.
    Fasel, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recognition 36, 259–275 (1999)CrossRefzbMATHGoogle Scholar
  3. 3.
    Whitehill, J., Littlewort, G., Fasel, I., Bartlett, M., Movellan, J.: Toward practical smile detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 2106–2111 (2009)CrossRefGoogle Scholar
  4. 4.
    Deniz, O., Castrillon, M., Lorenzo, J., Anton, L., Bueno, G.: Smile detection for user interfaces. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Remagnino, P., Porikli, F., Peters, J., Klosowski, J., Arns, L., Chun, Y.K., Rhyne, T.-M., Monroe, L. (eds.) ISVC 2008, Part II. LNCS, vol. 5359, pp. 602–611. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  5. 5.
    Heikkilä, M., Pietikäinen, M., Schmid, C.: Description of interest regions with local binary patterns. Pattern Recogn. 42(3), 425–436 (2009)CrossRefzbMATHGoogle Scholar
  6. 6.
    Shimada, K., Noguchi, Y., Sasahara, H., Yamamoto, M., Tamegai, H.: Detection of driverfs face orientation for safety driving assistance. Transactions of JSAE 41, 775–780 (2010)Google Scholar
  7. 7.
    Scholkopf, B., Burges, C.J.C., Smola, A.J.: Advances in Kernel Methods. The MIT Press, Cambridge (1998)zbMATHGoogle Scholar
  8. 8.
    Wallhoff, F.: Facial expressions and emotion database (2006),

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Keiji Shimada
    • 1
  • Tetsu Matsukawa
    • 2
  • Yoshihiro Noguchi
    • 1
  • Takio Kurita
    • 3
  1. 1.Human Technology Research Institute, Advanced Industrial Science and TechnologyTsukubaJapan
  2. 2.Graduate School of Systems and Information EngineeringUniversity of TsukubaTsukubaJapan
  3. 3.Faculty of EngineeringHiroshima UniversityHigashi-HiroshimaJapan

Personalised recommendations