Skip to main content

Facial Expression Recognition from Webcam Based on Active Shape Models and Support Vector Machines

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8868))

Abstract

This paper introduces an application that uses a webcam and aims to recognize emotions of an elderly from his/her facial expression in real-time. Six basic emotions (Happiness, Sadness, Anger, Fear, Disgust and Surprise) as well as a Neutral state are distinguished. Active shape models are applied for feature extraction, the Cohn-Kanade, JAFFE and MMI databases are used for training, and support vector machines (ν-SVM) are employed for facial expression classification. In the future, the application is thought to be the starting point to enhance the mood of the elderly by external stimuli.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gascueña, J.M., Castillo, J.C., Navarro, E., Fernández-Caballero, A.: Engineering the development of systems for multisensory monitoring and activity interpretation. International Journal of Systems Science 45(4), 728–740 (2014)

    Article  MATH  Google Scholar 

  2. Alugupally, N., Samal, A., Marx, D., Bhatia, S.: Analysis of landmarks in recognition of face expressions. Pattern Recognition and Image Analysis 21(4), 681–693 (2011)

    Article  Google Scholar 

  3. Maglogiannis, I., Vouyioukas, D., Aggelopoulos, C.: Face detection and recognition of natural human emotion using Markov random fields. Personal and Ubiquitous Computing 13(1), 95–101 (2009)

    Article  Google Scholar 

  4. Wang, L., Gu, X., Wang, Y., Zhang, L.: Happy-sad expression recognition using emotion geometry feature and support vector machine. In: Köppen, M., Kasabov, N., Coghill, G. (eds.) ICONIP 2008, Part II. LNCS, vol. 5507, pp. 535–542. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  5. Zhang, L., Tjondronegoro, D.W., Chandran, V.: Discovering the best feature extraction and selection algorithms for spontaneous facial expression recognition. In: Proc. 2012 IEEE Conference on Multimedia and Expo, pp. 1027–1032 (2012)

    Google Scholar 

  6. Cootes, T.F., Taylor, C.J., Coper, D.H., Graham, J.: Active shape models - their training and application. Computer Vision and Image Understanding 61(1), 38–59 (1996)

    Article  Google Scholar 

  7. Cortes, C., Vapnik, V.: Support-vector networks. Machine Learning 20(3), 273–297 (1995)

    MATH  Google Scholar 

  8. Chang, Y., Hu, C., Feris, R., Turk, M.: Manifold based analysis of facial expression. Image and Vision Computing 24(6), 605–614 (2006)

    Article  Google Scholar 

  9. Pantic, M., Bartlett, M.: Machine analysis of facial expressions. In: Face Recognition, ch. 20, pp. 978–973 (2007) ISBN 978-3-902613-03-5

    Google Scholar 

  10. Hsieh, C.-C., Jiang, M.-K.: A facial expression classification system based on active shape model and support vector machine. In: Proc. 2011 International Symposium on Computer Science and Society, pp. 311–314 (2011)

    Google Scholar 

  11. Wu, J., Mei, L.: A face recognition algorithm based on ASM and Gabor features of key points. In: Proceedings of SPIE 8768, Article number 87686L (2013)

    Google Scholar 

  12. Wan, C., Tian, Y., Liu, S.: Facial expression recognition in video sequences. In: Proc. 10th World Congress on Intelligent Control and Automation, pp. 4766–4770 (2012)

    Google Scholar 

  13. Gang, L., Xiao-hua, L., Ji-liu, Z., Xiao-gang, G.: Geometric feature based facial expression recognition using multiclass support vector machines. In: Proc. 2009 IEEE International Conference on Granular Computing, pp. 318–321 (2009)

    Google Scholar 

  14. Zhao, X., Zhang, H., Xu, Z.: Expression recognition by extracting facial features of shapes and textures. Journal of Computational Information Systems 8(8), 3377–3384 (2012)

    Google Scholar 

  15. Cruz, A., Bhanu, B.: A biologically inspired approach for fusing facial expression and appearance for emotion recognition. In: Proc. 19th IEEE International Conference on Image Processing, pp. 2625–2628 (2012)

    Google Scholar 

  16. Zhou, Q., Wang, X.: Real-time facial expression recognition system based-on geometric features. Lecture Notes in Electrical Engineering, vol. 212, pp. 449–456 (2013)

    Google Scholar 

  17. Ekman, P., Friesen, W.V., Hager, J.C.: Facial Action Coding System (FACS) (2002), http://face-and-emotion.com/dataface/facs/new_version.jsp

  18. Wei, Y.: Research on facial expression recognition and synthesis. Master Thesis. Department of Computer Science and Technology, Nanjing University (2009), http://code.google.com/p/asmlibrary

  19. Stegmann, M.B.: Analysis and segmentation of face images using point annotations and linear subspace techniques. Technical Report IMM-REP-2002-22 (2002), http://www2.imm.dtu.dk/pubdb/views/publication_details.php?id=922

  20. Cootes, T.F., Cristinacce, D., Babalola, K.: BioID face database (2005), http://www.bioid.com/index.php?q=downloads/software/bioid-face-database.html

  21. Chan, C.H.: The XM2VTS Database (2000), http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/

  22. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2(27), 1–27 (2011)

    Article  Google Scholar 

  23. Wu, T.F., Lin, C.J., Wang, R.C.: Probability estimates for multi-class classification by pairwise coupling. Journal of Machine Learning Research 5, 975–1005 (2004)

    MATH  Google Scholar 

  24. Lyons, M.J., Kamachi, M., Gyoba, J.: Japanese Female Facial Expressions (JAFFE). Database of Digital Images (1997), http://www.kasrl.org/jaffe_info.html

  25. Valstar, M.F., Pantic, M.: Induced disgust, happiness and surprise: an addition to the IMM facial expression database. In: Proc. International Conference on Language Resources and Evaluation, Workshop on Emotion, pp. 65–70 (2010)

    Google Scholar 

  26. Kanade, T., Cohn, J., Tian, Y.L.: Comprehensive database for facial expression analysis. In: Proc. 4th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53 (2000)

    Google Scholar 

  27. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The Extended Cohn-Kanade Dataset (CK+): A complete facial expression dataset for action unit and emotion-specified expression. In: Proc. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 94–101 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Lozano-Monasor, E., López, M.T., Fernández-Caballero, A., Vigo-Bustos, F. (2014). Facial Expression Recognition from Webcam Based on Active Shape Models and Support Vector Machines. In: Pecchia, L., Chen, L.L., Nugent, C., Bravo, J. (eds) Ambient Assisted Living and Daily Activities. IWAAL 2014. Lecture Notes in Computer Science, vol 8868. Springer, Cham. https://doi.org/10.1007/978-3-319-13105-4_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-13105-4_23

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-13104-7

  • Online ISBN: 978-3-319-13105-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics