Skip to main content

Building Emotion Recognition Control System Using Raspberry Pi

  • Conference paper
  • First Online:
Book cover Frontier Computing (FC 2017)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 464))

Included in the following conference series:

Abstract

Facial expression analysis for human-computer interaction, the driver’s state monitoring, or user emotion state monitoring has always been a very important issue in emotion recognition. People have a few emotions, and in different emotions, their facial expressions will have different characteristics. For example, if a person is happy, he/she may be with smiling face or smiling eyes, and if a person is angry or sad, he/she may frown. Once the system identified the user’s facial expression, there will be a corresponding action. This paper presents a framework for the use of raspberry functions to develop emotion recognition systems. We use Raspberry Pi’s camera module to detect the user’s facial expressions and use the Microsoft emotion recognition API to identify the user’s emotion. If the recognition result is angry or sad emotion, the system will broadcast gentle music and tune the light to be soft to smooth the person’s mood. Experiments results indicated the system can interact with users’ emotions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. https://dataholic.wordpress.com/2016/10/29. Accessed 29 Oct 2016

  2. https://en.wikipedia.org/wiki/Convolutional_neural_network

  3. Microsoft Emotion API. https://www.microsoft.com/cognitive-services/en-us/emotion-api

  4. Kotsia, I., Pitas, I.: Using geometric deformation features and support vector machines. IEEE Trans. Image Process. 16(1), 172–187 (2007)

    Article  MathSciNet  Google Scholar 

  5. Pantic, M., Patras, I.: Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans. Syst. Man Cybern. Part B Cybern. 36(2), 433–449 (2006)

    Article  Google Scholar 

  6. Pantic, M., Rothkrantz, L.J.M.: Facial action recognition for facial expression analysis from static face images. IEEE Trans. Syst. Man Cybern. Part B Cybern. 34(3), 1449–1461 (2004)

    Article  Google Scholar 

  7. Pantic, M., Rothkrantz, L.: Expert system for automatic analysis of facial expression. Image Vis. Comput. 18(11), 881–905 (2000)

    Article  Google Scholar 

  8. Bartlett, M.S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., Movellan, J.: Recognizing facial expression: machine learning and application to spontaneous behavior. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 568–573 (2005)

    Google Scholar 

  9. Bartlett, M.S., Movellan, J.R., Sejnowski, T.J.: Face recognition by independent component analysis. IEEE Trans. Neural Netw. 13(6), 1450–1464 (2002)

    Article  Google Scholar 

  10. Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  11. Viola, P., Jones, M.: Robust real time object detection. In: IEEE ICCV Workshop on Statistical and Computational Theories of Vision (2001)

    Google Scholar 

  12. Zhang, Z., Lyons, M.J., Schuster, M., Akamatsu, S.: Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron. In: Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, pp. 454–459 (1998)

    Google Scholar 

Download references

Acknowledgements

This paper is supported by Ministry of Science and Technology, Taiwan, (Grant Nos. MOST-104-2221-E-324-019-MY2 and MOST- 103-2632-E-324-001-MY3).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rung-Ching Chen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lee, HT., Chen, RC., Wei, D. (2018). Building Emotion Recognition Control System Using Raspberry Pi. In: Hung, J., Yen, N., Hui, L. (eds) Frontier Computing. FC 2017. Lecture Notes in Electrical Engineering, vol 464. Springer, Singapore. https://doi.org/10.1007/978-981-10-7398-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-7398-4_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-7397-7

  • Online ISBN: 978-981-10-7398-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics