A Study on Multimedia Emotion/Mood Classification and Recognition

  • Sang-Soo YeoEmail author
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 179)


Recently, multimedia emotion/mood can play an important role in multimedia understanding, retrieval, recommendation and some other multimedia applications. Many issues for multimedia emotion recognition have been addressed by different disciplines such as physiology, psychology, cognitive science and musicology. Recently, researchers have conducted various studies to uncover the relationship between multimedia contents such as image or music and emotion in many applications. In this paper, we introduce the emotion/mood models and features used for classification. This paper also presents a comparison of different emotion/mood classification methods in various multimedia applications.


Linear Discriminant Analysis Gaussian Mixture Model Emotion Recognition Emotion Model Music Information Retrieval 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Rho, S., Yeo, S.: Bridging the Semantic Gap in Multimedia Emotion/Mood Recognition for Ubiquitous Computing Environment. Journal of Supercomputing (JoS) (Online Published: June 4, 2010) Google Scholar
  2. 2.
    Ortony, A., Clore, G.L., Collins, L.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1998)Google Scholar
  3. 3.
    Russell, J.A.: A Circumplex Model of Affect. Journal of Personality and Social Psychology 39 (1980)Google Scholar
  4. 4.
    Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989)Google Scholar
  5. 5.
    Lakdashti, A., Moin, M.S., Badie, K.: A Novel Semantic-Based Image Retrieval Method. In: Proceeding of International Conference on Advanced Communication Technology, pp. 969–974 (2008)Google Scholar
  6. 6.
    Wang, Y., Guan, L.: Recognizing human emotional state from audiovisual signals. IEEE Transaction on Multimedia 10(5), 936–946 (2008)CrossRefGoogle Scholar
  7. 7.
    Dellandrea, E., Liu, N., Chen, L.: Classification of affective semantics in images based on discrete and dimensional models of emotions. In: 2010 International Workshop on Content Based Multimedia Indexing (CBMI), pp. 1–6 (2010)Google Scholar
  8. 8.
    Olkiewicz, K.A., M.-Kaczmar, U.: Emotion-based Image Retrieval—an Artificial Neural Network Approach. In: International Multiconference on Computer Science and Information Technology, pp. 89–96 (2010)Google Scholar
  9. 9.
    Luoh, L., Huang, C.-C., Liu, H.-Y.: Image processing based emotion recognition. In: International Conference on System Science and Engineering, pp. 491–494 (2010)Google Scholar
  10. 10.
    Lu, L., Liu, D., Zhang, H.: Automatic Mood Detection and Tracking of Music Audio Signals. IEEE Transactions on Audio, Speech and Audio Processing 14(1), 5–18 (2006)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Dunker, P., Nowak, S., Begau, A., Lanz, C.: Content-based Mood Classification for Photos and Music – A generic multi-modal classification framework and evaluation approach. In: ACM International Conference on Multimedia Information Retrieval, Vancouver, Canada, pp. 97–104 (2008)Google Scholar
  12. 12.
    Han, B., Rho, S., Dannenberg, R., Hwang, E.: SMERS: Music Emotion Recognition using Support Vector Regression. In: Proceedings of International Society for Music Information Retrieval, pp. 651–656 (2009)Google Scholar
  13. 13.
    Yang, Y.-H., Chen, H.H.: Ranking-Based Emotion Recognition for Music Organization and Retrieval. IEEE Transactions on Audio, Speech, and Language Processing 19(4) (2011)Google Scholar
  14. 14.
    Juslin, P.N., Sloboda, J.A.: Music and Emotion: Theory and research. Oxford University Press, New York (2001)Google Scholar
  15. 15.
    Esau, N., Wetzel, E., Kleinjohann, L., Keinjohann, B.: Real-time facial expression recognition using a fuzzy emotion model. In: IEEE International Fuzzy Systems Conference, pp. 1–6 (2007)Google Scholar
  16. 16.
    Zhao, S., Yao, H., Sun, X.: Affective Video Classification Based on Spatio-Temporal Feature Fusion. In: 6th International Conference on Image and Graphics, pp. 795–800 (2011)Google Scholar
  17. 17.
    Gajsek, R., Struc, V., Dobrisek, S., Mihelic, F.: Emotion recognition using linear transformations in combination with video. In: INTERSPEECH 2009, pp. 1967–1970 (2009)Google Scholar
  18. 18.
    Feng, Y., Zhuang, Y., Pan, Y.: Music information retrieval by detecting mood via computational media aesthetics. In: IEEE/WIC International Conference on Web Intelligence, pp. 235–241 (2003)Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2012

Authors and Affiliations

  1. 1.Division of Computer EngineeringMokwon UniversityDaejeonKorea

Personalised recommendations