Abstract
Recently, multimedia emotion/mood can play an important role in multimedia understanding, retrieval, recommendation and some other multimedia applications. Many issues for multimedia emotion recognition have been addressed by different disciplines such as physiology, psychology, cognitive science and musicology. Recently, researchers have conducted various studies to uncover the relationship between multimedia contents such as image or music and emotion in many applications. In this paper, we introduce the emotion/mood models and features used for classification. This paper also presents a comparison of different emotion/mood classification methods in various multimedia applications.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Rho, S., Yeo, S.: Bridging the Semantic Gap in Multimedia Emotion/Mood Recognition for Ubiquitous Computing Environment. Journal of Supercomputing (JoS) (Online Published: June 4, 2010)
Ortony, A., Clore, G.L., Collins, L.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1998)
Russell, J.A.: A Circumplex Model of Affect. Journal of Personality and Social Psychology 39 (1980)
Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989)
Lakdashti, A., Moin, M.S., Badie, K.: A Novel Semantic-Based Image Retrieval Method. In: Proceeding of International Conference on Advanced Communication Technology, pp. 969–974 (2008)
Wang, Y., Guan, L.: Recognizing human emotional state from audiovisual signals. IEEE Transaction on Multimedia 10(5), 936–946 (2008)
Dellandrea, E., Liu, N., Chen, L.: Classification of affective semantics in images based on discrete and dimensional models of emotions. In: 2010 International Workshop on Content Based Multimedia Indexing (CBMI), pp. 1–6 (2010)
Olkiewicz, K.A., M.-Kaczmar, U.: Emotion-based Image Retrieval—an Artificial Neural Network Approach. In: International Multiconference on Computer Science and Information Technology, pp. 89–96 (2010)
Luoh, L., Huang, C.-C., Liu, H.-Y.: Image processing based emotion recognition. In: International Conference on System Science and Engineering, pp. 491–494 (2010)
Lu, L., Liu, D., Zhang, H.: Automatic Mood Detection and Tracking of Music Audio Signals. IEEE Transactions on Audio, Speech and Audio Processing 14(1), 5–18 (2006)
Dunker, P., Nowak, S., Begau, A., Lanz, C.: Content-based Mood Classification for Photos and Music – A generic multi-modal classification framework and evaluation approach. In: ACM International Conference on Multimedia Information Retrieval, Vancouver, Canada, pp. 97–104 (2008)
Han, B., Rho, S., Dannenberg, R., Hwang, E.: SMERS: Music Emotion Recognition using Support Vector Regression. In: Proceedings of International Society for Music Information Retrieval, pp. 651–656 (2009)
Yang, Y.-H., Chen, H.H.: Ranking-Based Emotion Recognition for Music Organization and Retrieval. IEEE Transactions on Audio, Speech, and Language Processing 19(4) (2011)
Juslin, P.N., Sloboda, J.A.: Music and Emotion: Theory and research. Oxford University Press, New York (2001)
Esau, N., Wetzel, E., Kleinjohann, L., Keinjohann, B.: Real-time facial expression recognition using a fuzzy emotion model. In: IEEE International Fuzzy Systems Conference, pp. 1–6 (2007)
Zhao, S., Yao, H., Sun, X.: Affective Video Classification Based on Spatio-Temporal Feature Fusion. In: 6th International Conference on Image and Graphics, pp. 795–800 (2011)
Gajsek, R., Struc, V., Dobrisek, S., Mihelic, F.: Emotion recognition using linear transformations in combination with video. In: INTERSPEECH 2009, pp. 1967–1970 (2009)
Feng, Y., Zhuang, Y., Pan, Y.: Music information retrieval by detecting mood via computational media aesthetics. In: IEEE/WIC International Conference on Web Intelligence, pp. 235–241 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media Dordrecht
About this paper
Cite this paper
Yeo, SS. (2012). A Study on Multimedia Emotion/Mood Classification and Recognition. In: Park, J., Leung, V., Wang, CL., Shon, T. (eds) Future Information Technology, Application, and Service. Lecture Notes in Electrical Engineering, vol 179. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-5064-7_47
Download citation
DOI: https://doi.org/10.1007/978-94-007-5064-7_47
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-5063-0
Online ISBN: 978-94-007-5064-7
eBook Packages: EngineeringEngineering (R0)