Abstract
Emotions have been studied for a long time and results show that they play an important role in human cognitive functions. In fact, emotions play an extremely important role during the communication between people. And the human face is the most communicative part of the body for expressing emotions; it is recognized that a link exists between facial activity and emotional states. In order to make computer applications more believable and friendly, giving them the ability to recognize and/or express emotions are research fields which have been much focused on. Being able to perform these tasks, firstly, we need to have knowledge about the relationship between emotion and facial activity. Up to now, there have been proposed researches on this relationship. However, almost all these researches focused on analyzing the relationship without taking into account time factors. They analyzed the relationship but did not examined it in the time domain. In this paper, we propose a work on analyzing the relationship between emotions and facial activity in the time domain. Our goal is finding the temporal patterns of facial activity of six basic emotions (happy, sad, angry, fear, surprise, disgust). To perform this task, we analyzed a spontaneous video database in order to consider how facial activities which are related to the six basic emotions happen temporally. From there, we bring out the general temporal patterns for facial expressions of each of the six emotions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arnold, M.B.: Emotion and personality. Psychological aspects, vol. 1(2). Columbia University Press, New York (1960)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Computer Vision and Image Understanding 61(1), 38–59 (1995)
Darwin, C.: The expression of the emotions in man and animals. Univerity of Chicago Press, Chicago (1872/1965)
Du, S., Tao, Y., Martinez, A.M.: Compound facial expressions of emotion. In: Heeger, D.J. (ed.) Proceedings of the National Academy of Sciences, New York University, New York (2014)
Ekman, P.: Emotion in the human face. Cambridge University Press, Cambridge (1982)
Ekman, P., Friesen, W.V.: Unmasking the face: A guide to recognizing emotions from facial clues. Prentice-Hall, Englewood Cliffs (1975)
Ekman, P., Friesen, W.V.: The facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press, Inc, San Francisco (1978)
Ekman, P., Hager, J.: Facial action coding system affect interpretation database (facsaid), http://face-and-emotion.com/ dataface/facsaid/description.jsp
Ekman, P., Rosenberg, E.L.: What the face reveals: basic and applied studies of spontaneous expression using the facial action coding system (FACS), Illustrated Edition. Oxford University Press (1997)
Essa, I.A.: Analysis, Interpretation, and Synthesis of Facial Expressions. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA (1994)
Friesen, W., Ekman, P.: EMFACS-7: Emotional Facial Action Coding System. Unpublished manual, University of California, California (1983)
Izard, C.: Emotions and facial expressions: A perspective from differential emotions theory. In: Russell, J., Fernandez-Dols, J. (eds.) The Psychology of Facial Expression, Maison des Sciences de l’Homme and Cambridge University Press (1997)
Kappas, A.: What facial Activity can and cannot tell us about emotions. In: Katsikitis, M. (ed.) The Human Face: Measurement and Meaning, pp. 215–234. Kluwer Academic Publishers, Dordrecht (2003)
Mavadati, S.M., Mohammad, H.M., Bartlett, K., Trinh, P., Cohn, J.F.: Disfa: A spontaneous facial action intensity database. IEEE Transactions on Affective Computing 4(2), 151–160 (2013)
Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)
Pantic, M., Patras, I.: Detecting facial actions and their temporal segments in nearly frontal-view face image sequences. In: Proc. IEEE conf. Systems, Man and Cybernetics, vol. 4, pp. 3358–3363 (2005)
Pantic, M., Valstar, M.F., Rademaker, R., Maat, L.: Web-based database for facial expression analysis. In: Proc. 13th ACM Intl Conf. Multimedia, pp. 317–321 (2005)
Picard, R.: Affective Computing. MIT Press, Cambridge (1997)
Russell, J.A.: Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective. In: Russell, J.A., Fernndez-Dols, J.M. (eds.) The Psychology of Facial Expression, Cambridge University Press, New York (1997)
Scherer, K.R.: What does facial expression express? In: Strongman, K. (ed.) International Review of Studies on Emotion, vol. 2, Wiley, Chichester (1992)
Tian, Y., Kanade, T., Cohn, J.: Recognizing action units for facial expression analysis. IEEE Trans. Pattern Analysis and Machine Intelligence 23(2), 97–115 (2001)
Tomkins, S.S.: Affect, Imagery, Consciousness. The Positive Affects, vol. 1. Springer, New York (1962)
Viola, P., Jones, M.: Robust real-time object detection, tech. rep.,Cambridge Research Laboratory Technical report series (2) (2001)
Wallhoff, F.: The facial expressions and emotions database homepage (feedtum), www.mmk.ei.tum.de/~waf/fgnet/feedtum.html
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Ngo, T.D., Ma, T.C., Bui, T.D. (2015). Emotional Facial Expression Analysis in the Time Domain. In: Nguyen, VH., Le, AC., Huynh, VN. (eds) Knowledge and Systems Engineering. Advances in Intelligent Systems and Computing, vol 326. Springer, Cham. https://doi.org/10.1007/978-3-319-11680-8_39
Download citation
DOI: https://doi.org/10.1007/978-3-319-11680-8_39
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11679-2
Online ISBN: 978-3-319-11680-8
eBook Packages: EngineeringEngineering (R0)