Skip to main content
SpringerLink
Log in

Emotion and Facial Expression

  • Chapter
Affective Interactions (IWAI 1999)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1814))

Included in the following conference series:

Abstract

Facial expression is usually synthesized or predicted on the basis of a given emotion. The prototypical expressions for basic emotions (happiness, sadness, surprise, disgust, anger, and fear) as postulated by discrete emotion psychologists are rather consistently produced and interpreted among different cultures, and can be used as icons to represent a basic emotion. However, these facial expressions are actually rarely observable in every day affective episodes, because of the complexity and multi-functional nature of facial expression and a high inter-individual variance. This article sketches the different functions of facial expression and presents and alternative way to predict, synthesize, and understand facial behavior. We present an empirical setting, which allows us to collect behavioral data in human-computer interactions, and show some examples from empirical studies as well as a computational model for facial expression on the basis of appraisal theory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ball, G., Breese, J.: Emotion and Personality in a Conversational Character. In: Workshop on Embedded Conversational Characters., pp. 83–84, 119-121. Tahoe City, CA (1998)

    Google Scholar 

  2. Bänninger-Huber, E., Widmer, C.: A New Model of the Elicitation, Phenomenology, and Function of Emotions. In: Frijda, N.H. (ed.) Proceedings of the IXth Conference of the International Society for Research on Emotions, pp. 251–255. ISRE Publications, Toronto (1996)

    Google Scholar 

  3. Darwin, C.: The Expression of the Emotions in Man and Animals. University of Chicago Press, Chicago (1965) (Original work published 1876 London: Murray)

    Google Scholar 

  4. Ekman, P.: Facial Expressions of Emotion: New Findings, New Questions. Psychological Science 3, 34–38 (1992)

    Article  Google Scholar 

  5. Ekman, P., Friesen, W.V.: The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding. Semiotica 1, 49–98 (1969)

    Google Scholar 

  6. Ekman, P., Friesen, W.V.: The Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  7. Ekman, P., Friesen, W.V., Ellsworth, P.: Research Foundations. In: Ekman, P. (ed.) Emotion in the Human Face, 2nd edn., pp. 1–143. Cambridge University Press, New York (1982)

    Google Scholar 

  8. Elliot, C.: I Picked up Catapia and Other Stories: A Multi-modal Approach to Expressivity for ’Emotionally Intelligent’ Agents. In: Johnson, W.L. (ed.) Proceedings of the First International Conference of Autonomous Agents, pp. 451–457. ACM Press, New York (1997)

    Chapter  Google Scholar 

  9. Essa, I., Pentland, A.: Coding, Analysis, Interpretation, and Recognition of Facial Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 757–763 (1997)

    Article  Google Scholar 

  10. Fridlund, A.J.: Human Facial Expression: An Evolutionary View. Academic Press, San Diego (1994)

    Google Scholar 

  11. Frijda, N.H.: The Emotions. Cambridge University Press, Cambridge (1986)

    Google Scholar 

  12. Frijda, N.H., Tcherkassof, A.: Facial Expressions as Modes of Action Readiness. In: Russell, J.A., Fernández-Dols, J.M. (eds.) The Psychology of Facial Expression, pp. 78–102. Cambridge University Press, Cambridge (1997)

    Chapter  Google Scholar 

  13. Izard, C.E.: The Psychology of Emotions. Plenum Press, New York (1991)

    Google Scholar 

  14. Kaiser, S., Scherer, K.R.: Models of “Normal” Emotions Applied to Facial and Vocal Expressions in Clinical Disorders. In: Flack Jr., W.F., Laird, J.D. (eds.) Emotions in Psychopathology, pp. 81–98. Oxford University Press, New York (1998)

    Google Scholar 

  15. Kaiser, S., Wehrle, T.: Automated Coding of Facial Behavior in Human- Computer Interactions with FACS. Journal of Nonverbal Behavior 16, 67–83 (1992)

    Article  Google Scholar 

  16. Kaiser, S., Wehrle, T.: Situated Emotional Problem Solving in Interactive Computer Games. In: Frijda, N.H. (ed.) Proceedings of the IXth Conference of the International Society for Research on Emotions, ISRE 1996, pp. 276–280. ISRE Publications, Toronto (1996)

    Google Scholar 

  17. Kaiser, S., Wehrle, T.: Facial Expressions as Indicators of Appraisal Processes. In: Scherer, K.R., Schorr, A. (eds.) Appraisal Theories of Emotions: Theories, Methods, Research. Oxford University Press, New York (in press)

    Google Scholar 

  18. Kaiser, S., Wehrle, T., Edwards, P.: Multi-Modal Emotion Measurement in an Interactive Computer Game: A Pilot-Study. In: Frijda, N.H. (ed.) Proceedings of the VIIIth Conference of the International Society for Research on Emotions, pp. 275–279. ISRE Publications, Storrs (1994)

    Google Scholar 

  19. Kaiser, S., Wehrle, T., Schmidt, S.: Emotional Episodes, Facial Expression, and Reported Feelings in Human-Computer Interactions. In: Fischer, A.H. (ed.) Proceedings of the Xth Conference of the International Society for Research on Emotions, ISRE 1998, pp. 82–86. ISRE Publications, Würzburg (1998)

    Google Scholar 

  20. Lazarus, R.S.: Psychological Stress and the Coping Process. McGraw Hill, New York (1966)

    Google Scholar 

  21. Leventhal, H., Scherer, K.R.: The Relationship of Emotion to Cognition: A Functional Approach to a Semantic Controversy. Cognition and Emotion 1, 3–28 (1987)

    Article  Google Scholar 

  22. Lien, J.J., Kanade, T.K., Zlochower, A.Z., Cohn, J.F., Li, C.C.: A Multi-Method Approach for Discriminating Between Similar Facial Expressions, Including Expression Intensity Estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA (1998)

    Google Scholar 

  23. Pfeifer, R.: Artificial Intelligence Models of Emotion. In: Hamilton, V., Bower, G.H., Frijda, N.H. (eds.) Cognitive Perspectives on Emotion and Motivation, pp. 287–320. Kluwer Academic Publishers, Dordrecht (1988)

    Google Scholar 

  24. Picard, R.W.: Affective Computing. The MIT Press, Cambridge (1997)

    Google Scholar 

  25. Roseman, I.J., Kaiser, S.: Applications of Apprasial Theory to Understanding and Treating Emotion Pathology. In: Scherer, K.R., Schorr, A. (eds.) Appraisal Theories of Emotions: Theories, Methods, Research. Oxford University Press, New York (in press)

    Google Scholar 

  26. Roseman, I.J., Wiest, C., Swartz, T.S.: Phenomenology, Behaviors, and Goals Differentiate Discrete Emotions. Journal of Personality and Social Psychology 67, 206–221 (1994)

    Article  Google Scholar 

  27. Russell, J.A., Fernández-Dols, J.M. (eds.): The Psychology of Facial Expression. Cambridge University Press, Cambridge (1997)

    Google Scholar 

  28. Scherer, K.R.: On the Nature and Function of Emotion: A Component Process Approach. In: Scherer, K.R., Ekman, P. (eds.) Approaches to Emotion, pp. 293–318. Lawrence Erlbaum, Hillsdale (1984)

    Google Scholar 

  29. Scherer, K.R.: What Does Facial Expression Express? In: Strongman, K. (ed.) International Review of Studies on Emotion, vol. 2, pp. 139–165. Wiley, Chichester (1992)

    Google Scholar 

  30. Scherer, K.R.: Studying the Emotion-Antecedent Appraisal Process: An Expert System Approach. Cognition and Emotion 7, 325–355 (1993)

    Article  Google Scholar 

  31. Smith, C.A., Ellsworth, P.C.: Patterns of Cognitive Appraisal in Emotion. Journal of Personality and Social Psychology 48, 813–838 (1985)

    Article  Google Scholar 

  32. Smith, C.A., Scott, H.S.: A Componential Approach to the Meaning of Facial Expression. In: Russell, J.A., Fernández-Dols, J.M. (eds.) The Psychology of Facial Expression, pp. 229–254. Cambridge University Press, Cambridge (1997)

    Chapter  Google Scholar 

  33. Takeuschi, A., Naito, T.: Situated Facial Displays: Towards Social Interaction. In: CHI 1995, Human Factors in Computing Systems, pp. 450–454 (1995)

    Google Scholar 

  34. Wehrle, T.: The Facial Expression Analysis Tool (FEAT) Unpublished Computer Software. University of Geneva, Switzerland (1992/1996)

    Google Scholar 

  35. Wehrle, T.: The Autonomous Agent Modeling Environment (AAME) Unpublished Computer Software. University of Geneva, Switzerland (1993)

    Google Scholar 

  36. Wehrle, T.: Eine Methode zur Psychologischen Modellierung und Simulation von Autonomen Agenten. Unveröff. Dissertation an der Philosophischen Fakultät I, Universität Zürich (1994a)

    Google Scholar 

  37. Wehrle, T.: New Fungus Eater Experiments. In: Gaussier, P., Nicoud, J.-D. (eds.) From Perception to Action. IEEE Computer Society Press, Los Alamitos (1994b)

    Google Scholar 

  38. Wehrle, T.: The Geneva Appraisal Theory Environment (GATE). Unpublished Computer Software. University of Geneva, Switzerland (1995a)

    Google Scholar 

  39. Wehrle, T.: The Facial Action Composing Environment (FACE). Unpublished Computer Software. University of Geneva, Switzerland (1995b/1999)

    Google Scholar 

  40. Wehrle, T.: The Geneva Appraisal Manipulation Environment (GAME). Unpublished Computer Software. University of Geneva, Switzerland (1996a)

    Google Scholar 

  41. Wehrle, T.: The Interactive Data Elicitation and Analysis (IDEA). Unpublished Computer Software. University of Geneva, Switzerland (1996b)

    Google Scholar 

  42. Wehrle, T.: Motivations behind modeling emotional agents: Whose emotion does your robot have? Paper presented at the Workshop on Grounding Emotions in Adaptive Systems, hold at the 5th International Conference of the Society for Adaptive Behavior (SAB 1998), University of Zurich, Switzerland (1998)

    Google Scholar 

  43. Wehrle, T.: Topological Reconstruction and Computational Evaluation of Situations (TRACE). Unpublished Computer Software. University of Geneva, Switzerland (1999)

    Google Scholar 

  44. Wehrle, T., Scherer, K.R.: Potential Pitfalls in Computational Modelling of Appraisal Processes: A Reply to Chwelos and Oatley. Cognition and Emotion 9, 599–616 (1995)

    Article  Google Scholar 

  45. Wehrle, T., Scherer, K.R.: Towards Computational Modeling of Appraisal Theories. In: Scherer, K.R., Schorr, A. (eds.) Appraisal Theories of Emotions: Theories, Methods, Research. Oxford University Press, New York (in press)

    Google Scholar 

  46. Wehrle, T., Kaiser, S., Schmidt, S., Scherer, K.R.: Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology 78 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, University of Geneva, 40, Boulevard du Pont d’Arve, CH-1205, Geneva, Switzerland

    Thomas Wehrle & Susanne Kaiser

Authors
  1. Thomas Wehrle
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Susanne Kaiser
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. INESC-ID, IST, Taguspark, Av. Prof. Dr. Cavaco Silva, 2744-016, Porto Salvo, Portugal

    Ana Paiva

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Wehrle, T., Kaiser, S. (2000). Emotion and Facial Expression. In: Paiva, A. (eds) Affective Interactions. IWAI 1999. Lecture Notes in Computer Science(), vol 1814. Springer, Berlin, Heidelberg. https://doi.org/10.1007/10720296_5

Download citation

  • DOI: https://doi.org/10.1007/10720296_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-41520-6

  • Online ISBN: 978-3-540-44559-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation