Skip to main content

Expression of Moral Emotions in Cooperating Agents

  • Conference paper
Intelligent Virtual Agents (IVA 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5773))

Included in the following conference series:

Abstract

Moral emotions have been argued to play a central role in the emergence of cooperation in human-human interactions. This work describes an experiment which tests whether this insight carries to virtual human-human interactions. In particular, the paper describes a repeated-measures experiment where subjects play the iterated prisoner’s dilemma with two versions of the virtual human: (a) neutral, which is the control condition; (b) moral, which is identical to the control condition except that the virtual human expresses gratitude, distress, remorse, reproach and anger through the face according to the action history of the game. Our results indicate that subjects cooperate more with the virtual human in the moral condition and that they perceive it to be more human-like. We discuss the relevance these results have for building agents which are successful in cooperating with humans.

This work was sponsored by the U.S. Army Research, Development, and Engineering Command. The content does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Frank, R.: Introducing Moral Emotions into Models of Rational Choice. In: Manstead, A.S., Frijda, N., Fischer, A. (eds.) Feelings and Emotions: The Amsterdam Symposium, pp. 422–440. Cambridge University Press, Cambridge (2004)

    Chapter  Google Scholar 

  2. Haidt, J.: The Moral Emotions. In: Davidson, R.J., Scherer, K.R., Goldsmith, H.H. (eds.) Handbook of Affective Sciences, pp. 852–870. Oxford University Press, Oxford (2003)

    Google Scholar 

  3. Lowenstein, G., Lerner, J.: The Role of Affect in Decision Making. In: Davidson, R.J., Scherer, K.R., Goldsmith, H.H. (eds.) Handbook of Affective Sciences, pp. 619–642. Oxford University Press, Oxford (2003)

    Google Scholar 

  4. Frank, R.: Cooperation through emotional commitment. In: Hesse, R. (ed.) Evolution and the capacity for commitment, pp. 57–76. Russell Sage, New York (2001)

    Google Scholar 

  5. Gratch, J., Rickel, J., Andre, E., Cassell, J., Petajan, E., Badler, N.: Creating Interactive Virtual Humans: Some Assembly Required. IEEE Intellig. Systems 17(4), 54–63 (2002)

    Article  Google Scholar 

  6. Sabater, J., Sierra, C.: Review on computational trust and reputation models. Artificial Intelligence Review 24, 33–60 (2005)

    Article  MATH  Google Scholar 

  7. Morris, M., Keltner, D.: How Emotions Work: The Social Functions of Emotional Expression in Negotiations. Research in Organizational Behaviour 22, 1–50 (2000)

    Article  Google Scholar 

  8. Reeves, B., Nass, C.: The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. University of Chicago Press (1996)

    Google Scholar 

  9. Kramer, N.: Social Effects of Virtual Assistants. A Review of Empirical Results with Regard to Communication. Intelligent Virtual Agents 2008, 507–508 (2008)

    Google Scholar 

  10. Poundstone, W.: Prisoner’s Dilemma. Anchor Books (1992)

    Google Scholar 

  11. Axelrod, R.: The Evolution of Cooperation. Basic Books (1984)

    Google Scholar 

  12. de Melo, C., Paiva, A.: Multimodal Expression in Virtual Humans. Computer Animation and Virtual Worlds 17(3-4), 239–248 (2006)

    Article  Google Scholar 

  13. Keltner, D., Kring, A.: Emotion, Social Function, and Psychopathology. Review of General Psychology 2(3), 320–342 (1998)

    Article  Google Scholar 

  14. Sally, D.: A general theory of sympathy, mind-reading, and social interaction, with an application to the prisoner’s dilemma. Social Science Information 39(4), 567–623 (2000)

    Article  Google Scholar 

  15. Damasio, A.: Descarte’s Error: Emotion, Reason, and the Human Brain. G.P. Putnan’s Sons (1994)

    Google Scholar 

  16. Capella, J.: On defining conversational coordination and rapport. Psychological Inquiry 1(4), 303–305 (1990)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

de Melo, C.M., Zheng, L., Gratch, J. (2009). Expression of Moral Emotions in Cooperating Agents. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds) Intelligent Virtual Agents. IVA 2009. Lecture Notes in Computer Science(), vol 5773. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04380-2_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04380-2_32

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04379-6

  • Online ISBN: 978-3-642-04380-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics