Skip to main content
SpringerLink
Log in

Interacting with Emotion and Memory Enabled Virtual Characters and Social Robots

  • Chapter
Modeling Machine Emotions for Realizing Intelligence

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 1))

  • 769 Accesses

Abstract

Personality and emotion modeling is being used recently in order to create variation in the behaviour of virtual characters and social robots and to make them socially intelligent for more engaged interaction with people. For these characters to be everyday social actors, it is also important that they can remember and maintain their feelings and establish unique emotional interpersonal relationships with people in a long-term manner. Thus they should be equipped with emotion and memory capabilities in order to remember interacted people and past exchanges with them. This chapter gives an overview of theories and applications on emotion, personality and memory enabled intelligent autonomous characters and mentions about our research on creating long-term emotional interactions with a social robot with human-like expression capability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gratch, J., Marsella, S.: Lessons from emotion psychology for the design of lifelike characters. Applied Artificial Intelligence 19(3-4), 215–233 (2005)

    Article  Google Scholar 

  2. Ekman, P.: Emotion in the Human Face. Cambridge University Press, New York (1982)

    Google Scholar 

  3. Plutchik, R.: A general psychoevolutionary theory of emotion. In: Plutchik, R., Kellerman, H. (eds.) Emotion: Theory, research, and experience, vol. 1, pp. 2–33 (1980)

    Google Scholar 

  4. Lazharus, R.: Emotion and Adaptation. Oxford University Press, Oxford (1991)

    Google Scholar 

  5. Roseman, I., Spindel, M., Jose, P.: Appraisals of emotion-eliciting events: Testing a theory of discrete emotions. Personality and Social Psychology 59(5), 899–913 (1990)

    Article  Google Scholar 

  6. Scherer, K.R., Shorr, A., Johnstone, T.: Appraisal processes in emotion: theory, methods, research. Oxford University Press, Canary (2001)

    Google Scholar 

  7. Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)

    Google Scholar 

  8. Ortony, A.: On making believable emotional agents believable. In: Trappl, R., et al. (eds.) Emotions in Humans and Artifacts, pp. 189–212 (2003)

    Google Scholar 

  9. Bartneck, C.: Integrating the occ model of emotions in embodied characters. In: Proceedings of the Workshop on Workshop on Virtual Conversational Characters: Applications, Methods, and Research Challenges, Melbourne (2002)

    Google Scholar 

  10. Vinayagamoorthy, V., Gillies, M., Steed, A., Tanguy, E., Pan, X., Loscos, C., Slater, M.: Building expression into virtual characters. In: Eurographics Conference State of the Art Reports (2006)

    Google Scholar 

  11. Whissel, C.M.: The dictionary of affect in language (1980)

    Google Scholar 

  12. Mehrabian, A.: Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology 14, 261–292 (1996)

    Article  MathSciNet  Google Scholar 

  13. Mccrae, R.R., John, P.: An introduction to the five-factor model and its applications. Journal of Personality 60, 175–215 (1992)

    Article  Google Scholar 

  14. Hampson, S.: State of the art: Personality. The Psychologist 12(6), 284–290 (1999)

    Google Scholar 

  15. Bickmore, T.W., Picard, R.W.: Establishing and maintaining long-term human-computer relationships. ACM Trans. Comput.-Hum. Interact. 12(2), 293–327 (2005)

    Article  Google Scholar 

  16. Svennevig, J.: Getting acquainted in conversation. John Benjamins, Philadephia (1999)

    Google Scholar 

  17. Argyle, M.: Bodily communication, 2nd edn. Methuen and Co Ltd (1998)

    Google Scholar 

  18. Bickmore, T.W., Cassell, J.: Relational agents: A model and implementation of building user trust. In: Proceedings of SIGCHI (2001), pp. 396–403 (2001)

    Google Scholar 

  19. Bickmore, T.W., Cassell, J.: Social dialogue with embodied conversational agents. In: van Kuppevelt, J., Dybkjaer, L., Bernsen, N. (eds.) Advances in Natural, Multimodal Dialogue Systems, pp. 256–284. Kluwer Academic, Dordrecht (2005)

    Google Scholar 

  20. Kshirsagar, S., Magnenat-Thalmann, N.: A multilayer personality model. In: ACM International Conference Proceeding Series, vol. 24, pp. 107–115 (2002)

    Google Scholar 

  21. Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: Generic personality and emotion simulation for conversational agents. Computer Animation and Virtual Worlds 15(1), 1–13 (2004)

    Article  Google Scholar 

  22. Gebhard, P.: Alma - a layered model of affect. In: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multi Agent Systems, pp. 29–36 (2005)

    Google Scholar 

  23. Becker, C., Kopp, S., Wachsmuth, I.: Simulating the emotion dynamics of a multimodal conversational agent. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS 2004. LNCS (LNAI), vol. 3068, pp. 154–165. Springer, Heidelberg (2004)

    Google Scholar 

  24. Breazeal, C.: Emotion and sociable humanoid robots. International Journal of Human-Computer Studies 59, 119–155 (2002)

    Article  Google Scholar 

  25. Leite, I., Pereira, A.: Icat, the affective chess player. In: Petta, P., Martinho, C. (eds.) Proceedings of the systems demonstrations. Second international conference on Affective Computing and Intelligent Interaction (ACII 2007), pp. 29–33 (2007)

    Google Scholar 

  26. Predinger, H., Ishizuka, M.: Evolving social relationships with animate characters. In: Proceedings of the Symposium of the AISM Convention and Animationg Expressive Characters for Social Interactions, pp. 73–78 (2002)

    Google Scholar 

  27. Romano, D., Sheppard, G., Hall, J., Miller, A., Ma, Z.: Basic: A believable, adaptable socially intelligent character for social presence. In: PRESENCE 2005, The 8th Annual International Workshop on Presence, London, UK (2005)

    Google Scholar 

  28. Gockley, R., Simmons, R., Forlizzi, J.: Modeling affect in socially interactive robots. In: The 15th IEEE International Symposium on Robot and Human Interactive Communication, ROMAN 2006 (2006)

    Google Scholar 

  29. Tulving, E.: Elements of Episodic Memory. Claredon Press, Oxford (1983)

    Google Scholar 

  30. Nuxoll, A.: Enhancing Intelligent Agents with Episodic Memory. PhD thesis, The University of Michigan (2007)

    Google Scholar 

  31. Schank, R.: Dynamic Memory. A Theory of Reminding and Learning in Computers and People. Cambridge University Press, Cambridge (1982)

    Google Scholar 

  32. Kolodner, J.: Case-based reasoning. Morgan Kaufmann, San Mateo (1993)

    Google Scholar 

  33. Laird, J.: Episodic memory vs. case-based reasoning. In: Invited talk at the Sixth International Conference on Case-Based Reasoning, ICCBR (2005)

    Google Scholar 

  34. Tecuci, D.: A Generic Memory Module for Events, Phd Dissertation. Computer Sciences Department, The University of Texas at Austin (August 2007)

    Google Scholar 

  35. Vere, S., Bickmore, T.: A basic agent. Computational Intelligence 4, 41–60 (1990)

    Article  Google Scholar 

  36. Rickel, J., Johnson, W.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13(4-5), 343–382 (1999)

    Article  Google Scholar 

  37. Ho, W.C., Dautenhahn, K.: Towards a narrative mind: Creating coherent life stories for believable agents. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 59–72. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  38. Brom, C., Pesková, K., Lukavský, J.: What does your actor remember? towards characters with a full episodic memory. In: International Conference on Virtual Storytelling, pp. 89–101 (2007)

    Google Scholar 

  39. Dodd, W., Gutierrez, R.: The role of episodic memory and emotion in a cognitive robot. In: IEEE International Workshop on Robot and Human Interactive Communication, Roman, pp. 692–697 (2005)

    Google Scholar 

  40. Jockel, S., Westhoff, D., Zhang, J.: Epirome - a novel framework to investigate high-level episodic robot memory. In: IEEE International Conference on Robotics and Biomimetics, pp. 1075–1080 (2007)

    Google Scholar 

  41. Mirza, N., Nehaniv, C., Dautenhahn, K., te Boekhorst, R.: Developing social action capabilities in a humanoid robot using an interaction history architecture. In: 8th IEEE-RAS International Conference on Humanoid Robots, pp. 609–616 (2008)

    Google Scholar 

  42. Endo, Y.: Anticipatory robot control for a partially observable environment using episodic memories. In: ICRA 2008, pp. 2852–2859 (2008)

    Google Scholar 

  43. Kasap, Z., Ben Moussa, M., Chaudhuri, P., Magnenat-Thalmann, N.: Making them rememberemotional virtual characters with memory. IEEE Computer Graphics and Applications 29(2), 20–29 (2009)

    Article  Google Scholar 

  44. Hanson, D., Olney, A., Zielke, M., Pereira, A.: Upending the uncanny valley. In: Proceedings of National Conference on Artificial Intelligence, AAAI 2005 (2005)

    Google Scholar 

  45. Tulving, E.: Episodic memory: from mind to brain. Annual Rev. Psychol. 53, 1–25 (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. MIRALab, University of Geneva, Switzerland

    Zerrin Kasap & Nadia Magnenat-Thalmann

  2. Nanyang Technological University, Singapore

    Nadia Magnenat-Thalmann

Authors
  1. Zerrin Kasap
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nadia Magnenat-Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Dept. of Intelligence Science and Technology, Graduate School of Informatics, Kyoto University , Yoshida-Honmachi, Sakyo-ku, 606-8501, Kyoto, Japan

    Toyoaki Nishida

  2. SCT-Building, University of South Australia , Mawson Lakes Campus, Adelaide, South Australia, Australia

    Lakhmi C. Jain

  3. Universitè Paul Cézanne Polytech’ Marseille , Avenue Escadrille Normandie-Niemen, 13397, Marseille Cedex 20, France

    Colette Faucher

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer Berlin Heidelberg

About this chapter

Cite this chapter

Kasap, Z., Magnenat-Thalmann, N. (2010). Interacting with Emotion and Memory Enabled Virtual Characters and Social Robots. In: Nishida, T., Jain, L.C., Faucher, C. (eds) Modeling Machine Emotions for Realizing Intelligence. Smart Innovation, Systems and Technologies, vol 1. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12604-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12604-8_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12603-1

  • Online ISBN: 978-3-642-12604-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation