Abstract
Empathy can be broadly defined as the ability to understand and respond appropriately to the affective states of others. In this paper, we present a scenario where a social robot acts as a chess companion for children, and describe our current efforts towards endowing such robot with empathic capabilities. A multimodal framework for modeling some of the user’s affective states that combines visual and task-related features is presented. Using this model of the user, we personalise the learning environment by adapting the robot’s empathic responses to the particular preferences of the child who is interacting with the robot. We also describe a preliminary study conducted in this scenario.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aghaei Pour, P., Hussain, M.S., AlZoubi, O., D’Mello, S., Calvo, R.A.: The Impact of System Feedback on Learners’ Affective and Physiological States. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6094, pp. 264–273. Springer, Heidelberg (2010)
Anderson, C., Keltner, D.: The role of empathy in the formation and maintenance of social bonds. Behavioral and Brain Sciences 25(01), 21–22 (2002)
Arroyo, I., Ferguson, K., Johns, J., Dragon, T., Meheranian, H., Fisher, D., Barto, A., Mahadevan, S., Woolf, B.P.: Repairing disengagement with non-invasive interventions. In: Proc. of AIED 2007, pp. 195–202. IOS Press, Amsterdam (2007)
Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite-time analysis of the multiarmed bandit problem. Machine Learning 47(2), 235–256 (2002)
Batson, C.D., Early, S., Salvarani, G.: Perspective taking: Imagining how another feels versus imaging how you would feel. Personality and Social Psychology Bulletin 23(7), 751 (1997)
Bickmore, T., Schulman, D., Yin, L.: Maintaining engagement in long-term interventions with relational agents. Applied Artificial Intelligence 24(6), 648–666 (2010)
Castellano, G., Leite, I., Pereira, A., Martinho, C., Paiva, A., McOwan, P.W.: It’s all in the game: Towards an affect sensitive and context aware game companion. In: Proceedings of ACII 2009, pp. 29–36. IEEE (2009)
Castellano, G., Leite, I., Pereira, A., Martinho, C., Paiva, A., McOwan, P.W.: Affect recognition for interactive companions: Challenges and design in real-world scenarios. Journal on Multimodal User Interfaces 3(1-2), 89–98 (2010)
Castellano, G., Pereira, A., Leite, I., Paiva, A., McOwan, P.W.: Detecting user engagement with a robot companion using task and social interaction-based features. In: Proceedings of ICMI 2009, pp. 119–126. ACM Press (2009)
Conati, C., Maclaren, H.: Empirically building and evaluating a probabilistic model of user affect. User Modeling and User-Adapted Interaction 19(3), 267–303 (2009)
Cooper, B., Brna, P., Martins, A.: Effective Affective in Intelligent Systems: Building on Evidence of Empathy in Teaching and Learning. In: Paiva, A.M. (ed.) IWAI 1999. LNCS, vol. 1814, pp. 21–34. Springer, Heidelberg (2000)
Craig, S., Graesser, A., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. Learning, Media and Technology 29(3), 241–250 (2004)
Csikszentmihalyi, M.: Flow: The psychology of optimal experience. Harper Perennial, New York (1991)
Deutsch, F., Madle, R.A.: Empathy: Historic and current conceptualizations, measurement, and a cognitive theoretical perspective. Human Development 18(4), 267–287 (1975)
D’Mello, S., Craig, S., Fike, K., Graesser, A.: Responding to learners’ cognitive-affective states with supportive and shakeup dialogues. In: Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction, pp, 595–604 (2009)
D’Mello, S., Picard, R.W., Graesser, A.: Toward an affect-sensitive autotutor. IEEE Intelligent Systems, 53–61 (2007)
Domagk, S.: Do pedagogical agents facilitate learner motivation and learning outcomes?: The role of the appeal of agent’s appearance and voice. Journal of Media Psychology 22(2), 84–97 (2010)
Efklides, A., Petkaki, C.: Effects of mood on students’ metacognitive experiences. Learning and Instruction 15(5), 415–431 (2005)
Hoffman, M.L.: Empathy and moral development: Implications for caring and justice. Cambridge Univ. Press (2001)
Horgan, D.D., Morgan, D.: Chess expertise in children. Applied Cognitive Psychology 4(2), 109–128 (1990)
Isen, A.M., Reeve, J.: The influence of positive affect on intrinsic and extrinsic motivation: Facilitating enjoyment of play, responsible work behavior, and self-control. Motivation and Emotion 29(4), 295–323 (2005)
Kapoor, A., Burleson, W., Picard, R.W.: Automatic prediction of frustration. International Journal of Human-Computer Studies 65(8), 724–736 (2007)
Kapoor, A., Picard, R.W.: Multimodal affect recognition in learning environments. In: ACM International Conference on Multimedia, pp. 677–682 (2005)
Keltner, D., Ellsworth, P.C., Edwards, K.: Beyond simple pessimism: Effects of sadness and anger on social perception. Journal of Personality and Social Psychology 64, 740–740 (1993)
Leite, I., Martinho, C., Pereira, A., Paiva, A.: iCat: an affective game buddy based on anticipatory mechanisms. In: Proceedings of AAMAS 2008, pp. 1229–1232. IFAAMAS (2008)
Leite, I., Martinho, C., Pereira, A., Paiva, A.: As Time goes by: Long-term evaluation of social presence in robotic companions. In: Proceedings of RO-MAN 2009, pp. 669–674. IEEE (2009)
Leite, I., Mascarenhas, S., Pereira, A., Martinho, C., Prada, R., Paiva, A.: ”Why Can’t We Be Friends?” An Empathic Game Companion for Long-Term Interaction. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 315–321. Springer, Heidelberg (2010)
Lester, J.C., Converse, S.A., Kahler, S.E., Barlow, S.T., Stone, B.A., Bhogal, R.S.: The persona effect: affective impact of animated pedagogical agents. In: Proceedings of CHI 1997, pp. 359–366. ACM, NY (1997)
Nakano, Y.I., Ishii, R.: Estimating user’s engagement from eye-gaze behaviors in human-agent conversations. In: Proceeding of IUI 2010, pp. 139–148. ACM, New York (2010)
Robison, J., McQuiggan, S., Lester, J.: Evaluating the consequences of affective feedback in intelligent tutoring systems. In: Proceedings of ACII 2009. IEEE (2009)
Russell, J.A.: A circumplex model of affect. Journal of Personality and Social Psychology 39, 1161–1178 (1980)
Saerbeck, M., Schut, T., Bartneck, C., Janse, M.: Expressive robots in education: varying the degree of social supportive behavior of a robotic tutor. In: Proceedings of CHI 2010, pp. 1613–1622. ACM (2010)
Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P.W., Paiva, A.: Automatic analysis of affective postures and body motion to detect engagement with a game companion. In: ACM/IEEE International Conference on Human-Robot Interaction, Lausanne, Switzerland (2011)
Sidner, C.L., Kidd, C.D., Lee, C., Lesh, N.: Where to look: a study of human-robot engagement. In: Proc. of IUI 2004, pp. 78–84. ACM (2004)
Tiberius, R.G.: The why of teacher/student relationships. Essays on Teaching Excellence 31 (2003)
van Breemen, A., Yan, X., Meerbeek, B.: iCat: an animated user-interface robot with personality. In: Proc. of AAMAS 2005, pp. 143–144. ACM (2005)
Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., Picard, R.: Affect-aware tutors: recognising and responding to student affect. International Journal of Learning Technology 4(3), 129–164 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Leite, I., Pereira, A., Castellano, G., Mascarenhas, S., Martinho, C., Paiva, A. (2012). Modelling Empathy in Social Robotic Companions. In: Ardissono, L., Kuflik, T. (eds) Advances in User Modeling. UMAP 2011. Lecture Notes in Computer Science, vol 7138. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28509-7_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-28509-7_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28508-0
Online ISBN: 978-3-642-28509-7
eBook Packages: Computer ScienceComputer Science (R0)