Abstract
Designing for rapport with virtual agents is one of the key success factors for delivering engaging and motivating virtual experiences. This paper presents the results of the study on rapport with virtual agent “Anna” who acts as a personal virtual trainer in a gamified, simulated mixed reality (MR) environment for physical training of senior trainees with hypertension. The exploratory study with 22 senior participants over 65 years old applied an adapted rapport scale to measure cognitive, affective and interactional rapport. Results from the survey and interviews show that imitating movements of the virtual trainer received highest values and that agent generated behaviour was essential for establishing rapport. The paper explores the relationships between the rapport scores and the perception of senior users of a range of characteristics of the virtual agent such as body, head, hand and facial and verbal expression.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nijholt, A.: Embodied Agents: A New Impetus to Humor Research. In: Stock, O., Strapparava, C. (eds.) TWLT20: The April Fools' Day workshop on computation humor: Proceedings of the twentieth Twente Workshop on Language Technology, Trento, Italy (2002)
Reidsma, D., Dehling, E., van Welbergen, H., Zwiers, J., Nijholt, A.: Leading and following with a virtual trainer. In: England, D., El Rhalibi, A., Cheok, A. D. (eds.), Proceedings of the 4th Int. Workshop on Whole Body Interaction in Games and Entertainment, n. pag. University of Liverpool (2011)
van Wissen, A., Vinkers, C., van Halteren, A.: Developing a virtual coach for chronic patients: a user study on the impact of similarity, familiarity and realism. In: Meschtscherjakov, A., De Ruyter, B., Fuchsberger, V., Murer, M., Tscheligi, M. (eds.) PERSUASIVE 2016. LNCS, vol. 9638, pp. 263–275. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-31510-2_23
Gardiner P.M., et al.: Engaging women with an embodied conversational agent to deliver mindfulness and lifestyle recommendations: A feasibility randomized control trial. Patient Education and Counselling, vol. 100(9), pp. 1720–1729. Elsevier (2017)
Kouris, I., Sarafidis, M., Androutsou, T., Koutsouris, D.: HOLOBALANCE: An Augmented Reality virtual trainer solution for balance training and fall prevention. In: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4233--4236. IEEE EMBC (2018)
Pelachaud, C., Poggi. I.: Subtleties of facial expressions in embodied agents. In: The Journal of Visualization and Computer Animation, vol. 13, pp. 301–312. Wiley (2002)
Buisine, S., Abrilian, S., Martin, J.-C.: Evaluation of multimodal behaviour of embodied agents. In: Ruttkay, Z., Pelachaud, C. (eds.) From Brows to Trust. HIS, vol. 7, pp. 217–238. Springer, Dordrecht (2004). https://doi.org/10.1007/1-4020-2730-3_8
Traum, D., Rickel, J.: Embodied agents for multi-party dialogue in immersive virtual worlds. In: Proceedings of the first International Joint Conference on Autonomous Agents and Multiagent Systems: Part 2 (AAMAS 2002), pp. 766–773. Association for Computing Machinery, New York (2002)
Van Vugt, H.C., Bailenson, J.N. Hoorn, J.F., Konijn, E.A.: Effects of facial similarity on user responses to embodied agents. In: ACM Transactions on Computer-Human Interaction, vol. 17, p. 7:1–7:27. TOCHI (2008)
Rickel, J., Johnson, W.: Task-oriented collaboration with embodied agents in virtual worlds. In: Cassell, J., Sullivan, J., Prevost, S. (eds.) Embodied Conversational Agents, pp. 95--122 MIT Press, Cambridge (2001)
Thiebaux, M., Marsella, S., Marshall, A.N., Kallmann, M.: SmartBody: behavior realization for embodied conversational agents. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 151--158. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2008)
Guadagno, R.E., Swinth, K.R., Blascovich, J.: Social evaluations of embodied agents and avatars. Comput. Hum. Behav. 27, 2380–2385 (2011)
Stal, S.T., Kramer, L.L., Tabak, M., op den Akker, H., Hermens, H.: Design features of embodied conversational agents in ehealth: a literature review. Int. J. Hum.-Comput. Stud. 138, 102409 (2020)
Guo, Y. R., Goh. D.: Evaluation of affective embodied agents in an information literacy game. Comput. Educ. 103, 59–75 (2016)
Mimoun, M.S.B., Poncin, I., Garnier, M.: Case study—embodied virtual agents: an analysis on reasons for failure. J. Retail. Consum. Serv. 19, 605–612 (2012)
Tickle-Degnen, L., Rosenthal, R.: The nature of rapport and its nonverbal correlates. Psychol. Inq. 1, 285–293 (1990)
Ghosh, P., Satyawadi, R., Prasad Joshi, J., Ranjan, R., Singh, P.: Towards more effective training programmes: a study of trainer attributes. In: Industrial and Commercial Training, vol. 44, pp. 194–202 (2012)
Gratch, J., et al.: Virtual rapport. In: Gratch, J. Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) Intelligent Virtual Agents, pp. 14–27. Marina Del Rey, CA (2006)
Gratch, J., Wang, N., Gerten, J., Fast, E., Duffy, R.: Creating rapport with virtual agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 125–138. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74997-4_12
Wang, N., Gratch, J.: Can virtual human build rapport and promote learning? In: Proceedings of the 2009 Conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling, NLD, pp. 737–739. Brighton, UK (2021)
Tinetti, M.E., Williams, T.F., Mayewski, R.: Fall risk index for elderly patients based on number of chronic disabilities. Am. J. Med. 80(3), 429–434 (1986)
Brandt, J., Spencer, M., Folstein, M.: The telephone interview for cognitive status. Cogn. Behav. Neurol. 1(2), 111–118 (1988)
Cerekovic, A., Aran, O., Gatica-Perez, D.: How do you like your virtual agent?: human-agent interaction experience through nonverbal features and personality traits. In: Park, H.S., Salah, A.A., Lee, Y.J., Morency, L.-P., Sheikh, Y., Cucchiara, R. (eds.) HBU 2014. LNCS, vol. 8749, pp. 1–15. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11839-0_1
Huang, L., Morency, L.-P., Gratch, J.: Virtual rapport 2.0. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS (LNAI), vol. 6895, pp. 68–79. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23974-8_8
Nijholt, A., Reidsma, D., van Welbergen, H.: Establishing rapport with a virtual dancer. In: Sheridan, J.G., Bayliss, A. (eds.) Proceedings (re)Actor. The First International Conference on Digital Live Art. University of Leeds (2006)
Hsieh, H., Shannon, S.: Three approaches to qualitative content analysis. Qual. Health Res. 15, 1277–1288 (2005)
Acknowledgments
This publication was produced as part of the bewARe project with the name: Sensor-supported movement training for senior citizens in an intelligent Augmented Reality System. The bewARe project is a three-year (08/2018 - 08/2021) R&D project founded by the German Federal Ministry of Education and Research (BMBF). Project website: https://www.beware-projekt.de/en/index.html.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Buchem, I., Vorwerg, S., Stamm, O., Kruschel, K. (2021). Designing for Rapport with Virtual Agents in a Simulated Mixed Reality Environment: Results from a Pilot Study with Senior Users in the bewARe Project. In: Ahram, T.Z., Falcão, C.S. (eds) Advances in Usability, User Experience, Wearable and Assistive Technology. AHFE 2021. Lecture Notes in Networks and Systems, vol 275. Springer, Cham. https://doi.org/10.1007/978-3-030-80091-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-80091-8_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-80090-1
Online ISBN: 978-3-030-80091-8
eBook Packages: EngineeringEngineering (R0)