Abstract
Effective face-to-face conversations are highly interactive. Participants respond to each other, engaging in nonconscious behavioral mimicry and backchanneling feedback. Such behaviors produce a subjective sense of rapport and are correlated with effective communication, greater liking and trust, and greater influence between participants. Creating rapport requires a tight sense-act loop that has been traditionally lacking in embodied conversational agents. Here we describe a system, based on psycholinguistic theory, designed to create a sense of rapport between a human speaker and virtual human listener. We provide empirical evidence that it increases speaker fluency and engagement.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Alibali, M.W., Heath, D.C., et al.: Effects of visibility between speaker and listener on gesture production: some gestures are meant to be seen. Journal of Memory and Language 44, 169–188 (2001)
Bailenson, J., Beall, A., et al.: Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments. PRESENCE: Teleoperators and Virtual Environments 13(4), 428–441 (2004)
Bailenson, J.N., Yee, N.: Digital Chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science 16, 814–819 (2005)
Bavelas, J.B., Coates, L., et al.: Listeners as Co-narrators. Journal of Personality and Social Psychology 79(6), 941–952 (2000)
Cassell, J., Bickmore, T., et al.: Embodiment in Conversational Interfaces: Rea. In: Conference on Human Factors in Computing Systems, Pittsburgh, PA (1999)
Cassell, J., Thórisson, K.R.: The Power of a Nod and a Glance: Envelope vs. Emotional Feedback in Animated Conversational Agents. International Journal of Applied Artificial Intelligence 13(4-5), 519–538 (1999)
Chartrand, T.L., Bargh, J.A.: The Chameleon Effect: The Perception-Behavior Link and Social Interaction. Journal of Personality and Social Psychology 76(6), 893–910 (1999)
Chiu, C., Hong, Y., et al.: Gaze direction and fluency in conversational speech (unpublished) (manuscript, 1995)
Heylen, D.: Challenges Ahead. Head Movements and other social acts in conversation. AISB, Hertfordshire (2005)
Kallmann, M., Marsella, S.: Hierarchical Motion Controllers for Real-Time Autonomous Virtual Humans. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 253–265. Springer, Heidelberg (2005)
Kopp, S., Krenn, B., et al.: Towards a common framework for multimodal generation in ECAs: The behavior markup language, Intelligent Virtual Agents, Marina del Rey, CA (2006)
Krauss, R.M., Garlock, C.M., et al.: The Role of Audible and Visible Back-Channel Responses in Interpersonal Communication. Journal of Personality and Social Psychology 35, 523–529 (1977)
Kraut, R.K., Lewis, S.H., et al.: Listener Responsiveness and the Coordination of Conversation. Journal of Personality and Social Psychology, 718–731 (1982)
Lamothe, F., Morales, M.: Response Behavior. Marina del Rey, CA, University of Southern California: Technical Report ICT TR 01.2006 (2006)
Maatman, M., Gratch, J., et al.: Natural Behavior of a Listening Agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 25–36. Springer, Heidelberg (2005)
McNeill, D.: Hand and mind: What gestures reveal about thought. The University of Chicago Press, Chicago (1992)
Morency, L.-P., Sidner, C., et al.: Contextual Recognition of Head Gestures. In: 7th International Conference on Multimodal Interactions, Torento, Italy (2005)
Nakano, Y., Reinstein, G., et al.: Towards a Model of Face-to-Face Grounding. Meeting of the Association for Computational Linguistics, Sapporo, Japan (2003)
Nass, C., Reeves, B.: The Media Equation. Cambridge University Press, Cambridge (1996)
Oppenheim, A.V., Schafer, R.W.: From Frequency to Quefrency: A History of the Cepstrum. IEEE Signal Processing Magazine, 95–106 (September 2004)
Pertaub, D.-P., Slater, M., et al.: An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience. Presence: Teleoperators and Virtual Environments 11(1), 68–78 (2001)
Rickenberg, R., Reeves, B.: The effects of animated characters on anxiety, task performance, and evaluations of user interfaces. In: SIGCHI conference on Human factors in computing systems, The Hague, The Netherlands (2000)
Smith, J.: GrandChair: Conversational Collection of Family Stories. MIT Press, Cambridge (2000)
Tatar, D.: Social and personal consequences of a preoccupied listener, Department of Psychology. Stanford University, Stanford (unpublished) (doctoral dissertation) (1997)
Tosa, N.: Neurobaby. ACM SIGGRAPH, 212–213 (1993)
van der Werf, R.: Creating Rapport with Virtual Humans. Marina del Rey, CA, University of Southern California: Technical Report ICT TR 02.2006 (2006)
Ward, N., Tsukahara, W.: Prosodic features which cue back-channel responses in English and Japanese. Journal of Pragmatics 23, 1177–1207 (2000)
Welji, H., Duncan, S.: Characteristics of face-to-face interactions, with and without rapport: Friends vs. strangers. In: Symposium on Cognitive Processing Effects of Social Resonance in Interaction, 26th Annual Meeting of the Cognitive Science Societ (2004)
Yngve, V.H.: On getting a word in edgewise. Sixth regional Meeting of the Chicago Linguistic Society (1970)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gratch, J. et al. (2006). Virtual Rapport. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds) Intelligent Virtual Agents. IVA 2006. Lecture Notes in Computer Science(), vol 4133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11821830_2
Download citation
DOI: https://doi.org/10.1007/11821830_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37593-7
Online ISBN: 978-3-540-37594-4
eBook Packages: Computer ScienceComputer Science (R0)