Skip to main content

Hand Gestures and Verbal Acknowledgments Improve Human-Robot Rapport

  • Conference paper
  • First Online:
Social Robotics (ICSR 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10652))

Included in the following conference series:

Abstract

Enhancing the rapport between the human and the robot will be an essential element in successfully developing robotic assistants, especially ones working in our homes. We use a personality survey task to assess how humans initially perceive rapport between themselves and a robot. Robots administering the survey presented relational behaviors designed to improve human-robot rapport. Participants preferred it when the robot provided verbal acknowledgments or was more engaging, such as when the robot supplemented its speech with iconic gestures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Berry, D.S., Pennebaker, J.W., Mueller, J.S., Hiller, W.S.: Linguistic bases of social perception. Pers. Soc. Psychol. Bull. 23(5), 526–537 (1997)

    Article  Google Scholar 

  2. Bickmore, T.W., Picard, R.W.: Establishing and maintaining long-term human-computer relationships. ACM Trans. Comput.-Hum. Interact. 12(2), 293–327 (2005)

    Article  Google Scholar 

  3. Briggs, P., Scheutz, M., Tickle-degnen, L.: Are robots ready for administering health status surveys? first results from an HRI study with subjects with Parkinson’s Disease. In: 10th ACM/IEEE International Conference on Human-Robot Interaction, pp. 327–334. ACM, Portland (2015)

    Google Scholar 

  4. Bronstein, I., Nelson, N., Livnat, Z., Ben-Ari, R.: Rapport in negotiation: the contribution of the verbal channel. J. Confl. Resolut. 56(6), 1089–1115 (2012)

    Article  Google Scholar 

  5. Burns, M.: Rapport and relationships: the basis of child care. J. Child Care (1984)

    Google Scholar 

  6. Cordella, M., Kokubu, C.: Creating, Maintaining and challenging rapport across languages and age groups. In: Cordella, M., Huang, H. (eds.) Rethinking Second Language Learning: Using Intergenerational Community Resources, chap. 7, pp. 110–148. Multilingual Matters (2016)

    Google Scholar 

  7. Drolet, A.L., Morris, M.W.: Rapport in conflict resolution: accounting for how face-to-face contact fosters mutual cooperation in mixed-motive conflicts. J. Exp. Soc. Psychol. 36(1), 26–50 (2000)

    Article  Google Scholar 

  8. Duggan, P., Parrott, L.: Physicians’ nonverbal rapport building and patients’ talk about the subjective component of illness. Hum. Comm. Res. 27(2), 299–311 (2001)

    Google Scholar 

  9. Gadde, P., Kharrazi, H., Patel, H., MacDorman, K.F.: Toward monitoring and increasing exercise adherence in older adults by robotic intervention: a proof of concept study. J. Robot. 2011, 1–11 (2011)

    Article  Google Scholar 

  10. Grahe, J.E., Bernieri, F.J.: The importance of nonverbal cues in judging rapport. J. Nonverbal Behav. 23(4), 253–269 (1999)

    Article  Google Scholar 

  11. Gratch, J., Wang, N., Gerten, J., Fast, E., Duffy, R.: Creating rapport with virtual agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS, vol. 4722, pp. 125–138. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74997-4_12

    Chapter  Google Scholar 

  12. Harrigan, J.A., Oxman, T.E., Rosenthal, R.: Rapport expressed through nonverbal behavior. J. Nonverbal Behav. 9(2), 95–110 (1985)

    Article  Google Scholar 

  13. Haskard, K.B., Williams, S.L., DiMatteo, M.R., Heritage, J., Rosenthal, R.: The providers voice: patient satisfaction and the content-filtered speech of nurses and physicians in primary medical care. J. Nonverbal Behav. 32(1), 1–20 (2008)

    Article  Google Scholar 

  14. Jefferson, G.: Notes on a systematic deployment of the acknowledgement tokens yeah; and mm hm (1984)

    Google Scholar 

  15. Kanda, T., Ishiguro, H., Ishida, T.: Psychological analysis on human-robot interaction. In: Proceedings of the 2001 ICRA IEEE International Conference on Robotics and Automation, vol. 4, pp. 4166–4173. IEEE (2001)

    Google Scholar 

  16. Kang, S.H., Gratch, J.: Socially anxious people reveal more personal information with virtual counselors that talk about themselves using intimate human back stories. Ann. Rev. Cyberther. Telemed. 181, 202–207 (2012)

    Google Scholar 

  17. Kang, S.H., Watt, J.H., Ala, S.K.: Social copresence in anonymous social interactions using a mobile video telephone. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1544. ACM (2008)

    Google Scholar 

  18. Kleinke, C.L.: Gaze and eye contact: a research review. Psychol. Bull. 100(1), 78 (1986)

    Article  Google Scholar 

  19. Lambertz, K.: Back-channelling: the use of yeah and mm to portray engaged listenership. Griffiths Working Papers Pragmat. Intercult. Commun. 4(1/2), 11–18 (2011)

    Google Scholar 

  20. McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)

    Google Scholar 

  21. Myers, I.B., McCaulley, M.H., Most, R.: Manual: A Guide to the Development and use of the Myers-Briggs Type Indicator, vol. 1985. Consulting Psychologists Press, Palo Alto (1985)

    Google Scholar 

  22. Nowak, K.L., Biocca, F.: The effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments. Presence: Teleoper. Virtual Environ. 12(5), 481–494 (2003)

    Article  Google Scholar 

  23. Pollack, M., Brown, L., Colbry, D.: Pearl: a mobile robotic assistant for the elderly. In: AAAI Workshop on Automation as Eldercare, pp. 85–91 (2002)

    Google Scholar 

  24. von der Pütten, A.M., Krämer, N.C., Gratch, J., Kang, S.H.: “It doesn’t matter what you are!” explaining social effects of agents and avatars. Comput. Hum. Behav. 26(6), 1641–1650 (2010)

    Article  Google Scholar 

  25. Riek, L.D., Paul, P.C., Robinson, P.: When my robot smiles at me: enabling human-robot rapport via real-time head gesture mimicry. J. Multimodal User Interf. 3, 99–108 (2010)

    Article  Google Scholar 

  26. Sharpley, C.F., Sagris, A.: When does counsellor forward lean influence client-perceived rapport? Br. J. Guid. Counsell. 23(3), 387–394 (1995)

    Article  Google Scholar 

  27. Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artif. Intell. 166(1–2), 140–164 (2005)

    Article  Google Scholar 

  28. Tickle-Degnen, L.: Therapeutic Rapport. In: Radomski, M.V., Latham, C.A.T. (eds.) Occupational Therapy for Physical Dysfunction, 6th edn., chap. 15, pp. 402–419. Lippincott Williams & Wilkins (2008)

    Google Scholar 

  29. Tickle-Degnen, L., Rosenthal, R.: The nature of rapport and its nonverbal correlates. Psychol. Inq. 1(4), 285–293 (1990)

    Article  Google Scholar 

  30. Tsui, P., Schultz, G.L.: Failure of rapport: why psychotherapeutic engagement fails in the treatment of asian clients. Am. J. Orthopsychiatry 55(4), 561 (1985)

    Article  Google Scholar 

  31. Wang, N., Gratch, J.: Can virtual human build rapport and promote learning. In: 14th International Conference on Artificial Intelligence in Education, pp. 737–739 (2009)

    Google Scholar 

  32. Wilson, J.R., Tickle-Degnen, L., Scheutz, M.: Designing a social robot to assist in medication sorting. In: Agah, A., Cabibihan, J.-J., Howard, A.M., Salichs, M.A., He, H. (eds.) ICSR 2016. LNCS, vol. 9979, pp. 211–221. Springer, Cham (2016). doi:10.1007/978-3-319-47437-3_21

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jason R. Wilson .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Wilson, J.R., Lee, N.Y., Saechao, A., Hershenson, S., Scheutz, M., Tickle-Degnen, L. (2017). Hand Gestures and Verbal Acknowledgments Improve Human-Robot Rapport. In: Kheddar, A., et al. Social Robotics. ICSR 2017. Lecture Notes in Computer Science(), vol 10652. Springer, Cham. https://doi.org/10.1007/978-3-319-70022-9_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70022-9_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70021-2

  • Online ISBN: 978-3-319-70022-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics