Skip to main content

The Role of Gesture in Social Telepresence Robots—A Scenario of Distant Collaborative Problem-Solving

  • Chapter
  • First Online:
Social Robots: Technological, Societal and Ethical Aspects of Human-Robot Interaction

Abstract

Human–robot interaction is a well-studied research field today; robots vary from tele-operators and avatars to robots with social characteristics. In this review paper, first we present related work on tele-operation, mobile robotic telepresence, and social robots. Then, we focus on the role of gestures and body language in robotics, and more precisely their importance for communication in collaborative settings. In our collaborative setting scenario, we have a group of multiple human users working on collaborative problem-solving around a tangible user interface (TUI). A TUI employs physical artifacts both as “representations” and “controls” for computational media. We have the same situation in a separate spatial location. We extend this specific scenario by having an avatar robot in each one of the two locations which represents remote team members and mirrors their actions, gaze, and gestures. Our goal in this paper is to give an overview of current solutions that provide a sense of being in a different place and to describe our future scenario of having an avatar robot solving a problem on a TUI collaboratively with human users. We present a discussion about technical and social questions related to the acceptance of avatar robots at work considering which properties they should have, to what extent the current state of the art in social robotics is applicable, and which additional technical components need to be developed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Adalgeirsson, S. O., & Breazeal, C. (2010). MeBot: A robotic platform for socially embodied presence. In Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction (pp. 15–22).

    Google Scholar 

  • Anastasiou, D., Ras, E. & Fal, M. (2019). Assessment of collaboration and feedback on gesture performance. In Proceedings of the Technology-Enhanced Assessment (TEA) Conference. Berlin: Springer (to be published).

    Google Scholar 

  • Anastasiou, D. & Stahl, C. (2012). Gestures used by intelligent wheelchair users. In Proceedings of the International Conference on Computers Helping People with Special Needs (ICCHP-12) (pp. 392–398). Berlin: Springer.

    Google Scholar 

  • Baker, K., Greenberg, S., & Gutwin, C. (2001). Heuristic evaluation of groupware based on the mechanics of collaboration. In Engineering for human-computer interaction (pp. 123–139). Berlin: Springer.

    Google Scholar 

  • Bartneck, C., & Forlizzi, J. (2004). A design-centred framework for social human-robot interaction. In IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2004) (pp. 591–594).

    Google Scholar 

  • Bekker, M. M., Olson, J. S., & Olson, G. M. (1995). Analysis of gestures in face-to-face design teams provides guidance for how to use groupware in design. In Proceedings of the 1st Conference on Designing Interactive Systems: Processes, Practices, Methods, & Techniques (pp. 157–166).

    Google Scholar 

  • Björnfot, P., & Kaptelinin, V. (2017). Probing the design space of a telepresence robot gesture arm with low fidelity prototypes. In 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 352–360).

    Google Scholar 

  • Breazeal, C. (2000). Sociable machines: Expressive social exchange between humans and robots, Ph.D. Thesis. Cambridge, MA: Department of Electrical Engineering and Computer Science, MIT.

    Google Scholar 

  • Breazeal, C., & Scassellati, B. (2000). Robots that imitate humans. Trends in Cognitive Sciences, 6(11), 481–487.

    Article  Google Scholar 

  • Cha, E., Chen, S., & Mataric, M. J. (2017). Designing telepresence robots for K-12 education. In IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2017) (pp. 683–688).

    Google Scholar 

  • Dautenhahn, K. (2007). Socially intelligent robots: Dimensions of human–robot interaction. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 362(1480), 679–704.

    Article  Google Scholar 

  • Dautenhahn, K., & Billard, A. (1999). Bringing up robots or-the psychology of socially intelligent robots: From theory to implementation. In Proceedings of the Third Annual Conference on Autonomous Agents (pp. 366–367).

    Google Scholar 

  • Double Robotics. https://www.doublerobotics.com/. Retrieved February 14, 2018.

  • Edwards, L. D. (1991). The design and analysis of a mathematical microworld. Journal of Educational Computing Research, 12(1), 77–94.

    Article  Google Scholar 

  • Eyssel, F., & Kuchenbrandt, D. (2012). Social categorization of social robots: Anthropomorphism as a function of robot group membership. British Journal of Social Psychology, 51(4), 724–731.

    Article  Google Scholar 

  • Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003). A survey of socially interactive robots. Robotics and Autonomous Systems, 42(3–4), 143–166.

    Article  Google Scholar 

  • Fukushima, S., Sekiguchi, H., Saito, Y., Iida, W., Nozaki, T., & Ohnishi, K. (2017). Artificial replacement of human sensation using haptic transplant technology. IEEE Transactions on Industrial Electronics, 65(5), 3985–3994.

    Article  Google Scholar 

  • Goffman, E. (1966). Behavior in public places: Notes on the social organization of gatherings. New York: Free Press.

    Google Scholar 

  • Heeter, C. (1992). Being there: The subjective experience of presence. Presence: Teleoperators & Virtual Environments, 1(2), 262–271.

    Article  Google Scholar 

  • Hornecker, E., & Buur, J. (2006). Getting a grip on tangible interaction: A framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘06) (pp. 437–446). New York: ACM.

    Google Scholar 

  • Ishii, H. (2008). Tangible bits: Beyond pixels. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (pp. xv–xxv).

    Google Scholar 

  • ISO 8373:2012, Robots and robotic devices—Vocabulary. https://www.iso.org/standard/55890.html. Retrieved February 14, 2018.

  • Jibo. https://www.jibo.com/. Retrieved March 21, 2018.

  • Keecker. https://www.keecker.com/. Retrieved March 21, 2018.

  • Kristoffersson, A., Coradeschi, S., & Loutfi, A. (2013). A review of mobile robotic telepresence. Advances in Human-Computer Interaction, 3.

    Google Scholar 

  • Kubi. https://www.revolverobotics.com. Retrieved March 21, 2018.

  • Kuzuoka, H., et al. (2000). GestureMan: A mobile robot that embodies a remote instructor’s actions. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (pp. 155–162). New York: ACM.

    Google Scholar 

  • Lee, M. K., & Takayama, L. (2011). Now, I have a body: Uses and social norms for mobile remote presence in the workplace. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 33–42).

    Google Scholar 

  • LuxAI. 2018. QT Robot. Retrieved March 21, 2018 from http://www.luxai.com.

  • MantaroBot. 2016. Retrieved February 13, 2019 from http://www.mantarobot.com/.

  • McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.

    Google Scholar 

  • Maquil, V., Tobias, E., Anastasiou, D., Mayer, H., & Latour, T. (2017). COPSE: Rapidly instantiating problem solving activities based on tangible tabletop interfaces. Proceedings of the ACM on Human-Computer Interaction, 1(1), 6.

    Article  Google Scholar 

  • Minsky, M. (1980, June). Telepresence (essay). In Omni Magazine (Vol. 2, No. 9) (pp. 45–52). Omni Publications International Ltd.

    Google Scholar 

  • Mehrabian, A. (1980). Silent messages: Implicit communication of emotions and attitudes. Belmont: Wadsworth Publishing Co Inc.

    Google Scholar 

  • Meltzoff, A. N., Brooks, R., Shon, A. P., & Rao, R. P. (2010). “Social” robots are psychological agents for infants: A test of gaze following. Neural Networks, 23(8–9), 966–972.

    Article  Google Scholar 

  • Mojin Robotics. (2018). Care-O-Bot 4. Retrieved March 21, 2018 from http://www.mojin-robotics.de.

  • Nowak, K. L., & Biocca, F. (2003). The effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments. Presence: Teleoperators and Virtual Environments, 12(5), 481–494.

    Article  Google Scholar 

  • PadBot. (2018). PadBot Telepresence Robot. Retrieved March 21, 2018 from http://www.padbot.com.

  • Polycom. (2018). RealPresence OTX Studio. Retrieved March 21, 2018 from http://www.polycom.com/products-services/hd-telepresence-video-conferencing/realpresence-immersive/realpresence-otx-studio.html.

  • Shaer, O., & Hornecker, E. (2010). Tangible user interfaces. Past, present and future directions. Foundations and Trends in Human-Computer Interaction, 3(1–2), 4–137.

    Google Scholar 

  • Short, J., Williams, E., & Christie, B. (1976). The social psychology of telecommunications. London, New York: Wiley.

    Google Scholar 

  • Steelcase. (2016). Making Distance Disappear-Unleashing the Power of Distributed Teams. Steelcase360 Magazine, Issue 10, 8–13.

    Google Scholar 

  • Swivl. (2018). Retrieved March 21, 2018 from https://www.swivl.com.

  • Tang, A., Boyle, M., & Greenberg, S. (2005). Understanding and mitigating display and presence disparity in mixed presence groupware. Journal of Research and Practice in Information Technology (JRPIT), 37(2), 193–210.

    Google Scholar 

  • Toyota Global Newsroom. (2017). Toyota Unveils Third Generation Humanoid Robot T-HR3. (21 November 2017). Retrieved March 21, 2018 from https://newsroom.toyota.co.jp/en/download/20110424.

  • Ullmer B., & Ishii, H. (2000, July). Emerging frameworks for tangible user interfaces. IBM Systems Journal, 39(3.4), 915–931.

    Google Scholar 

  • Willow Garage. (2012). Texai Remote Presence System, from http://www.willowgarage.com/pages/texai/overview.

  • Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., & Sloetjes, H. (2006). ELAN: A professional framework for multimodality research. In 5th International Conference on Language Resources and Evaluation (LREC 2006) (pp. 1556–1559).

    Google Scholar 

  • World Robotics, Executive Summary. (2018). Retrieved November 20, 2018, https://ifr.org/downloads/press2018/Executive_Summary_WR_2018_Industrial_Robots.pdf.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dimitra Anastasiou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Anastasiou, D., Stahl, C., Latour, T. (2019). The Role of Gesture in Social Telepresence Robots—A Scenario of Distant Collaborative Problem-Solving. In: Korn, O. (eds) Social Robots: Technological, Societal and Ethical Aspects of Human-Robot Interaction. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-030-17107-0_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-17107-0_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-17106-3

  • Online ISBN: 978-3-030-17107-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics