Skip to main content
SpringerLink
Log in
Book cover

International Conference on Agents and Artificial Intelligence

ICAART 2012: Agents and Artificial Intelligence pp 433–448Cite as

Evaluating Telepresence Robots in the Field

  • Conference paper

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 358))

Abstract

Most robotic systems are usually used and evaluated in laboratory setting for a limited period of time. The limitation of lab evaluation is that it does not take into account the different challenges imposed by the fielding of robotic solutions into real contexts. Our current work evaluates a robotic telepresence platform to be used with elderly people. This paper describes our effort toward a comprehensive, ecological and longitudinal evaluation of such robots. Specifically, the paper highlights open points related to the transition from laboratory to real world settings. It first discusses some results from a short term evaluation performed in Italy, obtained by interviewing 44 healthcare workers as possible clients (people connecting to the robot) and 10 older adults as possible end users (people receiving visits through the robot). It then describes a complete evaluation plan designed for a long term assessment also dwelling on the initial application of such methodology to test sites, finally it introduces some technical features that could enable a more robust real world deployment.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Tapus, A., Matarić, M.J., Scassellati, B.: The Grand Challenges in Socially Assistive Robotics. IEEE Robotics and Automation Magazine 14, 35–42 (2007)

    Article  Google Scholar 

  2. Pineau, J., Montemerlo, M., Pollack, M., Roy, N., Thrun, S.: Towards Robotic Assistants in Nursing Homes: Challenges and Results. Robotics and Autonomous Systems 42, 271–281 (2003)

    Article  MATH  Google Scholar 

  3. Cesta, A., Cortellessa, G., Rasconi, R., Pecora, F., Scopelliti, M., Tiberio, L.: Monitoring elderly people with the RoboCare Domestic Environment: Interaction synthesis and user evaluation. Computational Intelligence 27, 60–82 (2011)

    Article  MathSciNet  Google Scholar 

  4. Saffiotti, A.: The Concept of Peis-Ecology: Integrating Robots in Smart Environments. Acta Futura 3, 35–42 (2009)

    Google Scholar 

  5. Lee, M.K., Takayama, L.: Now, I Have a Body: Uses and Social Norms for Mobile Remote Presence in the Workplace. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems, CHI 2011, pp. 33–42. ACM, New York (2011)

    Chapter  Google Scholar 

  6. Tsui, K.M., Desai, M., Yanco, H.A., Uhlik, C.: Exploring Use Cases for Telepresence Robots. In: Proceedings of the 6th Int. Conf. on Human-Robot Interaction, HRI 2011, pp. 11–18. ACM, New York (2011)

    Google Scholar 

  7. Beer, J.B., Takayama, L.: Mobile Remote Presence for Older Adults: Acceptance, Benefits, and Concerns. In: Proceedings of Human Robot Interaction, HRI 2011, Lausanne, CH, pp. 19–26 (2011)

    Google Scholar 

  8. Kristoffersson, A., Coradeschi, S., Loutfi, A., Severinson Eklundh, K.: Towards Evaluation of Social Robotic Telepresence based on Measures of Social and Spatial Presence. In: Proceedings on HRI 2011 Workshop on Social Robotic Telepresence, Lausanne, pp. 43–49 (March 2011)

    Google Scholar 

  9. Tiberio, L., Padua, L., Pellegrino, A., Aprile, I., Cortellessa, G., Cesta, A.: Assessing the Tolerance of a Telepresence Robot in Users with Mild Cognitive Impairment – A Protocol for Studying Users’ Physiological Response. In: Proceedings on HRI 2011 Workshop on Social Robotic Telepresence, Lausanne, pp. 23–28 (March 2011)

    Google Scholar 

  10. Sabanovic, S., Michalowski, M., Simmons, R.: Robots in the Wild: Observing Human-Robot Social Interaction Outside the Lab. In: Proceedings of the International Workshop on Advanced Motion Control, Istanbul, Turkey. ACM (2006)

    Google Scholar 

  11. Hutchins, E.: Cognition in the Wild. MIT Press (1995)

    Google Scholar 

  12. Bickmore, T.W., Picard, R.W.: Establishing and Maintaining Long-Term Human-Computer Relationships. ACM Transactions on Computer Human Interaction 12, 293–327 (2005)

    Article  Google Scholar 

  13. Cesta, A., Cortellessa, G., Orlandini, A., Tiberio, L.: Addressing the Long-term Evaluation of a Telepresence Robot for the Elderly. In: Proc. of the 4th Int. Conf. on Agents and Artificial Intelligence, ICAART 2012. Artificial Intelligence, vol. 1, pp. 652–663. SciTePress (2012)

    Google Scholar 

  14. Sumi: Software Usability Measurement Inventory, University College Cork (2011), http://sumi.ucc.ie/. (last checked November 2011)

  15. Lombard, M., Ditton, T., Weinstein, L.: Measuring Telepresence: The Temple Presence Inventory. In: Proceedings of the Twelfth International Workshop on Presence, Los Angeles, California (USA), San Francisco (2009)

    Google Scholar 

  16. Terracciano, A., McCrae, R.R., Costa, P.T.: Factorial and Construct Validity of the Italian Positive and Negative Affect Schedule (PANAS). European Journal of Psychological Assessment Official Organ of the European Association of Psychological Assessment 19, 131–141 (2003)

    Article  Google Scholar 

  17. Russell, D., Peplau, L.A., Cutrona, C.E.: The Revised UCLA Loneliness Scale: Concurrent and Discriminant Validity Evidence. Journal of Personality and Social Psychology 39, 472–480 (1980)

    Article  Google Scholar 

  18. Ware, J.E.J., Kosinski, M., Keller, S.D.: A 12-Item Short-Form Health Survey: Construction of Scales and Preliminary Tests of Reliability and Validity. Medical Care 34 (1996)

    Google Scholar 

  19. Zimet, G.D., Dahlem, N.W., Zimet, S.G., Farley, G.K.: The Multidimensional Scale of Perceived Social Support. Journal of Personality Assessment 52, 30–41 (1988)

    Article  Google Scholar 

  20. Yesavage, J.A., Brink, T.L., Rose, T.L., Lum, O., Huang, V., Adey, M., Leirer, V.O.: Development and Validation of a Geriatric Depression Screening Scale: a Preliminary Report. Journal of Psychiatric Research 17, 37–49 (1983)

    Article  Google Scholar 

  21. Heerink, M., Kröse, B.J.A., Evers, V., Wielinga, B.J.: Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model. I. J. Social Robotics 2, 361–375 (2010)

    Article  Google Scholar 

  22. Cortellessa, G., Scopelliti, M., Tiberio, L., Koch Svedberg, G., Loutfi, A., Pecora, F.: A Cross-Cultural Evaluation of Domestic Assistive Robots. In: Proceedings of AAAI Fall Symposium on AI in Eldercare: New Solutions to Old Problems (2008)

    Google Scholar 

  23. Steinfeld, A., Lewis, M., Fong, T., Scholtz, J.: Common Metrics for Human-Robot Interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, pp. 33–40. ACM (2006)

    Google Scholar 

  24. Tsai, T.C., Hsu, Y.L., Ma, A.I., King, T., Wu, C.H.: Developing a Telepresence Robot for Interpersonal Communication with the Elderly in a Home Environment. Telemedicine and e-Health 13, 407–424 (2007)

    Article  Google Scholar 

  25. Bensalem, S., de Silva, L., Gallien, M., Ingrand, F., Yan, R.: “Rock Solid” Software: A Verifiable and Correct-by-Construction Controller for Rover and Spacecraft Functional Levels. In: Proc. of the 10th Int. Symp. on Artificial Intelligence, Robotics and Automation in Space, i-SAIRAS 2010 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CNR, Italian National Research Council, ISTC, Rome, Italy

    Amedeo Cesta, Gabriella Cortellessa, Andrea Orlandini & Lorenza Tiberio

Authors
  1. Amedeo Cesta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gabriella Cortellessa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andrea Orlandini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lorenza Tiberio
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. INSTICC and IPS, Estefanilha, Setúbal, Portugal

    Joaquim Filipe

  2. IST - Technical University of Lisbon, Av.Rovisco Pais, 1, 1049-001, Lisbon, Portugal

    Ana Fred

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cesta, A., Cortellessa, G., Orlandini, A., Tiberio, L. (2013). Evaluating Telepresence Robots in the Field. In: Filipe, J., Fred, A. (eds) Agents and Artificial Intelligence. ICAART 2012. Communications in Computer and Information Science, vol 358. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36907-0_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-36907-0_29

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-36906-3

  • Online ISBN: 978-3-642-36907-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation