Skip to main content

Two Faces of Human–Robot Interaction: Field and Service Robots

  • Chapter
  • First Online:
New Trends in Medical and Service Robots

Part of the book series: Mechanisms and Machine Science ((Mechan. Machine Science,volume 20))

Abstract

This chapter reports on recent research and development done at Institute for Systems and Robotics (ISR) on Human-Robot Interaction (HRI), encompassing two different perspectives. On the one hand, we have conducted research on field robots tele-operated by remote human operators, targeting Urban Search And Rescue scenarios. Here, research is focused on the challenge of conveying the operator with an effective situation awareness of the robot surroundings. Situation awareness is here understood as “the perception of the elements in the environment within a volume of time and space, the comprehension of their meaning, and the projection of their status in the near future” (Drury et al. 2003). Our approach is based on decoupling operation of the robot perception from the motion command: an Head-Mounted Display displays in stereo a video stream from the cameras onboard the robot, while the gaze of these cameras is controlled by the operator head, and the robot motion is commanded from a gamepad held by the operator. On the other hand, we have addressed the challenge of service robots designed to perform tasks requested by users. Humans interact with these robots, firstly to request a task, and secondly during task execution. The main research challenge is to have these robots to be aware of their own limitations, and ask humans for help to overcome those limitations. We are currently addressing the challenge of developing robust localization and navigation methods targeting office environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.isr.ist.utl.pt

  2. 2.

    Pointgrey Bumblebee2 with an horizontal field-of-view of 97°.

  3. 3.

    GMapping (http://wiki.ros.org/gmapping, retrieved 16 October 2013).

  4. 4.

    AMCL (http://wiki.ros.org/amcl, retrieved 16 October 2013).

  5. 5.

    \( \varGamma \) corresponds to the boundary of an arbitrarily small ball around the goal.

References

  • Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis Machine Intelligence 14(2), 239–256 (1992)

    Google Scholar 

  • Biswas, J., Veloso, M.: Depth camera based localization and navigation for indoor mobile robots. In: RGB-D Workshop (RSS-2011) (2011)

    Google Scholar 

  • Borenstein, J., Koren, Y.: Real-time obstacle avoidance for fast mobile robots. IEEE Transactions on Systems, Man and Cybernetics 19(5), 1179–1187 (1989)

    Google Scholar 

  • Coltin, B., Biswas, J., Pomerleau, D., Veloso, M.: Effective semi-autonomous telepresence. In: Proceedings of the RoboCup Symposium. Istanbul, Turkey (2011)

    Google Scholar 

  • Coradeschi, S., Saffiotti, A.: Symbiotic robotic systems: Humans, robots, and smart environments. IEEE Intelligent Systems 21(3), 82–84 (2006)

    Google Scholar 

  • Drury, J., Scholtz, J., Yanco, H.: Awareness in human-robot interactions. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 1, pp. 912–918 (2003)

    Google Scholar 

  • Elfes, A.: Using occupancy grids for mobile robot perception and navigation. IEEE Computer 22(6), 46–57 (1989)

    Google Scholar 

  • Ferraz, J., Ventura, R.: Robust autonomous stair climbing by a tracked robot using accelerometer sensors. In: Mobile Robotics: Solutions and Challenges (CLAWAR-2009), pp. 415–422. World Scientific (2009)

    Google Scholar 

  • Ferreira, F., Ventura, R.: Autonomous docking of a tracked wheels robot to its tether cable using a vision-based algorithm. In: Workshop on Robotics for Disaster Response, IEEE International Conference on Robotics and Automation (ICRA-09). Kobe, Japan (2009)

    Google Scholar 

  • Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robotics and autonomous systems 42(3), 143–166 (2003)

    Google Scholar 

  • Goodrich, M.A., Schultz, A.C.: Human-robot interaction: A survey. Foundations and Trends in Human-Computer Interaction 1(3), 203–275 (2007)

    Google Scholar 

  • Goodrich, M.A., Olsen, D.R., Crandall, J.W., Palmer, T.J.: Experiments in adjustable autonomy. In: Proceedings of IJCAI Workshop on Autonomy, Delegation and Control: Interacting with Intelligent Agents, pp. 1624–1629 (2001)

    Google Scholar 

  • Haigh, K.Z., Veloso, M.M.: Interleaving planning and robot execution for asynchronous user requests. Autonomous Robots 5(1), 79–95 (1998)

    Google Scholar 

  • Helmer, S., Meger, D., Viswanathan, P., McCann, S., Dockrey, M., Fazli, P., Southey, T., Muja, M., Joya, M., Little, J., Lowe, D., Mackworth, A.: Semantic robot vision challenge: Current state and future directions. arXiv preprint arXiv:0908.2656 (2009)

    Google Scholar 

  • Jacoff, A., Messina, E., Weiss, B.A., Tadokoro, S., Nakagawa, Y.: Test arenas and performance metrics for urban search and rescue robots. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2003), vol. 4, pp. 3396–3403 (2003)

    Google Scholar 

  • Kim, J., Khosla, P.: Real-time obstacle avoidance using harmonic potential functions. IEEE Transactions on Robotics and Automation 8(3), 338–349 (1992)

    Google Scholar 

  • Kitano, H., Tadokoro, S.: RoboCup rescue: A grand challenge for multiagent and intelligent systems. AI Magazine 22(1), 39–52 (2001)

    Google Scholar 

  • Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: RoboCup: The robot world cup initiative. In: Proceedings of the First International Conference on Autonomous Agents (Agents’97), pp. 340–347. ACM Press, New York (1997)

    Google Scholar 

  • Koren, Y., Borenstein, J.: Potential field methods and their inherent limitations for mobile robot navigation. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA-91), pp. 1398–1404 (1991)

    Google Scholar 

  • LaValle, S., Kuffner Jr, J.: Randomized kinodynamic planning. The International Journal of Robotics Research 20(5), 378–400 (2001)

    Google Scholar 

  • Long, D., Fox, M.: The 3rd international planning competition: Results and analysis. Journal of Artificial Intellligence Research (JAIR) 20, 1–59 (2003)

    Google Scholar 

  • Marques, C., Cristovão, J., Lima, P., Frazão, J., Ribeiro, M.I., Ventura, R.: RAPOSA: Semi-autonomous robot for rescue operations. In: Proceedings of IROS2006 — IEEE/RSJ International Conference on Intelligent Robots and Systems (2006)

    Google Scholar 

  • Marques, C., Cristovão, J., Alvito, P., Lima, P., Frazão, J., Ribeiro, M.I., Ventura, R.: A search and rescue robot with tele-operated tether docking system. Industrial Robot 34(4), 332–338 (2007)

    Google Scholar 

  • Martins, H., Ventura, R.: Immersive 3-d teleoperation of a search and rescue robot using a head-mounted display. In: Proceedings of 14th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA-2009) (2009)

    Google Scholar 

  • Mauldin, M.L.: Chatterbots, tinymuds, and the turing test: Entering the loebner prize competition. In: Proceedings of AAAI-94, pp. 16–21 (1994)

    Google Scholar 

  • Murphy, R.R., Rogers, E.: Cooperative assistance for remote robot supervision. Presence 5(2), 224–240 (1996)

    Google Scholar 

  • Pin, F.G., Killough, S.M.: A new family of omnidirectional and holonomic wheeled platforms for mobile robots. IEEE Transactions on Robotics and Automation 10(4), 480–489 (1994)

    Google Scholar 

  • Reis, J.J., Ventura, R.: Immersive robot teleoperation using an hybrid virtual and real stereo camera attitude control. In: Proceedings of Portuguese Conference on Pattern Recognition (RecPad) (2012)

    Google Scholar 

  • Rosenthal, S., Veloso, M.: Using symbiotic relationships with humans to help robots overcome limitations. In: Proceedings of the AAMAS’10 Workshop on Collaborative Human/AI Control for Interactive Experiences. Toronto, Canada (2010)

    Google Scholar 

  • Rosenthal, S., Biswas, J., Veloso, M.: An effective personal mobile robot agent through symbiotic human-robot interaction. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 915–922. International Foundation for Autonomous Agents and Multiagent Systems (2010)

    Google Scholar 

  • Rosenthal, S., Veloso, M., Dey, A.: Task behavior and interaction planning for a mobile service robot that occasionally requires help. In: Proceedings of the AAAI Workshop on Automated Action Planning for Autonomous Mobile Robots. San Francisco, CA (2011)

    Google Scholar 

  • Sequeira, J., Lima, P., Saffiotti, A., Gonzalez-Pacheco, V., Salichs, M.A.: MOnarCH: Multi-robot cognitive systems operating in hospitals. In: ICRA 2013 Workshop on Many Robot Systems (2013)

    Google Scholar 

  • Sethian, J.A.: Fast marching methods. SIAM review 41(2), 199–235 (1999)

    Google Scholar 

  • van der Zant, T., Wisspeintner, T.: Robotic Soccer, chap. RoboCup@Home: Creating and Benchmarking Tomorrows Service Robot Applications, pp. 521–528. Itech Education and Publishing (2007)

    Google Scholar 

  • Vaz, M., Ventura, R.: Ground-plane based indoor mobile robot localization using RGB-D sensor. In: Proceedings of Portuguese Conference on Pattern Recognition (RecPad) (2013)

    Google Scholar 

  • Veloso, M., Biswas, J., Coltin, B., Rosenthal, S., Brandao, S.D., Kollar, T., Meri cli, C., Samadi, M., Ventura, R.: CoBots: Collaborative robots servicing multi-floor buildings. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-12). Vila Moura, Portugal (2012)

    Google Scholar 

  • Ventura, R., Coltin, B., Veloso, M.: Web-based remote assistance to overcome robot perceptual limitations. In: AAAI Conference on Artificial Intelligence (AAAI-13), Workshop on Intelligent Robot Systems. AAAI, Bellevue, WA (2013)

    Google Scholar 

  • Vieira, P., Ventura, R.: Interactive 3D scan-matching using RGB-D data. In: IEEE International Conference on Emerging Technologies and Factory Automation (ETFA’12). Kraków, Poland (2012a)

    Google Scholar 

  • Vieira, P., Ventura, R.: Interactive mapping in 3D using RGB-D data. In: IEEE International Symposium on Safety Security and Rescue Robotics (SSRR’12). College Station, TX (2012b)

    Google Scholar 

  • Vieira, P., Ventura, R.: Interactive mapping using range sensor data under localization uncertainty. Journal of Automation, Mobile Robotics & Intelligent Systems 6(1), 47–53 (2013)

    Google Scholar 

  • Yamauchi, B.M.: PackBot: a versatile platform for military robotics. Proceedings of SPIE 5422, 228–237 (2004)

    Google Scholar 

  • Yanco, H.A., Drury, J.L., Scholtz, J.: Beyond usability evaluation: analysis of human-robot interaction at a major robotics competition. Human-Computer Interaction 19(1), 117–149 (2004)

    Google Scholar 

  • Yanco, H.A., Drury, J.L.: A taxonomy for human-robot interaction. In: Proceedings of the AAAI Fall Symposium on Human-Robot Interaction, pp. 111–119 (2002)

    Google Scholar 

Download references

Acknowledgments

Most of the results here presented were only possible due to the hard work of many students and grantees supervised by the author, namely Jorge Ferraz, Fausto Ferreira, Henrique Martins, João José Reis, Pedro Vieira, Miguel Vaz, Filipe Jesus, and João Mendes.

This work was partially funded by FCT [PEst-OE/EEI/LA0009/2013], [PTDC/EIA-CCO/113257/2009], and EU Project MOnarCH.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rodrigo Ventura .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Ventura, R. (2014). Two Faces of Human–Robot Interaction: Field and Service Robots. In: Rodić, A., Pisla, D., Bleuler, H. (eds) New Trends in Medical and Service Robots. Mechanisms and Machine Science, vol 20. Springer, Cham. https://doi.org/10.1007/978-3-319-05431-5_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-05431-5_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-05430-8

  • Online ISBN: 978-3-319-05431-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics