Collaborative Human-Robot Hierarchical Task Execution with an Activation Spreading Architecture

  • Bashira Akter AnimaEmail author
  • Janelle Blankenburg
  • Mariya Zagainova
  • S. Pourya Hoseini A.
  • Muhammed Tawfiq Chowdhury
  • David Feil-Seifer
  • Monica Nicolescu
  • Mircea Nicolescu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11876)


This paper addresses the problem of human-robot task execution for hierarchical task plans. The main contributions are the ability for dynamic allocation of tasks in human-robot teams and opportunistic task execution given different environmental conditions. The human-robot collaborative task is represented in a tree structure which consists of sequential, non-ordering, and alternative paths of execution. The general approach to enable human-robot collaborative task execution is to have the robot maintain an updated, simulated version of the human’s task representation, which is similar to the robot’s own controller for the same task. Continuous peer node message passing between the agents’ task representations enables both to coordinate their task execution, so that they perform the task given its required execution constraints and they do not both work on the same task component. A tea-table task scenario was designed for validation with overlapping and non-overlapping sub-tasks between a human and a Baxter robot.



The authors would like to acknowledge the financial support of this work by Office of Naval Research (ONR) award #N00014-16-1-2312, N00014-14-1-0776.


  1. 1.
    Arkin, R.C., et al.: An ethological and emotional basis for human–robot interaction. Robot. Auton. Syst. 42(3–4), 191–201 (2003)CrossRefGoogle Scholar
  2. 2.
    Thrun, S., et al.: Probabilistic algorithms and the interactive museum tour-guide robot Minerva. Int. J. Robot. Res. 19(11), 972–999 (2000)CrossRefGoogle Scholar
  3. 3.
    Severinson-Eklundh, K., et al.: Social and collaborative aspects of interaction with a service robot. Robot. Auton. Syst. 42(3–4), 223–234 (2003)CrossRefGoogle Scholar
  4. 4.
    Hans, M., et al.: Robotic home assistant care-o-bot: past-present-future. IEEE (2002)Google Scholar
  5. 5.
    Ambrose, R., et al.: Robonaut: NASA’s space humanoid. IEEE Intell. Syst. 15(4), 57–63 (2000)CrossRefGoogle Scholar
  6. 6.
    Khurshid, J., Bing-rong, H.: Military robots - a glimpse from today and tomorrow. In: ICARCV Control, Automation, Robotics and Vision Conference (2004)Google Scholar
  7. 7.
    Casper, J., Murphy, R.: Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center. IEEE Trans. Syst. Man Cybern. Part B Cybern. 33(3), 367–385 (2003)CrossRefGoogle Scholar
  8. 8.
    Awais, M., Henrich, D.: Human-robot collaboration by intention recognition using probabilistic state machines. In: 19th International Workshop on Robotics in Alpe-Adria-Danube Region (RAAD 2010). IEEE, June 2010Google Scholar
  9. 9.
    Wang, Z. et al.: Recurrent convolutional networks based intention recognition for human-robot collaboration tasks. In: International Conference on Systems, Man, and Cybernetics (SMC) (2017)Google Scholar
  10. 10.
    Li, Y., Ge, S.S.: Human-robot collaboration based on motion intention estimation. IEEE/ASME Trans. Mechatron. 19(3), 1007–1014 (2014)CrossRefGoogle Scholar
  11. 11.
    Lasota, P.A., Shah, J.A.: Analyzing the effects of human-aware motion planning on close-proximity human–robot collaboration. Hum. Factors J. Hum. Factors Ergon.Soc. 57(1), 21–33 (2015)CrossRefGoogle Scholar
  12. 12.
    Luo, R.C., Huang, C.: Human-aware motion planning based on search and sampling approach. In: Workshop on Advanced Robotics and its Social Impacts (ARSO) (2016)Google Scholar
  13. 13.
    Navarro, S.E., et al.: Methods for safe human-robot-interaction using capacitive tactile proximity sensors. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, November 2013Google Scholar
  14. 14.
    Feil-Seifer, D., Matarić, M.: People-aware navigation for goal-oriented behavior involving a human partner. In: Proceedings of the International Conference on Development and Learning (ICDL), Frankfurt am Main, Germany, August 2011Google Scholar
  15. 15.
    Baraglia, J., et al.: Initiative in robot assistance during collaborative task execution (2016)Google Scholar
  16. 16.
    Hawkins, K.P. et al.: Probabilistic human action prediction and wait-sensitive planning for responsive human-robot collaboration. In: 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 499–506, October 2013Google Scholar
  17. 17.
    Hawkins, K.P., et al.: Anticipating human actions for collaboration in the presence of task and sensor uncertainty. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 2215–2222, May 2014Google Scholar
  18. 18.
    Blankenburg, J., et al.: A distributed control architecture for collaborative multi-robot task allocation. In: International Conference on Humanoid Robots, Birmingham, UK, November 2017Google Scholar
  19. 19.
    Quigley, M., et al. ROS: an open-source robot operating system. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) Workshop on Open Source Robotics, Kobe, Japan, May 2009Google Scholar
  20. 20.
    Hoseini A., S.P., et al.: Handling ambiguous object recognition situations in a robotic environment via dynamic information fusion. In: Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA), June 2018Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Bashira Akter Anima
    • 1
    Email author
  • Janelle Blankenburg
    • 1
  • Mariya Zagainova
    • 1
  • S. Pourya Hoseini A.
    • 1
  • Muhammed Tawfiq Chowdhury
    • 1
  • David Feil-Seifer
    • 1
  • Monica Nicolescu
    • 1
  • Mircea Nicolescu
    • 1
  1. 1.Department of Computer Science and EngineeringUniversity NevadaRenoUSA

Personalised recommendations