Mightability: A Multi-state Visuo-spatial Reasoning for Human-Robot Interaction
We, the Humans, are capable of estimating various abilities of ourselves and of the person we are interacting with. Visibility and reachability are among two such abilities. Studies in neuroscience and psychology suggest that from the age of 12-15 months children start to understand the occlusion of others line-of-sight and from the age of 3 years they start to develop the ability, termed as perceived reachability for self and for others. As such capabilities evolve in the children, they start showing intuitive and proactive behavior by perceiving various abilities of the human partner.
Inspired from such studies, which suggest that visuo-spatial perception plays an important role in Human-Human interaction, we propose to equip our robot to perceive various types of abilities of the agents in the workspace. The robot perceives such abilities not only from the current state of the agent but also by virtually putting an agent into various achievable states, such as turn left, stand up, etc. As the robot estimates what an agent might be able to ‘see’ and ‘reach’ if will be in a particular state, we term such analyses as Mightability Analyses. Currently the robot is equipped to perform such Mightability analyses at two levels: cells in the 3D grid and objects in the space, which we termed as Mightability Maps (MM) and Object Oriented Mightabilities (OOM) respectively.
We have shown the applications of Mightability analyses in performing various co-operative tasks like show and make an object accessible to the human as well as competitive tasks like hide and put away an object from the human. Such Mightability analyses equip the robot for higher-level learning and decisional capabilities as well as could facilitate the robot for better verbalize interaction and proactive behavior.
KeywordsHumanoid Robot Object Orient Proactive Behavior Human Partner Human Robot Interaction
Unable to display preview. Download preview PDF.
- 2.Caron, A.J., Kiel, E.J., Dayton, M., Butler, S.C.: Comprehension of the referential intent of looking and pointing between 12 and 15 months. Journal of Cognition and Development 3(4), 445–464 (2002)Google Scholar
- 6.Zacharias, F., Borst, C., Hirzinger, G.: Capturing robot workspace structure: representing robot capabilities. In: Proceedings of the IEEE/RSJ IROS, San Diego, USA, pp. 3229–3236 (October 2007)Google Scholar
- 7.Zacharias, F., Borst, C., Hirzinger, G.: Online Generation of Reachable Grasps for Dexterous Manipulation Using a Representation of the Reachable Workspace. In: Proceedings of the International Conference on Advanced Robotics, Germany (2009)Google Scholar
- 8.Guilamo, L., Kuffner, J., Nishiwaki, K., Kagami, S.: Efficient prioritized inverse kinematic solutions for redundant manipulators. In: Proceedings of IEEE/RSJ IROS, pp. 1905–1910 (2005)Google Scholar
- 9.Guan, Y., Yokoi, K.: Reachable Space Generation of A Humanoid Robot Using The Monte Carlo Method. In: Proceedings of IEEE/RSJ IROS, pp. 1984–1989 (October 2006)Google Scholar
- 10.Breazeal, C., Berlin, M., Brooks, A., Gray, J., Thomaz, A.L.: Using perspective taking to learn from ambiguous demonstrations. In: Robotics and Autonomous Systems, pp. 385–393 (2006)Google Scholar
- 11.Johnson, M., Demiris, Y.: Perceptual Perspective Taking And Action Recognition. International Journal of Advanced Robotic Systems 2(4), 301–308 (2005)Google Scholar
- 12.Gregory Trafton, J., Cassimatis, N.L., Bugajska, M.D., Brock, D.P., Mintz, F., Schultz, A.C.: Enabling effective human-robot interaction using perspective-taking in robots. IEEE Transactions on Systems, Man, and Cybernetics, 460–470 (2005)Google Scholar
- 13.Marin-Urias, L.F., Sisbot, E.A., Pandey, A.K., Tadakuma, R., Alami, R.: Towards shared attention through geometric reasoning for human robot interaction. In: IEEE-RAS International Conference on Humanoid Robots, Paris, France, pp. 331–336 (2009)Google Scholar
- 16.Pandey, A.K., Alami, R.: Mightability Maps: A Perceptual Level Decisional Framework for Co-operative and Competitive Human-Robot Interaction. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taiwan, pp. 5842–5848 (2010)Google Scholar
- 19.Simeon, T., Laumond, J.-P., Lamiraux, F.: Move3d: A generic platform for path planning. In: IEEE International Symposium on Assembly and Task Planning, Fukuoka, Japan, pp. 25–30 (2001)Google Scholar