Abstract
This paper introduces a behavior-grounded approach to representing and learning the affordances of tools by a robot. The affordance representation is learned during a behavioral babbling stage in which the robot randomly chooses different exploratory behaviors, applies them to the tool, and observes their effects on environmental objects. As a result of this exploratory procedure, the tool representation is grounded in the behavioral and perceptual repertoire of the robot. Furthermore, the representation is autonomously testable and verifiable by the robot as it is expressed in concrete terms (i.e., behaviors) that are directly available to the robot’s controller. The tool representation described here can also be used to solve tool-using tasks by dynamically sequencing the exploratory behaviors which were used to explore the tool based on their expected outcomes. The quality of the learned representation was tested on extension-of-reach tasks with rigid tools.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Beck, B.B.: Animal Tool behavior: The use and manufacture of tools by animals. Garland STMP Press, New York (1980)
Gibson, J.J.: The ecological approach to visual perception. Houghton Mifflin, Boston (1979)
Arkin, R.: Behavior-based robotics. MIT Press, Cambridge (1998)
Power, T.G.: Play and Exploration in Children and Animals. Lawrence Erlbaum Associates, Publishers, Mahwah (2000)
Lorenz, K.: Innate bases of learning. In: Pribram, K.H., King, J. (eds.) Learning as Self-Organization, Lawrence Erlbaum Associates, Publishers, Mahwah (1996)
Mah, C.D., Mussa-Ivaldi, F.A.: Evidence for a specific internal representation of motion-force relationships during object manipulation. Biological Cybernetics 88(1), 60–72 (2003)
Köhler, W.: The mentality of apes, Harcourt, Brace, and Co. (1931)
Povinelli, D., Reaux, J., Theall, L., Giambrone, S.: Folk Physics for Apes: The Chimpanzee’s theory of how the world works. Oxford Univ. Press, Oxford (2000)
Visalberghi, E., Trinca, L.: Tool use in capuchin monkeys: distinguishing between performing and understanding. Primates 30, 511–521 (1989)
Krotkov, E.: Perception of material properties by robotic probing: Preliminary investigations. In: IJCAI. Proceedings of the International Joint Conference on Artificial Intelligence, Montreal, pp. 88–94 (August 1995)
Fitzpatrick, P., Metta, G., Natale, L., Rao, S., Sandini, G.: Learning about objects through action - initial steps towards artificial cognition. In: ICRA. Proceedings of IEEE International Conference on Robotics and Automation, Taipei, Taiwan (May 12–17, 2003)
Bogoni, L., Bajcsy, R.: Interactive recognition and representation of functionality. Computer Vision and Image Understanding 62(2), 194–214 (1995)
Bogoni, L.: Identification of functional features through observations and interactions. PhD thesis, University of Pennsylvania (1995)
Stark, L., Bowyer, K.: Generic Object Recognition using Form and Function. Machine Perception and AI, vol. 10. World Scientific, Singapore (1996)
Rivlin, E., Dickinson, S.J., Rosenfeld, A.: Recognition by functional parts. Computer Vision and Image Understanding 62(2), 164–176 (1995)
Hayes, P.J.: The second naive physics manifesto. In: Formal Theories of the Commonsense World, Ablex Publishing, Greenwich (1985)
Tsai, R.Y.: An efficient and accurate camera calibration technique for 3D machine vision. In: CVPR. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Miami Beach, FL, pp. 364–374 (1986)
Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation RA-3(4), 323–344 (1987)
Willson, R.: Tsai Camera Calibration Software (1995), the source code can be downloaded from http://www-2.cs.cmu.edu/~rgw/TsaiCode.html
Berthoz, A.: The brain’s sense of movement. Harvard University Press, Cambridge (2000)
Singh, S., Littmn, M., Sutton, R., Stone, P.: Learning predictive state representations. Paper Draft (unpublished)
Littman, M.L., Sutton, R.S., Singh, S.: Predictive representation of state. Advances in Neural Information Processing Systems 14 (2002)
Ishibashi, H., Hihara, S., Iriki, A.: Acquisition and development of monkey tool-use: behavioral and kinematic analyses. Canadian Journal of Physiology and Pharmacology 78, 958–966 (2000)
Mason, M.T.: Mechanics of Robotic Manipulation. MIT Press, Cambridge (2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stoytchev, A. (2008). Learning the Affordances of Tools Using a Behavior-Grounded Approach. In: Rome, E., Hertzberg, J., Dorffner, G. (eds) Towards Affordance-Based Robot Control. Lecture Notes in Computer Science(), vol 4760. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77915-5_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-77915-5_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77914-8
Online ISBN: 978-3-540-77915-5
eBook Packages: Computer ScienceComputer Science (R0)