Abstract
We present a socially inspired approach that allows agents in Multi-Agent Systems to speed up their own learning process through communication. Thereby, they are able to trade off impact of knowledge by mutation dependent on the recent performance of the interacting agents. This is inspired by social interaction of humans, where the opinions of experts have greater impact on the overall opinion and are incorporated more exactly than those of newbies. The approach is successfully evaluated in a simulation in which mobile robots have to accomplish a task while taking care of timely recharging their resources.
Chapter PDF
References
M. L. Littman L. P. Kaelbling and A. W. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237–285, 1996.
R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, 1998.
M. J. Matarić. Reinforcement learning in the multi-robot domain. Autonomous Robots, 4(l):73–83, 1997.
M. Tan. Multi-agent reinforcement learning: Independent vs. cooperative learning. In M. N. Huhns and M. P. Singh, editors, Readings in Agents, pages 487–494. Morgan Kaufmann, San Francisco, CA, USA, 1997.
L. Kleinjohann W. Richert, B. Kleinjohann. Learning action sequences through imitation in behavior based architectures. In Systems Aspects in Organic and Pervasive Computing — ARCS 2005, number 3432 in LNCS, pages 93–107. Springer-Verlag Berlin, 14–17 March 2005.
A. Saskevic M. Koch, W. Richert. A self-optimization approach for hybrid planning and socially inspired agents. In Second NASA GSFC/IEEE Workshop on Radical Agent Concepts, NASA Goddard Space Flight Center Visitor’s Center Greenbelt, MD, USA, 2005.
R. Dawkins. The Selfish Gene. Oxford University Press, Oxford, 1976.
S. Blackmore. The Meme Machine. Oxford University Press, 1999.
M. Koch B. Kleinjohann, W. Richert, P. Adelt, and S. Rose. Paderkicker. http://paderkicker.upb.de, 2006.
T. Balch and R. C Arkin. Communication in reactive multiagent robotic systems. Autonomous Robots, l(l):27–52, 1994.
M. Matarić. Learning to behave socially. In SAB94: Proceedings of the third international conference on Simulation of adaptive behavior: from animals to animats 3, pages 453–462, Cambridge, MA, USA, 1994. MIT Press.
P. Riley and M. Veloso. Coaching advice and adaptation. In B. Browning D. Polani, A. Bonarini and K. Yoshida, editors, RoboCup-2003: The Sixth RoboCup Competitions and Conferences. Springer Verlag, Berlin, 2004.
T._S. Dahl, M. J. Matarić, and G. S. Sukhatme. Adaptive spatio-temporal organization in groups of robots. In IEEE/RSJ International Conference on Robotics and Intelligent Systems, pages 1044–1049, Lausanne, Switzerland, Oct 2002.
S. Kapetanakis and D. Kudenko. Reinforcement learning of coordination in heterogeneous cooperative multi-agent systems. In AAMAS’ 04: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, pages 1258–1259, Washington, DC, USA, 2004. IEEE Computer Society.
C. Claus and C. Boutilier. The dynamics of reinforcement learning in cooperative multiagent systems. In AAAI/IAAI, pages 746–752, 1998.
N. Cesa-Bianchi, Y. Freund, D. Haussler, D. P. Helmbold, R. E. Schapire, and M. K. Warmuth. How to use expert advice. J. ACM, 44(3):427–485, 1997.
R. A. Brooks. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation RA-2, pages 14–23, 1986.
R. C. Arkin. Behaviour-Based Robotics. MIT Press, 1998.
C. J. C. H. Watkins and Dayan. Q-learning. 1992.
ActivMedia. URL for the Pioneer robot: http://www.activrobots.com, 2003.
B. P. Gerkey, R. T. Vaughan, and A. Howard. The player/stage project: Tools for multi-robot and distributed sensor systems. In Proceedings of the International Conference on Advanced Robotics, pages 317–323, Coimbra, Portugal, Jul 2003.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 International Federation for Information Processing
About this paper
Cite this paper
Richert, W., Kleinjohann, B., Kleinjohann, L. (2006). Trading off Impact and Mutation of Knowledge by Cooperatively Learning Robots. In: Pan, Y., Rammig, F.J., Schmeck, H., Solar, M. (eds) Biologically Inspired Cooperative Computing. BICC 2006. IFIP International Federation for Information Processing, vol 216. Springer, Boston, MA . https://doi.org/10.1007/978-0-387-34733-2_19
Download citation
DOI: https://doi.org/10.1007/978-0-387-34733-2_19
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-34632-8
Online ISBN: 978-0-387-34733-2
eBook Packages: Computer ScienceComputer Science (R0)