Abstract
This paper describes an optimized algorithm for a simulated agent in the RoboCup Soccer 2D Simulation environment to find a better way dribbling with ball and simultaneously avoiding opponents who are blocking our agent’s way to the goal. At first an optimized algorithm for finding the best way for each cycle is introduced, which gives us an optimum direction toward the goal, avoiding the opponent agents. Then this algorithm is improved using a Reinforcement Learning (RL) method. The experimental results using Soccer 2D Simulator shows the improvement of the behavior of the agent in this multi-agent system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tavafi, A., Nozari, N., Vatani, R., Rad Yousefi, M., Rahmatinia, S., Piredeyr, P.: MarliK 2011 Team Description Paper. In: RoboCup 2011 Symposium and Competitions, Turkey (2011)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
de Boer, R., Kok, J.: The Incremental Development of a Synthetic Multi-Agent System: The UvA Trilearn 2001 Robotic Soccer Simulation Team. Master’s thesis, University of Amsterdam, The Netherlands (2002)
Mitchell, T.: Machine Learning. McGraw Hill, New York (1997)
Bianchi, R.A.C., Ribeiro, C.H.C., Costa, A.H.R.: Heuristically Accelerated Q–Learning: A New Approach to Speed Up Reinforcement Learning. In: Bazzan, A.L.C., Labidi, S. (eds.) SBIA 2004. LNCS (LNAI), vol. 3171, pp. 245–254. Springer, Heidelberg (2004)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice-Hall, Upper Saddle River (1995)
Akiyama, H., Noda, I.: Multi-agent Positioning Mechanism in the Dynamic Environment. In: Visser, U., Ribeiro, F., Ohashi, T., Dellaert, F. (eds.) RoboCup 2007. LNCS (LNAI), vol. 5001, pp. 377–384. Springer, Heidelberg (2008)
Ko, J., Klein, D.J., Fox, D., Hähnel, D.: Gaussian processes and reinforcement learning for identification and control of an autonomous blimp. In: Proceedings of the IEEE International Conference on Robotics & Automation, ICRA (2007b)
Crites, R., Barto, A.: Improving elevator performance using reinforcement learning. In: Advances in Neural Information Processing Systems 8 (NIPS 1995), Denver, USA, pp. 1017–1023. MIT Press, Cambridge (1995)
Kitano, H., Minoro, A., Kuniyoshi, Y., Noda, I., Osawa, E.: Robocup: A challenge problem for ai. AI Magazine 18(1), 73–85 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tavafi, A., Majidi, N., Shaghelani, M., Danesh, A.S. (2013). Optimization for Agent Path Finding in Soccer 2D Simulation. In: Das, V.V., Chaba, Y. (eds) Mobile Communication and Power Engineering. AIM 2012. Communications in Computer and Information Science, vol 296. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35864-7_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-35864-7_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35863-0
Online ISBN: 978-3-642-35864-7
eBook Packages: Computer ScienceComputer Science (R0)