Abstract
This paper is aimed to describe a general improvement over the previous work on the cooperative multiagent coordination. The focus is on highly dynamic environments where the message transfer delay is not negligible. Therefore, the agents shall not count on communicating their intentions along the time they are making the decisions, because this will directly add the communication latencies to the decision making phase. The only way for the agents to be in touch is to communicate and share their beliefs, asynchronously with the decision making procedure. Consequently, they can share similar knowledge and make coordinated decisions based on it. However, in a very dynamic environment, the shared knowledge may not remain similar due to the communication limitations and latencies. This may lead to some inconsistencies in the team coordination performance. Addressing this issue, we propose to hold another abstraction of the environment, called Virtual World Model (VWM), for each agent in addition to its primary internal world state. The primary world state is updated as soon as a new piece of information is received while the information affects the VWM through a synchronization mechanism. The proposed idea has been implemented and tested for Iran University of Science and Technology (IUST) RoboCupRescue simulation team, the 3rd winner of the 2006 worldcup competitions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Weiss, G. (ed.): Multiagent Systems: a Modern Approach to Distributed Artificial Intelligence. MIT Press, Cambridge, MA (1999)
Vlassis, N.: A concise introduction to multiagent systems and distributed AI. Informatics Institute, University of Amsterdam (2003)
Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: Robocup: The robot world cup initiative. In: AGENTS 1997. Proceedings of the first international conference on Autonomous agents, pp. 340–347. ACM Press, New York (1997)
Osborne, M.J., Rubinstein, A.: A Course in Game Theory. MIT Press, Cambridge (1994)
Carriero, N., Gelernter, D.: Linda in context. Communications of the ACM 32(4), 444–458 (1989)
Gelernter, D.: Generative communication in Linda. ACM Transactions on Programming Languages and Systems 7(1), 80–112 (1985)
Boutilier, C.: Planning, learning and coordination in multiagent decision processes. In: TARK 1996. Proceedings of the 6th conference on Theoretical aspects of rationality and knowledge, pp. 195–210. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA (1996)
Tan, M.: Multi-agent reinforcement learning: Independent vs. cooperative learning. In: Huhns, M.N., Singh, M.P. (eds.) Readings in Agents, pp. 487–494. Morgan Kaufmann, San Francisco, CA (1997)
Claus, C., Boutilier, C.: The dynamics of reinforcement learning in cooperative multiagent systems. In: AAAI/IAAI, pp. 746–752 (1998)
Guestrin, C., Koller, D., Parr, R.: Multiagent planning with factored MDPs. In: Advances in Neural Information Processing Systems, vol. 14, The MIT Press, Cambridge (2002)
Vlassis, N., Elhorst, R., Kok, J.R.: Anytime algorithms for multiagent decision making using coordination graphs. In: Proc. of the International Conference on Systems, Man and Cybernetics, The Hague, The Netherlands (2004)
Kok, J.R., Vlassis, N.: Using the max-plus algorithm for multiagent decision making in coordination graphs. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS (LNAI), vol. 4020, pp. 1–12. Springer, Heidelberg (2006)
Dawei, J., Shiyuan, W.: Using the simulated annealing algorithm for multiagent decision making. In: Proceedings of RoboCup International Symposium, Bremen, Germany. LNCS, vol. 4434, Springer, Heidelberg (to appear, 2007)
Kok, J.R., Spaan, M.T.J., Vlassis, N.: Non-communicative multi-robot coordination in dynamic environments. Robotics and Autonomous Systems 50, 99–114 (2005)
Tews, A., Wyeth, G.: Thinking as one: Coordination of multiple mobile robots by shared representations. In: Intl. Conf. on Robotics and Systems (IROS) (2000)
Stone, P., Veloso, M.: Task decomposition, dynamic role assignment, and lowbandwidth communication for real-time strategic teamwork. Artificial Intelligence 110, 241–273 (1999)
Isik, M., Stulp, F., Mayer, G., Utz, H.: Coordination without negotiation in teams of heterogeneous robots. In: Proceedings of RoboCup International Symposium, Bremen, Germany (2006)
Morimoto, T.: How to develop a RoboCupRescue agent (for RoboCupRescue Simulation System version 0) (last visited 2007/07/02) (2002), http://ne.cs.uec.ac.jp/~morimoto/rescue/manual/index.html
RoboCupRescue Simulation League, TC and OC: RoboCup 2006 Rescue Simulation League Rules (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hamraz, S.H., Minaei-Bidgoli, B., Punch, W.F. (2007). VWM: An Improvement to Multiagent Coordination in Highly Dynamic Environments. In: Petta, P., Müller, J.P., Klusch, M., Georgeff, M. (eds) Multiagent System Technologies. MATES 2007. Lecture Notes in Computer Science(), vol 4687. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74949-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-74949-3_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74948-6
Online ISBN: 978-3-540-74949-3
eBook Packages: Computer ScienceComputer Science (R0)