Abstract
The study of games in Artificial Intelligence has a long tradition. Game playing has been a fertile environment for the development of novel approaches to build intelligent programs. Multi-agent systems (MAS), in particular, are a very useful paradigm in this regard, not only because multi-player games can be addressed using this technology, but most importantly because social aspects of agenthood that have been studied for years by MAS researchers can be applied in the attractive and controlled scenarios that games convey. Diplomacy is a multi-player strategic zero-sum board game, including as main research challenges an enormous search tree, the difficulty of determining the real strength of a position, and the accommodation of negotiation among players. Negotiation abilities bring along other social aspects, such as the need to perform trust reasoning in order to win the game. The majority of existing artificial players (bots) for Diplomacy do not exploit the strategic opportunities enabled by negotiation, focusing instead on search and heuristic approaches. This paper describes the development of DipBlue, an artificial player that uses negotiation in order to gain advantage over its opponents, through the use of peace treaties, formation of alliances and suggestion of actions to allies. A simple trust assessment approach is used as a means to detect and react to potential betrayals by allied players. DipBlue was built to work with DipGame, a MAS testbed for Diplomacy, and has been tested with other players of the same platform and variations of itself. Experimental results show that the use of negotiation increases the performance of bots involved in alliances, when full trust is assumed. In the presence of betrayals, being able to perform trust reasoning is an effective approach to reduce their impact.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Detailed rules of the game can be found in [1].
- 2.
See e.g. http://www.playdiplomacy.com/.
- 3.
- 4.
- 5.
DipBlue is named in honor of the chess-player supercomputer DeepBlue, and of the platform it is built to play on, DipGame.
References
Calhamer, A.B.: The Rules of Diplomacy, 4th edn. Avalon Hill, Baltimore (2000)
Deyllot, R.J.G.: Diplomacy Base de Dados de Movimentos para Controlar Províncias. Master thesis, Universidade de Aveiro (2010)
Fabregues, A., Sierra, C.: Diplomacy game: the test bed. PerAda Magazine, towards persuasive adaptation, pp. 5–6 (2009)
Fabregues, A., Sierra, C.: A testbed for multiagent systems (technical report iiia-tr-2009-09). Technical report, IIIA-CSIC (2009)
Fabregues, A., Sierra, C.: Dipgame: a challenging negotiation testbed. Eng. Appl. Artif. Intell. 24(7), 1137–1146 (2011)
Collier, N.: Repast: An extensible framework for agent simulation. Nat. Resour. Environ. Issues 8, Article 4 (2001)
Hunter, E.: Solo percentages. http://www.diplom.org/Zine/W2003A/Hunter/Solo-Percentages.html. Accessed 29 July 2015
Johansson, S.J., Håård, F.: Tactical coordination in no-press diplomacy. In: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems - AAMAS 2005, p. 423 (2005)
Jonge, D.D.: Optimizing a diplomacy bot using genetic algorithms. Master thesis, Universitat Autònoma de Barcelona (2010)
Kemmerling, M., Ackermann, N., Beume, N., Preuss, M., Uellenbeck, S., Walz, W.: Is human-like and well playing contradictory for diplomacy bots? In: Proceedings of the 5th International Conference on Computational Intelligence and Games, CIG 2009, pp. 209–216. IEEE Press, Piscataway, NJ, USA (2009)
Kemmerling, M., Ackermann, N., Preuss, M.: Nested look-ahead evolutionary algorithm based planning for a believable diplomacy bot. In: Chio, C., et al. (eds.) EvoApplications 2011, Part I. LNCS, vol. 6624, pp. 83–92. Springer, Heidelberg (2011)
Kraus, S., Lehmann, D.: Diplomat, an agent in a multi agent environment: an overview. Technical report, Leibniz Center for Research in Computer Science (1987)
Kraus, S., Lehmann, D., Ephrati, E.: An automated diplomacy player. In: Levy, D., Beal, D. (eds.) Heuristic Programming in Artificial Intelligence: The 1st Computer Olympiad, pp. 136–153. Ellis Horwood Limited, Chinester (1989)
Krzywinski, A., Chen, W., Helgesen, A.: Agent architecture in social games - the implementation of subsumption architecture in diplomacy. In: Proceedings of the Fourth Artificial Intelligence and Interactive Digital Entertainment Conference, pp. 191–196 (2008)
Loeb, D.: Challenges in multi-player gaming by computers: a treatise on the diplomacy programming project. http://diplom.org/Zine/S1995M/Loeb/Project.html. Accessed 29 July 2015
Norman, D.: Dumbbot algorithm. http://www.daide.org.uk/index.php?title=DumbBot_Algorithm. Accessed 29 July 2015
Polberg, S., Paprzycki, M., Ganzha, M.: Developing intelligent bots for the diplomacy game. In: Proceedings of Federated Conference on Computer Science and Information Systems (FedCSIS 2011), pp. 589–596 (2011)
Ribeiro, J., Mariano, P., Seabra Lopes, L.: DarkBlade: a program that plays diplomacy. In: Lopes, L.S., Lau, N., Mariano, P., Rocha, L.M. (eds.) EPIA 2009. LNCS, vol. 5816, pp. 485–496. Springer, Heidelberg (2009)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Prentice Hall, New Jersey (2009)
Shapiro, A., Fuchs, G., Levinson, R.: Learning a game strategy using pattern-weights and self-play. In: Schaeffer, J., Müller, M., Björnsson, Y. (eds.) CG 2002. LNCS, vol. 2883, pp. 42–60. Springer, Heidelberg (2003)
Hal, J.V.: Diplomacy ai - albert. https://sites.google.com/site/diplomacyai/home. Accessed 29 July 2015
Webb, A., Chin, J., Wilkins, T.: Automated negotiation in the game of diplomacy. Technical report, Imperial College London (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Ferreira, A., Lopes Cardoso, H., Reis, L.P. (2015). Strategic Negotiation and Trust in Diplomacy – The DipBlue Approach. In: Nguyen, N., Kowalczyk, R., Duval, B., van den Herik, J., Loiseau, S., Filipe, J. (eds) Transactions on Computational Collective Intelligence XX . Lecture Notes in Computer Science(), vol 9420. Springer, Cham. https://doi.org/10.1007/978-3-319-27543-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-27543-7_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27542-0
Online ISBN: 978-3-319-27543-7
eBook Packages: Computer ScienceComputer Science (R0)