Advertisement

Evolving a Ms. PacMan Controller Using Grammatical Evolution

  • Edgar Galván-López
  • John Mark Swafford
  • Michael O’Neill
  • Anthony Brabazon
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6024)

Abstract

In this paper we propose an evolutionary approach capable of successfully combining rules to play the popular video game, Ms. Pac-Man. In particular we focus our attention on the benefits of using Grammatical Evolution to combine rules in the form of “if <condition> then perform <action>. We defined a set of high-level functions that we think are necessary to successfully maneuver Ms. Pac-Man through a maze while trying to get the highest possible score. For comparison purposes, we used four Ms. Pac-Man agents, including a hand-coded agent, and tested them against three different ghosts teams. Our approach shows that the evolved controller achieved the highest score among all the other tested controllers, regardless of the ghost team used.

Keywords

Derivation Tree Grammatical Evolution Start Symbol Integer Array Neural Network Location 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Dempsey, I., O’Neill, M., Brabazon, A.: Foundations in Grammatical Evolution for Dynamic Environments. Springer, Heidelberg (2009), http://www.springer.com/engineering/book/978-3-642-00313-4 CrossRefGoogle Scholar
  2. 2.
    Gallagher, M.: Learning to play pac-man: An evolutionary, rule-based approach. In: CEC 2003, The 2003 Congress on Evolutionary Computation, pp. 2462–2469. IEEE, Los Alamitos (2003)CrossRefGoogle Scholar
  3. 3.
    Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. The MIT Press, Cambridge (1992)zbMATHGoogle Scholar
  4. 4.
    Lucas, S.: Ms Pac-Man Competition (September 2009), http://cswww.essex.ac.uk/staff/sml/pacman/PacManContest.html
  5. 5.
    Lucas, S.: Ms Pac-Man Competition - IEEE CIG 2009 (September 2009), http://cswww.essex.ac.uk/staff/sml/pacman/CIG2009Results.html
  6. 6.
    Lucas, S.: Ms Pac-Man versus Ghost-Team Competition. (September 2009), http://csee.essex.ac.uk/staff/sml/pacman/kit/AgentVersusGhosts.html
  7. 7.
    Lucas, S.: Evolving a neural network location evaluator to play ms. pac-man. In: IEEE Symposium on Computational Intelligence and Games, pp. 203–210 (2005)Google Scholar
  8. 8.
    O’Neill, M., Ryan, C.: Grammatical Evolution: Evolutionary Automatic Programming in a Arbitrary Language. Kluwer Academic Publishers, Dordrecht (2003), http://www.wkap.nl/prod/b/1-4020-7444-1 zbMATHGoogle Scholar
  9. 9.
    O’Neill, M., Hemberg, E., Gilligan, C., Bartley, E., McDermott, J., Brabazon, A.: GEVA - grammatical evolution in java (v 1.0). Tech. rep., UCD School of Computer Science (2008)Google Scholar
  10. 10.
    Szita, I., Lõrincz, A.: Learning to play using low-complexity rule-based policies: illustrations through ms. pac-man. J. Artif. Int. Res. 30(1), 659–684 (2007)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Edgar Galván-López
    • 1
  • John Mark Swafford
    • 1
  • Michael O’Neill
    • 1
  • Anthony Brabazon
    • 1
  1. 1.Natural Computing Research & Applications GroupUniversity College DublinIreland

Personalised recommendations