Imitation Learning in Uncertain Environments

  • Steffen Priesterjahn
  • Markus Eberling
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5199)


This paper describes a new evolutionary learning method to handle the fast adaptation of a group of agents in an uncertain environment. The method is a result of our research towards the generation of intelligent agents in computer games and is inspired by the idea of social learning or cultural evolution. Thus, the agents try to adapt by the exchange of information about advantageous behaviours within the population. This paper evaluates the new approach by addressing the generation of competitive artificial players in a real-time action game.


Computer Game Uncertain Environment Base Setup Individual Adaptation Rule Replacement 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Priesterjahn, S.: Online Adaptation and Imitation in Modern Computer Games. PhD thesis, University of Paderborn (2008)Google Scholar
  2. 2.
    Priesterjahn, S., Kramer, O., Weimer, A., Goebels, A.: Evolution of Human-Competitive Agents in Modern Computer Games. In: Proceedings of the IEEE Congress on Evolutionary Computation (CEC 2006), pp. 777–784. IEEE Press, Los Alamitos (2006)Google Scholar
  3. 3.
    Priesterjahn, S., Weimer, A.: An Evolutionary Online Adaptation Method for Modern Computer Games. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2007) (2007)Google Scholar
  4. 4.
    Conte, R., Paolucci, M.: Intelligent Social Learning. Journal of Artificial Societies and Social Simulation 4(1), U61– U82 (2001)Google Scholar
  5. 5.
    Blackmore, S.J.: The Meme Machine. Oxford University Press, Oxford (2000)Google Scholar
  6. 6.
    Miles, C., Louis, S.J., Cole, N., McDonnell, J.: Learning to Play Like a Human: Case Injected Genetic Algorithms Applied to Strategic Computer Game Playing. In: Proceedings of the IEEE Congress on Evolutionary Computation (CEC 2004) (2004)Google Scholar
  7. 7.
    Spronck, P., Ponsen, M., Sprinkhuizen-Kuyper, I., Postma, E.: Adaptive Game AI with Dynamic Scripting. Machine Learning 63(3), 217–248 (2006)CrossRefGoogle Scholar
  8. 8.
    Chielens, K., Heylighen, F.: Operationalization of Meme Selection Criteria: Methodologies to Empirically Test Memetic Predictions. In: Proceedings of the Joint Symposium on Socially Inspired Computing (AISB 2005), pp. 14–20 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Steffen Priesterjahn
    • 1
  • Markus Eberling
    • 1
  1. 1.Department of Computer ScienceUniversity of PaderbornPaderbornGermany

Personalised recommendations