Associative Learning for Enhancing Autonomous Bots in Videogame Design

  • Sergio MorenoEmail author
  • Manuel G. Bedia
  • Francisco J. Serón
  • Luis Fernando Castillo
  • Gustavo Isaza
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 217)


The Today’s video games are highly technologically advanced, giving users the ability to step into virtual realities and play games from the viewpoint of highly complex characters. Most of the current efforts in the development of believable bots in videogames — bots that behave like human players — are based on classical AI techniques. Specifically, we design virtual bots using Continuous-Time Recurrent Neural Network (CTRNNs) as the controllers of the non-player characters, and we add a learning module to make an agent be capable of re-learning during its lifetime. Agents controlled by CTRNNs are evolved to search for the base camp and the enemy’s camp and associate them with one of two different altitudes depending on experience.We analyze the best-evolved agent’s behavior and explain how it arises from the dynamics of the coupled agent-environment system. The ultimate goal of the contest would be to develop a computer game bot able to behave the same way humans do.


Video Game Associative Learn Recurrent Neural Network Action Video Game Base Camp 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Beer, R.D.: On the dynamics of small continuous-time recurrent neural networks. Adaptative Behavior 3(4), 459–509 (1995a)MathSciNetGoogle Scholar
  2. 2.
    Harvey, I., Di Paolo, E., Wood, R., Quinn, M., Tuci, E.A.: Evolutionary robotics: A new scientific tool for studying cognition. Artificial Life 11(1-2), 79–98 (2005)CrossRefGoogle Scholar
  3. 3.
    Jakobi, N.: Minimal Simulations For Evolutionary Robotics. PhD thesis. COGS, University of Sussex (1998)Google Scholar
  4. 4.
    Collins, R.J., Jefferson, D.R.: Representations for artificial organisms. In: Meyer, J.-A., Roitblat, H., Wilson, S. (eds.) From Animals to Animats 1: Proceedings of the Second International Conference on the Simulation of Adaptive Behavior, pp. 382–390. MIT Press, Cambridge (1991)Google Scholar
  5. 5.
    Werner, G.M., Dyer, M.G.: Evolution of communication in artificial organisms. In: Langton, C.G., Taylor, C., Farmer, J.D., Rasmussen, S. (eds.) Artificial Life II, pp. 659–687. Addison-Wesley, Reading (1991)Google Scholar
  6. 6.
    Beer, R.D., Gallagher, J.: Evolving Dynamical Neural Networks for Adaptive Behavior. Adaptive Behavior 1(1), 91–122 (1992)CrossRefGoogle Scholar
  7. 7.
    Miller, G.F., Cliff, D.: Protean behavior in dynamic games: Arguments for the coevolution of pursuit-evasion tactics. In: Cliff, D., Husbands, P., Meyer, J., Wilson, S. (eds.) From Animals to Animats 3: Proceedings of the Second International Conference on the Simulation of Adaptive Behavior, pp. 411–420. MIT Press, Cambridge (1994)Google Scholar
  8. 8.
    Funahashi, K., Nakamura, Y.: Approximation of dynamical systems by continuous time recurrent neural networks. Neural Networks 6, 801–806 (1993)CrossRefGoogle Scholar
  9. 9.
    Xu, J.-X., Deng, X., Ji, D.: Study on C. elegans behaviors using recurrent neural network model. In: 2010 IEEE Conference on Cybernetics and Intelligent Systems (CIS), June 28-30, pp. 1–6 (2010), doi:10.1109/ICCIS.2010.5518591Google Scholar
  10. 10.
    Ruiz, S.M., Bedia, M.G., Castillo, L.F., Isaza, G.A.: Navigation and obstacle avoidance in an unstructured environment Videogame through recurrent neural networks continuous time (CTRNN). In: 2012 7th Colombian Computing Congress (CCC), October 1-5, pp. 1–6 (2012), doi:10.1109/ColombianCC.2012.6398004Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Sergio Moreno
    • 1
    Email author
  • Manuel G. Bedia
    • 1
  • Francisco J. Serón
    • 2
  • Luis Fernando Castillo
    • 3
  • Gustavo Isaza
    • 3
  1. 1.Departamento de Ciencias de la ComputaciónUniversidad de ZaragozaZaragozaSpain
  2. 2.Departamento de Sistema e InformáticaUniversidad de CaldasManizalesColombia
  3. 3.Departamento de Ing. IndustrialUniversidad Nacional de Colombia Sede ManizalesManizalesColombia

Personalised recommendations