Playing to Train Your Video Game Avatar

  • Ronan Le Hy
  • Pierre Bessiére
Part of the Springer Tracts in Advanced Robotics book series (STAR, volume 46)


Today’s video games feature synthetic characters involved in complex interactions with human players. A synthetic character may have one of many different roles: a tactical enemy, a partner for the human player, a strategic opponent, a simple unit among many, or a substitute for the player when he or she is unavailable.

In all of these cases, the game developer’s ultimate objective is for the synthetic character to act as if it were controlled by a human player. This implies the illusion of spatial reasoning, memory, commonsense reasoning, using goals, tactics, planning, communication and coordination, adaptation, unpredictability, and so on. In current commercial games, basic gesture and motion behaviours are generally satisfactory. More complex behaviours usually look much less lifelike. Sequencing elementary behaviours is an especially difficult problem, as compromises must be made between too-systematic behaviour that looks automatic and too-random behaviour that looks ridiculous.


Video Game Reactive Behaviour Spatial Reasoning Behaviour Selection Human Player 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Baum, L.: An inequality and associated maximization technique in statistical estimation for probabilistic functions of markov processes. Inequalities 3, 1–8 (1972)Google Scholar
  2. Dempster, A., Laird, N., Rubin, D.: Maximum likelihood from incomplete data via the em algorithm. J. Roy. Stat. Soc., Ser. B 39, 1–38 (1977)zbMATHMathSciNetGoogle Scholar
  3. Florez-Larrahondo, G.: Incremental Learning of Discrete Hidden Markov Models. PhD thesis, Mississippi State University (2005)Google Scholar
  4. Kaminka, G., Veloso, M., Schaffer, S., Sollitto, C., Adobbati, R., Marshal, A., Scholer, A., Tejada, S.: Gamebots: the ever-challenging multi-agent research test-bed. In: Communications of the ACM (January 2002)Google Scholar
  5. Le Hy, R., Arrigoni, A., Bessière, P., Lebeltel, O.: Teaching bayesian behaviors to video game characters. Robotics and Autonomous Systems 47, 177–185 (2004)CrossRefGoogle Scholar
  6. Rabiner, L.: A tutorial on hidden markov models and selected applications in speech recognition. In: IEEE, editor, Proceedings of the IEEE, vol. 77(2), pp. 257–295 (1989)Google Scholar
  7. Woodcock, S.: Game AI: the state of the industry 2000–2001. In: Game Developer (August 2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Ronan Le Hy
    • 1
  • Pierre Bessiére
    • 2
  1. 1.INPG – LIG Lab 
  2. 2.CNRS – Grenoble Université 

Personalised recommendations