Survey of How Human Players Divert In-game Actions for Other Purposes: Towards Human-Like Computer Players

  • Sila TemsiririrkkulEmail author
  • Naoyuki Sato
  • Kenta Nakagawa
  • Kokolo Ikeda
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10507)


Human-like behaviors are an important factor in achieving entertaining computer players. So far, the target of human-like behavior has been focused on actions in a game with the goal of winning. However, human behaviors might also be performed with other purposes not directly related to the game’s main objective. For example, in FPS games, some human players create illustrations or graffiti with a weapon (i.e., gun). In co-operative online FPS, when chat is not allowed in-game, some players shoot the nearest wall to warn an ally about danger. This kind of action for an indirect purpose is hard to reproduce with a computer player, but it is very important to simulate human behavior and to entertain human players. In this article, we present a survey of the possible actions in a game that are not directly related to the game’s main objective. Study cases of these behaviors are collected and classified by task and intention (i.e., warning, notification, provocation, greeting, expressing empathy, showing off, and self-satisfaction) and we discuss the possibility of reproducing such actions with a computer player. Furthermore, we show in experiments with multi-agent Q-learning that such actions with another purpose can emerge naturally.


Human-likeness Entertainment Computer players Q-learning Multi-agent 


  1. 1.
    Silver, D., et al.: Mastering the game of go with deep neural networks and tree search. Nature 529, 484–489 (2016)CrossRefGoogle Scholar
  2. 2.
    Mnih, V., et al.: Playing atari with deep reinforcement learning. In: NIPS Deep Learning Workshop 2013 (2013)Google Scholar
  3. 3.
    Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518, 529533 (2015)CrossRefGoogle Scholar
  4. 4.
    Soni, B., et al.: Bots trained to play like a human are more fun. In: 2008 IEEE International Joint Conference on Neural Networks IJCNN 2008 (IEEE World Congress on Computational Intelligence), pp. 363–369 (2008)Google Scholar
  5. 5.
    Ikeda, K., Viennot, S.: Production of various strategies and position control for Monte-Carlo Go - entertaining human players. In: IEEE Conference on Computational Intelligence and Games (CIG2013), pp. 145–152 (2013)Google Scholar
  6. 6.
    Togelius, J., et al.: Assessing Believability Believable Bots: Can Computers Play Like People?, pp. 215–230 Springer, Heidelberg (2012)Google Scholar
  7. 7.
    Fujii, N., Sato, Y., Wakama, H., Kazai, K., Katayose, H.: Evaluating human-like behaviors of video-game agents autonomously acquired with biological constraints. In: Reidsma, D., Katayose, H., Nijholt, A. (eds.) ACE 2013. LNCS, vol. 8253, pp. 61–76. Springer, Cham (2013). doi: 10.1007/978-3-319-03161-3_5 CrossRefGoogle Scholar
  8. 8.
    Shiratori, et al.: 感情表現生成を行う仮想ゲームプレイヤ. The Society for Art and Science, Vol. 7(2), pp. 65–74 (2008). (Japanese)Google Scholar
  9. 9.
    The 2 k bot prize. Accessed 20 Apr 2017
  10. 10.
  11. 11.
    Shaker, N., et al.: The turing test track of the 2012 Mario AI championship: Entries and evaluation. In: 2013 IEEE Conference on Computational Intelligence in Games (CIG), pp. 1–8 (2013)Google Scholar
  12. 12.
    Taylor, T.L.: The Assemblage of Play. Game Cult. 4(4), 331–339 (2009)CrossRefGoogle Scholar
  13. 13.
    Turing, A.M.: Computing machinery and intelligence. Mind 59(236), 433–460 (1950)MathSciNetCrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2017

Authors and Affiliations

  • Sila Temsiririrkkul
    • 1
    Email author
  • Naoyuki Sato
    • 1
  • Kenta Nakagawa
    • 1
  • Kokolo Ikeda
    • 1
  1. 1.Japan Advanced Institute of Science and TechnologyNomiJapan

Personalised recommendations