Agent-based simulation to analyze business office activities using reinforcement learning

  • Yukinao Kenjo
  • Takashi Yamada
  • Takao Terano
Part of the Springer Series on Agent Based Social Systems book series (ABSS, volume 6)


This paper attempts to clarify team behavior in cooperative organizations by agent-based simulations. We focus attention on both the roles of manages and the initiatives of staffs, and then model them using agent-based model concepts. This enables us to investigate phenomena in organizations at micro-level and macro-level. Besides, we formulate the task processing of each member in real organizations as learning for maze problem. The advantages of applying maze problem for our simulation model are as follows: It is possible to describe agents who acquire skills by reinforcement learning and to represent environmental uncertainty by changing block placements dynamically. Several computational experiments show what the whole organization behaves from microscopic points of view. At the same time, the authors confirm that the ability to adapt environments under uncertainty is different from the characters of organization.


Reinforcement Learning Task Processing Middle Management Environmental Uncertainty Work Content 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Axelrod R (1997) The complexity of cooperation: agent-based models of competition and collaboration. Princeton University Press, New JerseyGoogle Scholar
  2. 2.
    Axelrod R, Cohen M D (2000) Harnessing complexity: organizational implications of a scientific frontier. Free Press, New York.Google Scholar
  3. 3.
    Carley K M (1995) Computational and mathematical organization theory: perspective and directions. Compu. and Math. Org. Th. 1: 39–56CrossRefGoogle Scholar
  4. 4.
    Carley K M, Gasser L (1999) Computational organization theory. in Weiss, G. (ed.): Multiagent systems — a modern approach to distributed artificial intelligence. MIT Press, Cambridge, Massachusetts London, England, 299–330Google Scholar
  5. 5.
    Chang M-H, Harrington JR J E (2006) Agent-based simulation of organization, in Tesfatsion, L., Judd, K.L. (eds.) Handbook of computational economics: agent-based computational economics volume 2, North-Holland, Netherlands, 1273–1337Google Scholar
  6. 6.
    Cohen M D, March J G (1972) A garbage can model of organizational choice. Administrative Sci. Quart. 17: 1–25CrossRefGoogle Scholar
  7. 7.
    Cyert R M, March J G (1963) A behavioral theory of the firm. Prentice-Hall NJGoogle Scholar
  8. 8.
    Epstein J M, Axtell R L (1996) Growing artificial societies: social science from the bottom up. MIT Press, Washington, DCGoogle Scholar
  9. 9.
    Takahashi N (1992) An evaluation of organizational activation. Omega: Int. J. Manag. Sci. 20: 149–159CrossRefGoogle Scholar

Copyright information

© Springer 2009

Authors and Affiliations

  • Yukinao Kenjo
    • 1
  • Takashi Yamada
    • 1
  • Takao Terano
    • 1
  1. 1.Department of Computational Intelligence and System ScienceTokyo Institute of Technology (Now at Sony Corporation)Yokohama, KanagawaJapan

Personalised recommendations