Modeling Agents and Agent Systems

  • Theodor Lettmann
  • Michael Baumann
  • Markus Eberling
  • Thomas Kemmerich
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6910)


In present agent definitions, we often find different names and definitions for similar concepts. Many works on multiagent systems use abstract and informal descriptions to introduce the topic. Even books on multiagent systems often lack a formal definition or use a self-contained formalism. Our goal is to present a universal and formal description for agent systems that can be used as a core model with other existing models as special cases. This core model allows clear specification of agent systems and their properties. Design decisions are made explicitly and, by that, become a mean of comparison for different approaches. The proposed definitions for single- and multiagent systems address all basic properties while leaving space for extensions and can thus be used to talk about concepts using a homogeneous notation. The comparisons of our definition to existing models show that the most-cited descriptions can be expressed with our formalism which shows that there is a basic consensus on fundamental properties of agent systems.


Internal State Multiagent System Agent System Markov Decision Process Intelligent Agent 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baker, J.E.: Reducing bias and inefficiency in the selection algorithm. In: Grefenstette, J.J. (ed.) Proceedings of the Second International Conference on Genetic Algorithms and their Application, ICGA 1987, pp. 14–21. Lawrence Erlbaum Associates, Mahwah (1987)Google Scholar
  2. 2.
    Bernstein, D.S., Amato, C., Hansen, E.A., Zilberstein, S.: Policy iteration for decentralized control of markov decision processes. Journal of Artificial Intelligence Research (JAIR) 34, 89–132 (2009)zbMATHMathSciNetGoogle Scholar
  3. 3.
    Buşoniu, L., Babuška, R., De Schutter, B.: A comprehensive survey of multiagent reinforcement learning. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38(2), 156–172 (2008)CrossRefGoogle Scholar
  4. 4.
    Cellier, F.E.: Continuous System Modeling. Springer, Heidelberg (1991)CrossRefzbMATHGoogle Scholar
  5. 5.
    Encyclopædia Britannica: Agent. Website (2010), (visited on April 11, 2011)
  6. 6.
    Encyclopædia Britannica: Intelligence. Website (2010), (visited on April 11, 2011)
  7. 7.
    Ferber, J.: Multi-Agent Systems: An Introduction to Distributed Artificial Intelligence. Addison-Wesley, Longman (1999)Google Scholar
  8. 8.
    Florea, A.M.: Introduction to multi-agent systems. In: International Summer School on Multi-Agent Systems, Bucharest (1998)Google Scholar
  9. 9.
    Franklin, S., Graesser, A.C.: Is it an agent, or just a program?: A taxonomy for autonomous agents. In: Jennings, N.R., Wooldridge, M.J., Müller, J.P. (eds.) ECAI-WS 1996 and ATAL 1996. LNCS, vol. 1193, pp. 21–35. Springer, Heidelberg (1997)CrossRefGoogle Scholar
  10. 10.
    Gottfredson, L.S.: Foreword to “intelligence and social policy”. Intelligence 24(1), 1–12 (1997)CrossRefGoogle Scholar
  11. 11.
    Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101(1-2), 99–134 (1998)CrossRefzbMATHMathSciNetGoogle Scholar
  12. 12.
    Newell, A.: Reasoning, problem solving, and decision processes: The problem space as a fundamental category. In: Nickerson, R. (ed.) Attention and Performance VII, pp. 693–718. Erlbaum, Mahwah (1980)Google Scholar
  13. 13.
    Newell, A.: Unified Theories of Cognition. Harvard University Press, Harvard (1990)Google Scholar
  14. 14.
    Newell, A., Simon, H.A.: Computer science as empirical inquiry: Symbols and search. Commun. ACM 19, 113–126 (1976)CrossRefMathSciNetGoogle Scholar
  15. 15.
    Russell, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Prentice Hall, Englewood Cliffs (2010)zbMATHGoogle Scholar
  16. 16.
    Shoham, Y., Leyton-Brown, K.: Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge University Press, Cambridge (2009)zbMATHGoogle Scholar
  17. 17.
    Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)Google Scholar
  18. 18.
    Vlassis, N.: A Concise Introduction to Multiagent Systems and Distributed Artificial Intelligence. Morgan and Claypool Publishers (2007)Google Scholar
  19. 19.
    Weiss, G. (ed.): Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. MIT Press, Cambridge (1999)Google Scholar
  20. 20.
    Wikipedia: Multi-agent system – wikipedia, the free encyclopedia. Website (2010), (visited on April 11, 2011)
  21. 21.
    Wooldridge, M.: An Introduction to MultiAgent Systems, 2nd edn. Wiley, Chichester (2009)Google Scholar
  22. 22.
    Zeigler, B.P.: Multifacetted Modelling and Discrete Event Simulation. Academic Press Professional, Inc., London (1984)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Theodor Lettmann
    • 1
  • Michael Baumann
    • 2
  • Markus Eberling
    • 1
  • Thomas Kemmerich
    • 2
  1. 1.Department of Computer ScienceUniversity of PaderbornPaderbornGermany
  2. 2.International Graduate School of Dynamic Intelligent SystemsUniversity of PaderbornPaderbornGermany

Personalised recommendations