Learning Models of Other Agents Using Influence Diagrams

  • Dicky Suryadi
  • Piotr J. Gmytrasiewicz
Part of the CISM International Centre for Mechanical Sciences book series (CISM, volume 407)


We adopt decision theory as a descriptive paradigm to model rational agents. We use influence diagrams as a modeling representation of agents, which is used to interact with them and to predict their behavior. We provide a framework that an agent can use to learn the models of other agents in a multi-agent system (MAS) based on their observed behavior. Since the correct model is usually not known with certainty our agents maintain a number of possible models and assign them probabilities of being correct. When none of the available models is likely to be correct, we modify one of them to better account for the observed behaviors. The modification refines the parameters of the influence diagram used to model the other agent’s capabilities, preferences, or beliefs. The modified model is then allowed to compete with the other models and the probability assigned to it being correct can be arrived at based on how well it predicts the observed behaviors of the other agent.


Utility Function Decision Node Learning Agent Influence Diagram Neural Network Learning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bond, A. H., and Gasser, L. (1988). Readings in Distributed Artificial Intelligence. San Mateo, CA: Morgan Kaufmann Publishers.Google Scholar
  2. Carmel, D., and Markovitch, S. (1996). Learning models of intelligent agents. AAAI/IAAI 1:62–67.Google Scholar
  3. Cooper, G. H., and Herskovits, E. H. (1992). A bayesian method for the induction of probabilistic networks from data. Machine Learning 9:309–347.MATHGoogle Scholar
  4. Gmytrasiewicz, P. J., and Durfee, E. H. (1995). A rigorous, operational formalization of recursive modeling. In Proceedings of the First International Conference on Multi-Agent Systems (ICMAS), 125–132.Google Scholar
  5. Gmytrasiewicz, P. J., and Durfee, E. H. (1998). Rational interaction in multiagent environments: coordination. Submitted for publication, available at.Google Scholar
  6. Gmytrasiewicz, P. J., Durfee, E. H., and Wehe, D. K. (1991). A decision-theoretic approach to coordinating multiagent interactions. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, 166–172.Google Scholar
  7. Gmytrasiewicz, P. J. (1996). An approach to user modeling in decision support systems. In Proceedings of the Fifth International Conference on User Modeling, 121–127.Google Scholar
  8. Haykin, S. (1994). Neural Network: A Comprehensive Foundation. New York: Macmillan College Publishing Company.MATHGoogle Scholar
  9. Howard, R. A., and Matheson, J. E. (1984). Influence diagrams (article dated 1981).Google Scholar
  10. Howard, R.A. and Matheson, J.E. (Eds.), Readings on the principles and applications of decision analysis 2:719–762.Google Scholar
  11. Kaminka, G., Tambe, M., and Hopper, C. (1998). The role of agent-modeling in agent robustness. In Proceedings of the Conference on AI Meets the Real World.Google Scholar
  12. Keeney, R. L., and Raiffa, H. (1976). Decisions with Multiple Objectives: Preferences and Value Tradeoffs. New York: Wiley.Google Scholar
  13. Noh, S., and Gmytrasiewicz, P. J. (1997). Agent modeling in antiair defense. In Proceedings of the Sixth International Conference on User Modeling, 389–400.Google Scholar
  14. Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kauffman.Google Scholar
  15. Russell, S. J., and Norvig, P. (1995). Artificial Intelligence: A Modern Approach. Englewood Cliffs, NJ: Prentice-Hall.MATHGoogle Scholar
  16. Vidal, J. M., and Durfee, E. H. (1995). Recursive agent modeling using limited rationality. In Proceedings of the First International Conference on Multi-Agent Systems (ICMAS), 376–383.Google Scholar
  17. Widrow, B., and Hoff Jr., M. E. (1960). Adaptive switching circuits. IRE WESCON Convention Record 96–104.Google Scholar

Copyright information

© Springer Science+Business Media New York 1999

Authors and Affiliations

  • Dicky Suryadi
    • 1
  • Piotr J. Gmytrasiewicz
    • 1
  1. 1.Department of Computer Science and EngineeringUniversity of Texas at ArlingtonUSA

Personalised recommendations