Skip to main content

A Probabilistic Relational Model for Characterizing Situations in Dynamic Multi-Agent Systems

  • Conference paper
Data Analysis, Machine Learning and Applications

Abstract

Artificial systems with a high degree of autonomy require reliable semantic information about the context they operate in. State interpretation, however, is a difficult task. Interpretations may depend on a history of states and there may be more than one valid interpretation. We propose a model for spatio-temporal situations using hidden Markov models based on relational state descriptions, which are extracted from the estimated state of an underlying dynamic system. Our model covers concurrent situations, scenarios with multiple agents, and situations of varying durations. To evaluate the practical usefulness of our model, we apply it to the concrete task of online traffic analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • ANDERSON, C. R., DOMINGOS, P. and WELD, D. A. (2002): Relational Markov models and their application to adaptive web navigation. Proc. of the International Conference on Knowledge Discovery and Data Mining (KDD).

    Google Scholar 

  • COCORA, A., KERSTING, K., PLAGEMANN, C. and BURGARD, W. and DE RAEDT, L. (2006): Learning Relational Navigation Policies. Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

    Google Scholar 

  • COLLETT, T., MACDONALD, B. and GERKEY, B. (2005): Player 2.0: Toward a Practi-cal Robot Programming Framework. In: Proceedings of the Australasian Conference on Robotics and Automation (ACRA 2005).

    Google Scholar 

  • DEAN, T. and KANAZAWA, K. (1989): A Model for Reasoning about Persistence and Cau-sation. Computational Intelligence, 5(3):142-150.

    Article  Google Scholar 

  • DURBIN, R., EDDY, S., KROGH, A. and MITCHISON, G. (1998):Biological Sequence Anal-ysis. Cambridge University Press.

    Google Scholar 

  • FERN, A. and GIVAN, R. (2004): Relational sequential inference with reliable observations. Proc. of the International Conference on Machine Learning.

    Google Scholar 

  • JEFFREYS, H. (1961): Theory of Probability (3rd ed.). Oxford University Press.

    Google Scholar 

  • KASS, R. and RAFTERY, E. (1995): Bayes Factors. Journal of the American Statistical As-sociation, 90(430):773-795.

    Article  MATH  Google Scholar 

  • KERSTING, K., DE RAEDT, L. and RAIKO, T. (2006): Logical Hidden Markov Models. Journal of Artificial Intelligence Research.

    Google Scholar 

  • MANNING, C.D. and SCHÃœTZE, H. (1999): Foundations of Statistical Natural Language Processing. The MIT Press.

    Google Scholar 

  • RABINER, L. (1989): A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-286.

    Article  Google Scholar 

  • ESPIÉ, E. and GUIONNEAU, C. TORCS- The Open Racing Car Simulator. http://torcs.sourceforge.net

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Meyer-Delius, D., Plagemann, C., von Wichert, G., Feiten, W., Lawitzky, G., Burgard, W. (2008). A Probabilistic Relational Model for Characterizing Situations in Dynamic Multi-Agent Systems. In: Preisach, C., Burkhardt, H., Schmidt-Thieme, L., Decker, R. (eds) Data Analysis, Machine Learning and Applications. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78246-9_32

Download citation

Publish with us

Policies and ethics