Explaining Traffic Situations – Architecture of a Virtual Driving Instructor

  • Martin K. H. Sandberg
  • Johannes RehmEmail author
  • Matej Mnoucek
  • Irina Reshodko
  • Odd Erik Gundersen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12149)


Intelligent tutoring systems become more and more common in assisting human learners. Distinct advantages of intelligent tutoring systems are personalized teaching tailored to each student, on-demand availability not depending on working hour regulations and standardized evaluation not subjective to the experience and biases of human individuals. A virtual driving instructor that supports driver training in a virtual world could conduct on-demand personalized teaching and standardized evaluation. We propose an architectural design of a virtual driving instructor system that can comprehend and explain complex traffic situations. The architecture is based on a multi-agent system capable of reasoning about traffic situations and explaining them at an arbitrary level of detail in real-time. The agents process real-time data to produce instances of concepts and relations in an ever-evolving knowledge graph. The concepts and relations are defined in a traffic situation ontology. Finally, we demonstrate the process of reasoning and generating explanations on an overtake scenario.


Virtual driving instructor Intelligent Tutoring System Situation awareness Multi-agent system Ontology First order logic Explanations 


  1. 1.
    Arroyo, E., Sullivan, S., Selker, T.: CarCOACH: a polite and effective driving COACH. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 357–362 (2006).
  2. 2.
    Backlund, P., Engström, H., Johannesson, M., Lebram, M.: Games for traffic education: an experimental study of a game-based driving simulator. Simul. Gaming 41(2), 145–169 (2010). Scholar
  3. 3.
    Buechel, M., Hinz, G., Ruehl, F., Schroth, H., Gyoeri, C., Knoll, A.: Ontology-based traffic scene modeling, traffic regulations dependent situational awareness and decision-making for automated vehicles. In: 2017 IEEE Intelligent Vehicles Symposium (IV), vol. 7, pp. 1471–1476. IEEE, June 2017.
  4. 4.
    Chen, B., Cheng, H.H.: A review of the applications of agent technology in traffic and transportation systems. IEEE Trans. Intell. Transp. Syst. 11(2), 485–497 (2010). Scholar
  5. 5.
    Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37(1), 32–64 (1995). Scholar
  6. 6.
    Gatt, A., Krahmer, E.: Survey of the state of the art in natural language generation: core tasks, applications and evaluation. CoRR abs/1703.09902 (2017)Google Scholar
  7. 7.
    Gilpin, L.H., Bau, D., Yuan, B.Z., Bajwa, A., Specter, M., Kagal, L.: Explaining explanations: an overview of interpretability of machine learning. In: Proceedings of the 2018 IEEE 5th International Conference on Data Science and Advanced Analytics. DSAA 2018, pp. 80–89 (2019).
  8. 8.
    Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)zbMATHGoogle Scholar
  9. 9.
    Gunning, D., Aha, D.W.: DARPA’s explainable artificial intelligence program. AI Mag. 40(2), 44–58 (2019)CrossRefGoogle Scholar
  10. 10.
    Gutierrez, G., Iglesias, J.A., Ordoñez, F.J., Ledezma, A., Sanchis, A.: Agent-based framework for advanced driver assistance systems in urban environments. In: FUSION 2014–17th International Conference on Information Fusion (2014)Google Scholar
  11. 11.
    Hagras, H.: Toward human-understandable, explainable AI. Computer 51(9), 28–36 (2018). Scholar
  12. 12.
    Matheus, C.J., Kokar, M.M., Baclawski, K.: A core ontology for situation awareness. In: Proceedings of the 6th International Conference on Information Fusion, FUSION 2003, vol. 1, pp. 545–552 (2003).
  13. 13.
    McAree, O., Aitken, J.M., Veres, S.M.: Towards artificial situation awareness by autonomous vehicles. IFAC-PapersOnLine 50(1), 7038–7043 (2017). Scholar
  14. 14.
    Meiring, G.A.M., Myburgh, H.C.: A review of intelligent driving style analysis systems and related artificial intelligence algorithms. Sensors (Switzerland) 15(12), 30653–30682 (2015). Scholar
  15. 15.
    Oulhaci, M.A., Tranvouez, E., Espinasse, B., Fournier, S.: Intelligent tutoring systems and serious game for crisis management: a multi-agents integration architecture. In: Proceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, WETICE, pp. 253–258 (2013).
  16. 16.
    Raptis, D., Iversen, J., Mølbak, T.H., Skov, M.B.: Dara: assisting drivers to reflect on how they hold the steering wheel. In: ACM International Conference Proceeding Series, pp. 1–12 (2018).
  17. 17.
    Sipele, O., Zamora, V., Ledezma, A., Sanchis, A.: Advanced driver’s alarms system through multi-agent paradigm. In: 2018 3rd IEEE International Conference on Intelligent Transportation Engineering. ICITE 2018, pp. 269–275 (2018).
  18. 18.
    Sukthankar, R., Hancock, J., Pomerleau, D., Thorpe, C.: A simulation and design system for tactical driving algorithms. In: Proceedings of AI, Simulation and Planning in High Autonomy Systems, vol. 6 (1996)Google Scholar
  19. 19.
    Weevers, I., Kuipers, J., Brugman, A.O., Zwiers, J., van Dijk, E.M.A.G., Nijholt, A.: The virtual driving instructor creating awareness in a multiagent system. In: Xiang, Y., Chaib-draa, B. (eds.) AI 2003. LNCS, vol. 2671, pp. 596–602. Springer, Heidelberg (2003). Scholar
  20. 20.
    Nkambou, R., Bourdeau, J., Mizoguchi, R.: Advances in Intelligent Tutoring Systems. Studies in Computational Intelligence. Springer, Heidelberg (2010). Scholar
  21. 21.
    Zamora, V., Sipele, O., Ledezma, A., Sanchis, A.: Intelligent agents for supporting driving tasks: an ontology-based alarms system. In: VEHITS 2017 - Proceedings of the 3rd International Conference on Vehicle Technology and Intelligent Transport Systems, pp. 165–172 (2017).
  22. 22.
    Zhao, L., Ichise, R., Yoshikawa, T., Naito, T., Kakinami, T., Sasaki, Y.: Ontology-based decision making on uncontrolled intersections and narrow roads. In: Proceedings of the IEEE Intelligent Vehicles Symposium, vol. 2015-Augus, pp. 83–88. IEEE (2015).

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Martin K. H. Sandberg
    • 1
  • Johannes Rehm
    • 1
    • 2
    Email author
  • Matej Mnoucek
    • 1
  • Irina Reshodko
    • 2
  • Odd Erik Gundersen
    • 1
  1. 1.Department of Computer ScienceNorwegian University of Science and TechnologyTrondheimNorway
  2. 2.Way ASTrondheimNorway

Personalised recommendations