Abstract
Modelling driving dynamics in experimental educational scenarios represents a key enhancement of a SMART city, where citizen-oriented politics promote traffic rules knowledge retention and awareness. We propose an instructional design of mapping simulations of real-world urban networks as use cases for practicing traffic rules. Traffic simulations have been implemented through Reinforcement Learning agents, using a modified Policy Proximal Optimization (PPO) strategy, demonstrating a good sample efficiency. The proposed objective function and the selected policy positive and negative rewards empower the car agent to reach a predefined destination, from a predefined start position, while adapting to the route line. Results validate the applicability of the proposed approach to educational simulations, within a generic gamified environment. The approach proposes a further extension towards adaption to complex lane design (e.g. traffic signs) and player’s in-game behavior.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ingook, J., Donghun, K., Donghun, L., Youngsung, S.,: An agent-based simulation modeling with deep reinforcement learning for smart traffic signal control. In: IEEE International Conference on Information and Communication Technology Convergence, South Korea (2018)
Li, N., Oyler, D.W., Zhang, M., Yildiz, Y., Kolmanovsky, I., Girard, A.R.: Game theoretic modeling of driver and vehicle interactions for verification and validation of autonomous vehicle control systems. IEEE Trans. Control Syst. Technol. 26(5), 1782–1797 (2017)
Oyler, D.W., Yildiz, Y., Girard, A.R., Li, N.I., Kolmanovsky, I.V.: A game theoretical model of traffic with multiple interacting drivers for use in autonomous vehicle development. In: IEEE American Control Conference, pp. 1705–1710, Boston (2016)
Genders, W., Razavi, S.: Evaluating reinforcement learning state representations for adaptive traffic signal control. Proc. Comput. Sci. 130, 26–33 (2018)
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms. In: arXiv preprint arXiv:1707.06347, pp. 1–12 (2017)
Campos, C., Leitão, J., Coelho, A.: Integrated modeling of road environments for driving simulation. In: 10th International Conference on Computer Graphics Theory and Applications, pp. 70–80, Berlin (2015)
Fransman, A., Richter, B., Raath, S.: An interactive computer program for South African urban primary school children to learn about traffic signs and rules. Afr. Saf. Promot.: J. Inj. Violence Prevent. 16(1), 57–67 (2018)
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Koltun, V.: CARLA: an open urban driving simulator. In: arXiv preprint arXiv:1711.03938, pp. 1–16 (2016)
Paden, B., Cap, M., Yong, S., Yershov, D., Frazzoli, E.: A survey of motion planning and control techniques for self-driving urban vehicles. IEEE Trans. Intell. Veh. 1(1), 33–55 (2016)
Jraidi, I., Chalfoun, P., Frasson, C.: Implicit strategies for intelligent tutoring systems. In: International Conference on Intelligent Tutoring Systems, pp. 1–10 (2012)
Isele, D., Rahimi, R., Cosgun, A., Subramanian, K., Fujimura, K.: Navigating occluded intersections with autonomous vehicles using deep reinforcement learning. In: IEEE International Conference on Robotics and Automation, pp. 2034–2039, Brisbane (2018)
Mirowski, P., et al.: Learning to navigate in cities without a map. In: arXiv:1804.00168 (2018)
Oyer, W., Yildiz, Y., Girard, A., Li, N., Kolmanovsky, I.: A game theoretical model of traffic with multiple interacting drivers for use in autonomous vehicle development. In: Codevilla, F., Miiller, M., López, A., Koltun, V., Dosovitskiy, A. (eds.) American Control Conference on End-to-end Driving via Conditional Imitation Learning, Boston (2016). In: IEEE International Conference on Robotics and Automation, pp. 1–9, Brisbane (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Vajdea, B., Ciupe, A., Orza, B., Meza, S. (2020). Educational Driving Through Intelligent Traffic Simulation. In: Kumar, V., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2020. Lecture Notes in Computer Science(), vol 12149. Springer, Cham. https://doi.org/10.1007/978-3-030-49663-0_52
Download citation
DOI: https://doi.org/10.1007/978-3-030-49663-0_52
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49662-3
Online ISBN: 978-3-030-49663-0
eBook Packages: Computer ScienceComputer Science (R0)