Abstract
Traffic congestion has long been a serious problem in cities, and route planning can improve traffic efficiency. The existing route planning approach relies on current and future traffic status. However, because traffic prediction and route planning interact with each other, the actual driving results deviate from expectations, and the performance is not satisfactory. In order to solve this problem, considering the topology of road networks, this paper proposes a route planning algorithm based on generalized value iteration network (GVIN), which uses graph convolution to extract the features of traffic flow, and then imitates human routing experience under various traffic status. Finally we evaluate the performance of the proposed network on real map and trajectory data in Beijing, China. The experimental results show that GVIN can simulate the human’s routing decisions with high success rate and less commuting time.
This work was supported in part by the Natural Science Foundation of China under Grant 61876023 and Grant 61902035, and in part by the Natural Science Foundation of Beijing under Grant 4181002.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Montiel, O., Orozco-Rosas, U., Sepúlveda, R.: Path planning for mobile robots using Bacterial Potential Field for avoiding static and dynamic obstacles. Expert Syst. Appl. 42(12), 5177–5191 (2015)
Demers, A., et al.: Experimenting with real-time ATIS: stepping forward from ADVANCE (2006)
Boyce, D.: A memoir of the advance project. J. Intell. Transp. Syst. 7(2), 105–130 (2002)
Hu, W.-B., Nie, C., Qiu, Z.Y., Du, B., Yuan, Q.: A route guidance method based on quantum searching for real-time dynamic multi-intersections in urban traffic networks. Acta Electron. Sin. 46(1), 104–109 (2018)
Wan, J., Zhang, D., Zhao, S., Yang, L.T., Lloret, J.: Context-aware vehicular cyber-physical systems with cloud support: architecture, challenges, and solutions. Commun. Mag. IEEE 52(8), 106–113 (2014)
Quan, Y., Zhou, H., Li, J., Liu, Z., Shen, X.S.: Toward efficient content delivery for automated driving services: an edge computing solution. IEEE Netw. 32(1), 80–86 (2018)
Luo, G., et al.: Cooperative vehicular content distribution in edge computing assisted 5G-VANET. China Commun. 15(7), 1–17 (2018)
Yang, S., Li, J., Wang, J., Liu, Z., Yang, F.: Learning urban navigation via value iteration network. In: 2018 IEEE Intelligent Vehicles Symposium (IV), pp. 800–805 (2018)
Nazari, M., Oroojlooy, A., Snyder, L., Takac, M.: Reinforcement learning for solving the vehicle routing problem. In: Advances in Neural Information Processing Systems, vol. 31, pp. 9839–9849 (2018)
Yu, S., Zhou, J., Li, B., Mabu, S., Hirasawa, K.: Q value-based dynamic programming with SARSA learning for real time route guidance in large scale road networks. In: The 2012 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2012)
Brahmbhatt, S., Hays, J.: DeepNav: learning to navigate large cities. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3087–3096 (2017)
Li, J., et al.: A traffic prediction enabled double rewarded value iteration network for route planning. IEEE Trans. Veh. Technol. 68(5), 4170–4181 (2019)
Tamar, A., Wu, Y., Thomas, G., Levine, S., Abbeel, P.: Value iteration networks. In: Advances in Neural Information Processing Systems, vol. 29, pp. 2154–2162 (2016)
Niu, S., Chen, S., Guo, H., Targonski, C., Smith, M.C., Kovacevic, J.: Generalized value iteration networks: life beyond lattices. CoRR abs/1706.02416 (2017). http://arxiv.org/abs/1706.02416
Sutton, R., Barto, A.: Reinforcement learning: an introduction (adaptive computation and machine learning). IEEE Trans. Neural Netw. 9(5), 1054 (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, X., Yuan, Q., Liu, Z., Dong, Y., Wei, X., Li, J. (2020). Learning Route Planning from Experienced Drivers Using Generalized Value Iteration Network. In: Hsu, CH., Kallel, S., Lan, KC., Zheng, Z. (eds) Internet of Vehicles. Technologies and Services Toward Smart Cities. IOV 2019. Lecture Notes in Computer Science(), vol 11894. Springer, Cham. https://doi.org/10.1007/978-3-030-38651-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-38651-1_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-38650-4
Online ISBN: 978-3-030-38651-1
eBook Packages: Computer ScienceComputer Science (R0)