Abstract
Longitudinal and lateral coupling control is essential for high-precision lane keeping of self-driving cars. Recently, the end-to-end based method, which can learn high dimensional features from driving dataset, has been a new way for lane keeping of self-driving cars. However, state-of-the-art end-to-end based solutions mostly focus on the steering prediction and neglect the coupling effects of longitudinal and lateral control. This paper proposes a 3DCNN-LSTM (3D Convolutional Neural Networks-Long Short-Term Memory) model based end-to-end learning method for longitudinal and lateral coupling lane keeping of self-driving cars. A coupling controller will be designed in TORCS for lane keeping data collection. Then, the raw dataset will be augmented for better model training. Next, a 3DCNN-LSTM model with combined steering and speed loss function is proposed for model training and validation. At last, both the offline model testing and the online driving in TORCS are designed for the end-to-end model evaluation. The experiments show the proposed end-to-end coupling model achieves higher-precision lane keeping compared with the traditional end-to-end model with only lateral prediction.
This work was supported by the National Natural Science Foundation of China (U1764264/61873165).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Lim, E.H., Hedrick, J.K.: Lateral and longitudinal vehicle control coupling for automated vehicle operation. In: 1999 Proceedings of the American Control Conference, vol. 5, pp. 3676–3680. IEEE (1999)
Bakker, E., Pacejka, H.B., Lidner, L.: A new tire model with an application in vehicle dynamics studies. SAE Trans. 101–113 (1989)
Van Zanten, A.T., Erhardt, R., Pfaff, G.: VDC, the vehicle dynamics control system of Bosch. SAE Trans. 1419–1436 (1995)
Pomerleau, D.A.: ALVINN, an autonomous land vehicle in a neural network. Carnegie Mellon University, Computer Science Department, Technical report (1989)
Abbeel, P., Ng, A.Y.: Apprenticeship learning via inverse reinforcement learning. In: Proceedings of the Twenty-First International Conference on Machine Learning, p. 1. ACM (2004)
Bojarski, M., et al.: End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316 (2016)
Yang, S., Wang, W., Liu, C., Deng, K., Hedrick, J.K.: Feature analysis and selection for training an end-to-end autonomous vehicle controller using the deep learning approach. arXiv preprint arXiv:1703.09744 (2017)
Chen, Z., Huang, X.: End-to-end learning for lane keeping of self-driving cars. In: 2017 IEEE Intelligent Vehicles Symposium (IV), pp. 1856–1860. IEEE (2017)
Yu, H., Yang, S., Gu, W., Zhang, S.: Baidu driving dataset and end-to-end reactive control model. In: 2017 IEEE Intelligent Vehicles Symposium (IV), pp. 341–346. IEEE (2017)
Ji, S., Xu, W., Yang, M., Yu, K.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 221–231 (2013)
Donahue, J., et al.: Long-term recurrent convolutional networks for visual recognition and description. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015
Xingjian, S., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., Woo, W.-C.: Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Advances in Neural Information Processing Systems, pp. 802–810 (2015)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Wymann, B., Dimitrakakis, C., Sumner, A., Espié, E., Guionneau, C., Coulom, R.: TORCS, the open racing car simulator, v1.3.5 (2013). http://www.torcs.org
Snider, J.M., et al.: Automatic steering methods for autonomous automobile path tracking. Robotics Institute, Pittsburgh, PA, Technical report, CMU-RITR-09-08 (2009)
Paden, B., Čáp, M., Yong, S.Z., Yershov, D., Frazzoli, E.: A survey of motion planning and control techniques for self-driving urban vehicles. IEEE Trans. Intell. Veh. 1(1), 33–55 (2016)
Chen, C., Seff, A., Kornhauser, A., Xiao, J.: Deepdriving: learning affordance for direct perception in autonomous driving. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2722–2730 (2015)
Kingma, D., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yuan, W., Yang, M., Wang, C., Wang, B. (2019). Longitudinal and Lateral Coupling Model Based End-to-End Learning for Lane Keeping of Self-driving Cars. In: Sun, F., Liu, H., Hu, D. (eds) Cognitive Systems and Signal Processing. ICCSIP 2018. Communications in Computer and Information Science, vol 1006. Springer, Singapore. https://doi.org/10.1007/978-981-13-7986-4_38
Download citation
DOI: https://doi.org/10.1007/978-981-13-7986-4_38
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-7985-7
Online ISBN: 978-981-13-7986-4
eBook Packages: Computer ScienceComputer Science (R0)