Abstract
This work shows the application of artificial neural networks for the control task of the roll angle in passenger cars. The training of the artificial neural network is based on the specific actor-critic reinforcement learning training algorithm. It is implemented and trained utilizing the Python API for TensorFlow and set up in a co-simulation with the vehicle simulation realized in IPG CarMaker via MATLAB/Simulink to enable online learning. Subsequently it is validated in different representative driving maneuvers. For showing the practicability of the resulting neural controller it is also validated for different vehicle classes with respect to their corresponding structure, geometries and components. An analytical approach to adjust the resulting controller to various vehicle bodies dependent on physical correlations is presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sieberg, P., Schmid, M., Reicherts, S., Schramm, D.: Computation time optimization of a model-based predictive roll stabilization by neuro-fuzzy systems. In: Bargende, M., Reuss, H.-C., Wagner, A., Wiedemann, J. (eds.) 19. Internationales Stuttgarter Symposium, pp. 499–512. Springer, Wiesbaden (2019)
Boada, M., Boada, B., Gauchia Babe, A., Calvo, J., Diaz, V.: Active roll control using reinforcement learning for a single unit heavy vehicle. Int. J. Heavy Veh. Syst. 16(4), 412–430 (2009)
Fu, Z.-J., Li, B., Ning, X.-B., Xie, W.-D.: Online Adaptive optimal control of vehicle active suspension systems using single-network approximate dynamic programming. Math. Probl. Eng. 2017 (2017). 9 p.
Bahr, M., Reicherts, S., Sieberg, P., Morss, L., Schramm, D.: Development and validation of active roll control based on actor-critic neural network reinforcement learning. In: Proceedings of the 9th International Conference on Simulation and Modeling Methodologies, Technologies and Applications, pp. 36–46. SCITEPRESS, Prague (2019)
Schramm, D., Hiller, M., Bardini, R.: Vehicle Dynamics – Modeling and Simulation, 2nd edn. Springer, Heidelberg (2018)
Ammon, D.: Modellbildung und Systementwicklung in der Fahrzeugdynamik. Vieweg+Teubner, Stuttgart (2013)
Konda, V., Tsitsiklis, J.: Actor-critic algorithms. SIAM J. Control Optim. 42(4), 1143–1166 (2003)
Sutton, R., Barto, A.: Reinforcement Learning: An Introduction, 2nd edn. The MIT Press, London (2018)
Sutton, R., McAllester, D., Singh, S., Mansour, Y.: Policy gradient methods for reinforcement learning with function approximation. In: NIPS 1999 Proceedings of the 12th International Conference on Neural Information Processing Systems, pp. 1057–1063. The MIT Press, Cambridge (1999)
Szepesvári, C.: Algorithms for Reinforcement Learning, 1st edn. Morgan & Claypool Publishers, New York (2010)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations, p. 13. arXiv.org, Ithaca New York (2015)
IPG Automotive’s Official Website. https://ipg-automotive.com/. Accessed 09 Feb 2019
MathWorks’ Official Website. https://de.mathworks.com/. Accessed 09 Feb 2019
TensorFlow’s Official Website. https://www.tensorflow.org/. Accessed 09 Feb 2019
REGULATION (EC) No 139/2004. https://ec.europa.eu/competition/mergers/cases/decisions/m5518_20090724_20310_en.pdf. Accessed 08 Dec 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Bahr, M., Reicherts, S., Sieberg, P., Morss, L., Schramm, D. (2021). Application of Artificial Neural Networks for Active Roll Control Based on Actor-Critic Reinforcement Learning. In: Obaidat, M., Ören, T., Szczerbicka, H. (eds) Simulation and Modeling Methodologies, Technologies and Applications. SIMULTECH 2019. Advances in Intelligent Systems and Computing, vol 1260. Springer, Cham. https://doi.org/10.1007/978-3-030-55867-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-55867-3_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-55866-6
Online ISBN: 978-3-030-55867-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)