Abstract
Dynamic programming (DP) is a useful tool for solving many control problems, but for its complexity in computation, traditional DP control algorithms are not satisfactory in fact. So we must look for a new method which not only has the advantages of DP but also is easier in computation. In this paper, approximate dynamic programming (ADP) based controller system has been used to solve a ship heading angle keeping problem. The ADP controller comprises successive adaptations of two neural networks, namely action network and critic network which approximates the Bellman equations associated with DP. The Simulation results show that the ship keeps the desired heading satisfactorily.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aseltine, J.A., Mancini, A.R., Sarture, C.W.: A Survey of Adaptive Control Systems. IEEE Transactions on Automatic Control, 102–108 (1958)
Arie, T., Itoh, M., Senoh, A., Takahashi, N., Fujii, S., Mizuno, N.: An Adaptive Steering System for a Ship. Control Systems Magazine 6 (1986)
Yi, J.Q., Yubazaki, N., Hirota, K.: Trajectory Tracking Control of Unconstrained Object by the SIRMs Dynamically Connected Fuzzy Inference Model. Journal of Advanced Computational Intelligence 4, 302–312 (2000)
Witt, N.A.J., Miller, K.M.: A Neural Network Autopilot for Ship Control. In: Proceedings of Maritime Communications and Control Conference, pp. 13–19 (1993)
Liu, D.: Action-Dependent Adaptive Critic Designs. In: Proceedings of International Joint Conference on Neural Networks, vol. 2, pp. 15–19 (2001)
Liu, D.: Adaptive Critic Designs for Self-Learning Ship Steering Control. In: Proceedings of the 1999 IEEE International Symposium on Intelligent Control/Intelligent Systems and Semiotics, pp. 46–51 (1999)
Cheng, J., Yi, J.Q., Zhao, D.B.: A New Fuzzy Autopilot for Way-point Tracking Control of Ships. In: Proceedings of 2006 IEEE International Conference on Fuzzy Systems, pp. 16–21 (2006)
Si, J., Wang, Y.T.: On-line Learning Control by Association and Reinforcement. IEEE Transactions on Neural Network 12 (2001)
Prokhorov, D.D., Wunsch, D.C.: Adaptive critic designs. IEEE Transactions on Neural Networks 8, 997–1007 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bai, X., Yi, J., Zhao, D. (2007). Approximate Dynamic Programming for Ship Course Control. In: Liu, D., Fei, S., Hou, ZG., Zhang, H., Sun, C. (eds) Advances in Neural Networks – ISNN 2007. ISNN 2007. Lecture Notes in Computer Science, vol 4491. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72383-7_41
Download citation
DOI: https://doi.org/10.1007/978-3-540-72383-7_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72382-0
Online ISBN: 978-3-540-72383-7
eBook Packages: Computer ScienceComputer Science (R0)