Abstract
This paper is concerned with state feedback controller design using neural networks for nonlinear optimal regulator problem. Nonlinear optimal feedback control law can be synthesized by solving the Hamilton-Jacobi equation with three layered neural networks. The Hamilton-Jacobi equation generates the value function by which the optimal feedback law is synthesized. To obtain an approximate solution of the Hamilton-Jacobi equation, we solve an optimization problem by the gradient method, which determines connection weights and thresholds in the neural networks. Gradient functions are calculated explicitly by the Lagrange multiplier method and used in the learning algorithm of the networks. We propose also a device such that an approximate solution to the Hamilton-Jacobi equation converges to the true value function. The effectiveness of the proposed method was confirmed with simulations for various plants.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beard, R.W., Saridis, G.N. and Wen, J.T. (1997), Galerkin Approximations of the Generalized Hamilton-Jacobi-Bellman Equation, Automatica, Vol. 33, No. 12, pp. 2159–2177.
Doya, K. (2000), Reinforcement Learning in Continuous Time and Space, Neural Computation, Vol.12, pp. 219–245.
Goh, C.J. (1993), On the Nonlinear Optimal Regulator Problem, Automatica, Vol. 29, No. 3, pp. 751–756.
Isidori, A. (1989), Nonlinear Control Systems: An Introduction, Springer-Verlag.
Kucera, V. (1972), A Contribution to Matrix Quadratic Equations, IEEE Trans. Automatic Control, pp. 344–347.
Lee, H.W.J., Teo, K.L. and Yan, W.Y. (1996), Nonlinear Optimal Feedback Control Law for a Class of Nonlinear Systems, Neural Parallel & Scientific Computations 4, pp. 157–178.
Lukes, D.L. (1969), Optimal Regulation of Nonlinear Dynamical Systems, SIAM. J. Control, Vol. 7, No. 1, pp. 75–100.
Saridis, G.N. and Balaram, J. (1986), Suboptimal Control for Nonlinear System, Control Theory and Advanced Technology, Vol. 2, No. 3, pp. 547–562.
van der Schaft, A. (1996), L2 Gain and Passivity Techniques in Nonlinear Control, Lecture Notes in Control and Information Science 218, Springer.
Shimizu, K. (1994), Optimal Control-Theory and Algorithms, Chap. 10.
Suzuki, M. and Shimizu, K. (1990), Analysis of Distributed Systems by Array Algebra, Int. J. of Systems Science, Vol. 21, No. 1, pp. 129–155
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer Science+Business Media, Inc.
About this paper
Cite this paper
Shimizu, K. (2005). A Solution to Hamilton-Jacobi Equation by Neural Networks and Optimal State Feedback Control. In: Qi, L., Teo, K., Yang, X. (eds) Optimization and Control with Applications. Applied Optimization, vol 96. Springer, Boston, MA. https://doi.org/10.1007/0-387-24255-4_22
Download citation
DOI: https://doi.org/10.1007/0-387-24255-4_22
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-24254-5
Online ISBN: 978-0-387-24255-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)