Abstract
In this chapter, a novel ADP algorithm is developed to solve the nearly optimal finite-horizon control problem for a class of deterministic nonaffine nonlinear time-delay systems. The idea is to use ADP technique to obtain the nearly optimal control which makes the optimal performance index function close to the greatest lower bound of all performance index functions within finite time. The proposed algorithm contains two cases with respective different initial iterations. In the first case, there exists control policy which makes arbitrary state of the system reach to zero in one time step. In the second case, there exists a control sequence which makes the system reach to zero in multiple time steps. The state updating is used to determine the optimal state. Convergence analysis of the performance index function is given. Furthermore, the relationship between the iteration steps and the length of the control sequence is presented. Two neural networks are used to approximate the performance index function and compute the optimal control policy for facilitating the implementation of ADP iteration algorithm. At last, two examples are used to demonstrate the effectiveness of the proposed ADP iteration algorithm.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Niculescu, S.: Delay Effects on Stability: A Robust Control Approach. Springer, Berlin (2001)
Gu, K., Kharitonov, V., Chen, J.: Stability of Time-Delay Systems. Birkhäuser, Boston (2003)
Song, R., Zhang, H., Luo, Y., Wei, Q.: Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming. Neurocomputing 73(16–18), 3020–3027 (2010)
Huang, J., Lewis, F.: Neural-network predictive control for nonlinear dynamic systems with time-delay. IEEE Trans. Neural Netw. 14(2), 377–389 (2003)
Chyung, D.: On the controllability of linear systems with delay in control. IEEE Trans. Autom. Control 15(2), 255–257 (1970)
Phat, V.: Controllability of discrete-time systems with multiple delays on controls and states. Int. J. Control 49(5), 1645–1654 (1989)
Chyung, D.: Discrete optimal systems with time delay. IEEE Trans. Autom. Control 13(1), 117 (1968)
Chyung, D., Lee, E.: Linear optimal systems with time delays. SIAM J. Control 4(3), 548–575 (1966)
Wang, F., Jin, N., Liu, D., Wei, Q.: Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with \(\epsilon \)-error bound. IEEE Trans. Neural Netw. 22, 24–36 (2011)
Manu, M., Mohammad, J.: Time-Delay Systems Analysis, Optimization and Applications. North-Holland, New York (1987)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 Science Press, Beijing and Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Song, R., Wei, Q., Li, Q. (2019). Nearly Finite-Horizon Optimal Control for Nonaffine Time-Delay Nonlinear Systems. In: Adaptive Dynamic Programming: Single and Multiple Controllers. Studies in Systems, Decision and Control, vol 166. Springer, Singapore. https://doi.org/10.1007/978-981-13-1712-5_3
Download citation
DOI: https://doi.org/10.1007/978-981-13-1712-5_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1711-8
Online ISBN: 978-981-13-1712-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)