Skip to main content
SpringerLink
Log in

Event-Triggered Adaptive Dynamic Programming for Uncertain Nonlinear Systems

  • Conference paper
  • First Online:
Book cover Cognitive Systems and Signal Processing (ICCSIP 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 710))

Included in the following conference series:

Abstract

In this paper, the robust control for a class of continuous-time nonlinear system with unmatched uncertainties is investigated using an event-triggered adaptive dynamic programming method. First, the robust control problem is solved using the optimal control method. Under the event-triggered mechanism, the solution of the optimal control problem can asymptotically stabilize the uncertain system with an designed triggering condition. That is, the designed event-triggered controller is robust to the original uncertain system. Then, a single critic network structure with experience replay technique is constructed to approach the optimal control policies. Finally, a simulation example is provided to demonstrate the effectiveness of the proposed control scheme.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lin, F., Brandt, R.D., Sun, J.: Robust control of nonlinear systems: compensating for uncertainty. Int. J. Control 56(6), 1453–1459 (1992)

    Article  MathSciNet  MATH  Google Scholar 

  2. Lin, F.: An optimal control approach to robust control design. Int. J. Control 73(3), 177–186 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  3. Lewis, F.L., Liu, D.: Reinforcement Learning and Approximate Dynamic Programming for Feedback Control. Wiley, New Jersey (2013)

    Google Scholar 

  4. Werbos, P.J.: Advanced forecasting methods for global crisis warning and models of intelligence. Gen. Syst. Yearb. 22(12), 25–38 (1977)

    Google Scholar 

  5. Abu-Khalaf, M., Lewis, F.L.: Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica 41(5), 779–791 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  6. Jiang, Y., Jiang, Z.P.: Robust Adaptive Programming. Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, pp. 281–302 (2012)

    Google Scholar 

  7. Liu, D., Wang, D., Wang, F.Y., et al.: Neural-network-based online HJB solution for optimal robust guaranteed cost control of continuous-time uncertain nonlinear systems. IEEE Trans. Cybern. 44(12), 2834–2847 (2014)

    Article  Google Scholar 

  8. Wang, D., Liu, D., Li, H., et al.: Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming. Inf. Sci. 282, 167–179 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  9. Zhao, D., Zhu, Y.: MECA near-optimal online reinforcement learning algorithm for continuous deterministic systems. IEEE Trans. Neural Netw. Learn. Syst. 26(2), 346–356 (2015)

    Article  MathSciNet  Google Scholar 

  10. Zhao, D., Zhang, Q., Wang, D., et al.: Experience replay for optimal control of nonzero-sum game systems with unknown dynamics. IEEE Trans. Cybern. 46(3), 854–865 (2016)

    Article  Google Scholar 

  11. Zhang, Q., Zhao, D., Zhu, Y.: Event-triggered H\(_\infty \) control for continuous-time nonlinear system via concurrent learning. IEEE Trans. Syst. Man Cybern. Syst. doi:10.1109/TSMC.2016.2531680 (2016)

  12. Sahoo, A., Xu, H., Jagannathan, S.: Near optimal event-triggered control of nonlinear discrete-time systems using neurodynamic programming. IEEE Trans. Neural Netw. Learn. Syst. 27(9), 1801–1815 (2016)

    Article  MathSciNet  Google Scholar 

  13. Vamvoudakis, K.G.: Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems. IEEE/CAA J. Automatica Sinica 1(3), 282–293 (2014)

    Article  Google Scholar 

  14. Zhong, X., Ni, Z., He, H., et al.: Event-triggered reinforcement learning approach for unknown nonlinear continuous-time system. In: 2014 IEEE International Joint Conference on Neural Networks, pp. 3677–3684. IEEE Press, Beijing (2014)

    Google Scholar 

  15. Modares, H., Lewis, F.L., Naghibi-Sistani, M.B.: Adaptive optimal control of unknown constrained-input systems using policy iteration and neural networks. IEEE Trans. Neural Netw. Learn. Syst. 24(10), 1513–1525 (2013)

    Article  Google Scholar 

Download references

Acknowledgments

This research is supported by National Natural Science Foundation of China (NSFC) under Grants No. 61573353, No. 61533017, by the National Key Research and Development Plan under Grants 2016YFB0101000.

Author information

Authors and Affiliations

  1. The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China

    Qichao Zhang, Dongbin Zhao & Ding Wang

  2. University of Chinese Academy of Sciences, Beijing, 100049, China

    Qichao Zhang, Dongbin Zhao & Ding Wang

Authors
  1. Qichao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dongbin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ding Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dongbin Zhao .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Fuchun Sun

  2. Department of Computer Science and Technology, Tsinghua University, Beijing, China

    Huaping Liu

  3. College of Mechatronics and Automation, National University of Defense Technology, Changsha, China

    Dewen Hu

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Zhang, Q., Zhao, D., Wang, D. (2017). Event-Triggered Adaptive Dynamic Programming for Uncertain Nonlinear Systems. In: Sun, F., Liu, H., Hu, D. (eds) Cognitive Systems and Signal Processing. ICCSIP 2016. Communications in Computer and Information Science, vol 710. Springer, Singapore. https://doi.org/10.1007/978-981-10-5230-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-5230-9_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-5229-3

  • Online ISBN: 978-981-10-5230-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation