Advertisement

Interval Methods for Optimal Control

  • Andreas Rauh
  • Eberhard P. Hofer
Conference paper
Part of the Springer Optimization and Its Applications book series (SOIA, volume 33)

Abstract

Bellman’s discrete dynamic programming is one of the most general approaches to solve optimal control problems. For discrete-time dynamical systems, it is, at least theoretically, capable to determine globally optimal control laws. In most practical cases, both state and control variables are subject to constraints. Due to the necessity for gridding of the range of both state and control variables in numerical implementations of dynamic programming, the computational effort grows exponentially with increasing system dimensions. This fact is well known as the curse of dimensionality. Furthermore, gridding of intervals representing uncertain system parameters is inevitable, if dynamic programming is used for the design of optimal controllers for systems with uncertainties. In this contribution, an interval arithmetic procedure for the design of optimal and robust controllers is presented. This procedure relies on the basic concepts of dynamic programming. Sophisticated techniques for the exclusion of non-optimal control strategies significantly reduce the computational burden. Since interval techniques can be applied to both continuous-time and discrete-time dynamical systems, the interval arithmetic optimization approach presented in this chapter is applicable to both cases. In addition, the inclusion of effects of uncertain parameters in the underlying optimality criteria is demonstrated. For that purpose, interval arithmetic routines for analysis and design of optimal and robust controllers have been developed. Details about computationally efficient implementations of interval arithmetic optimization procedures and numerical results for a mechanical positioning system with statedependent switchings between different dynamical models for viscous and Coulomb friction are summarized.

Keywords

Uncertain Parameter Control Sequence Interval Arithmetic Interval Method Optimal Control Strategy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    E. Auer, A. Rauh, E. P. Hofer, and W. Luther. Validated Modeling of Mechanical Systems with SmartMOBILE: Improvement of Performance by ValEncIA-IVP. In Proc. of Dagstuhl Seminar 06021: Reliable Implementation of Real Number Algorithms: Theory and Practice, Lecture Notes in Computer Science 5045, Springer-Verlag, pages 1–27, 2008.Google Scholar
  2. 2.
    R. Bellman. Dynamic Programming. Princeton University Press, Princeton, NJ, 1957.Google Scholar
  3. 3.
    R. Bellman, editor. Mathematical Optimization Techniques. University of California Press, Berkeley, California, 1963.MATHGoogle Scholar
  4. 4.
    M. Berz and K.Makino. Verified Integration of ODEs and Flows Using Differential Algebraic Methods on High-order Taylor Models. Reliable Computing, 4:361–369, 1998.MATHCrossRefMathSciNetGoogle Scholar
  5. 5.
    A. A. Feldbaum. Optimal Control Systems. Academic Press, New York, 1965.Google Scholar
  6. 6.
    L. Jaulin, M. Kieffer, O. Didrit, and É. Walter. Applied Interval Analysis. Springer–Verlag, London, 2001.Google Scholar
  7. 7.
    K. Kowalski and W.-H. Steeb. Nonlinear Dynamical Systems and Carleman Linearization. World Scientific, Singapore, 1991.MATHGoogle Scholar
  8. 8.
    G. Leitmann. An Introduction to Optimal Control. McGraw-Hill, New York, 1966.MATHGoogle Scholar
  9. 9.
    Y. Lin and M. A. Stadtherr. Validated Solution of Initial Value Problems for ODEs with Interval Parameters. In Proc. of the 2nd NSF Workshop on Reliable Engineering Computing, Savannah GA, 2006.Google Scholar
  10. 10.
    Y. Lin and M. A. Stadtherr. Deterministic Global Optimization for Dynamic Systems Using Interval Analysis. In CD-Proc. of the 12th GAMM-IMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
  11. 11.
    Y. Lin and M. A. Stadtherr. Deterministic Global Optimization of Nonlinear Dynamic Systems. AIChE Journal, 53(4):866–875, 2007.CrossRefGoogle Scholar
  12. 12.
    K. Makino. Rigorous Analysis of Nonlinear Motion in Particle Accelerators. PhD thesis, Michigan State University, 1998.Google Scholar
  13. 13.
    J. Minisini, A. Rauh, and E. P. Hofer. Carleman Linearization for Approximate Solutions of Nonlinear Control Problems: Part 1 – Theory. In Proc. of the 14th Intl.Workshop on Dynamics and Control, Moscow-Zvenigorod, Russia, 2007, Advances in Mechanics: Dynamics and Control, F. L. Chernousko, G. V. Kostin, V. V. Saurin (Eds), pages 215–222, Nauka, Moscow, 2008.Google Scholar
  14. 14.
    R. Moore. Methods and Applications of Interval Analysis. SIAM, Philadelphia, 1979.MATHGoogle Scholar
  15. 15.
    N. S. Nedialkov. Computing Rigorous Bounds on the Solution of an Initial Value Problem for an Ordinary Differential Equation. PhD thesis, Graduate Department of Computer Science, University of Toronto, 1999.Google Scholar
  16. 16.
    N. S. Nedialkov. The Design and Implementation of an Object-Oriented Validated ODE Solver. Kluwer Academic Publishers, Dordrecht, 2002.Google Scholar
  17. 17.
    N. S. Nedialkov. Interval Tools for ODEs and DAEs. In CD-Proc. of the 12th GAMMIMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
  18. 18.
    N. S. Nedialkov and M. v. Mohrenschildt. Rigorous Simulation of Hybrid Dynamic Systems with Symbolic and Interval Methods. In Proc. of the American Control Conference ACC, pages 140–147, Anchorage, USA, 2002.Google Scholar
  19. 19.
    L. S. Pontryagin, V. G. Boltjanskij, R. V. Gamkrelidze, and E. F.Misčcenko. The Mathematical Theory of Optimal Processes. Interscience Publishers, New York, 1962.MATHGoogle Scholar
  20. 20.
    A. Rauh, E. Auer, and E. P. Hofer. VALENCIA-IVP: A Comparison with Other Initial Value Problem Solvers. In CD-Proc. of the 12th GAMM-IMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
  21. 21.
    A. Rauh and E. P. Hofer. Interval Arithmetic Optimization Techniques for Uncertain Discrete-Time Systems. In E. P. Hofer and E. Reithmeier, editors, Proc. of the 13th Intl. Workshop on Dynamics and Control, Modeling and Control of Autonomous Decision Support Based Systems, pages 141–148, Wiesensteig, Germany, 2005. Shaker Verlag, Aachen.Google Scholar
  22. 22.
    A. Rauh, M. Kletting, H. Aschemann, and E. P. Hofer. Robust Controller Design for Bounded State and Control Variables and Uncertain Parameters Using Interval Methods. In Proc. of the Intl. Conference on Control and Automation ICCA’05, pages 777–782, Budapest, Hungary, 2005.Google Scholar
  23. 23.
    A. Rauh, M. Kletting, H. Aschemann, and E. P. Hofer. Interval Methods for Simulation of Dynamical Systems with State-Dependent Switching Characteristics. In Proc. of the IEEE Intl. Conference on Control Applications CCA 2006, pages 355–360, Munich, Germany, 2006.Google Scholar
  24. 24.
    A. Rauh, J. Minisini, and E. P. Hofer. Carleman Linearization for Approximate Solutions of Nonlinear Control Problems: Part 2 – Applications. In Proc. of the 14th Intl. Workshop on Dynamics and Control, Moscow-Zvenigorod, Russia, 2007, Advances in Mechanics: Dynamics and Control, F. L. Chernousko, G. V. Kostin, V. V. Saurin (Eds), pages 266–273, Nauka, Moscow, 2008.Google Scholar
  25. 25.
    A. Rauh, J. Minisini, and E. P. Hofer. Interval Techniques for Design of Optimal and Robust Control Strategies. In CD-Proc. of the 12th GAMM-IMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
  26. 26.
    R. Rihm. Über Einschließungsverfahren für gewöhnliche Anfangswertprobleme und ihre Anwendung auf Differentialgleichungen mit unstetiger rechter Seite (in German). PhD thesis, University of Karlsruhe, Germany, 1993.Google Scholar
  27. 27.
    S. M. Rump. IntLab (Version 5.4). http://www.ti3.tu-harburg.de/rump/intlab/.
  28. 28.
    S. M. Rump. INTLAB – INTerval LABoratory. In T. Csendes, editor, Developments in Reliable Computing, pages 77–104. Kluver Academic Publishers, 1999.Google Scholar
  29. 29.
    The MathWorks, Inc. MATLAB Distributed Computing Toolbox – User’s Guide. http://www.mathworks.com.

Copyright information

© Springer-Verlag New York 2009

Authors and Affiliations

  1. 1.Chair of MechatronicsUniversity of RostockD-18059 RostockGermany
  2. 2.Institute of Measurement, Control, and MicrotechnologyUniversity of UlmD-89069 UlmGermany

Personalised recommendations