Interval Methods for Optimal Control
Bellman’s discrete dynamic programming is one of the most general approaches to solve optimal control problems. For discrete-time dynamical systems, it is, at least theoretically, capable to determine globally optimal control laws. In most practical cases, both state and control variables are subject to constraints. Due to the necessity for gridding of the range of both state and control variables in numerical implementations of dynamic programming, the computational effort grows exponentially with increasing system dimensions. This fact is well known as the curse of dimensionality. Furthermore, gridding of intervals representing uncertain system parameters is inevitable, if dynamic programming is used for the design of optimal controllers for systems with uncertainties. In this contribution, an interval arithmetic procedure for the design of optimal and robust controllers is presented. This procedure relies on the basic concepts of dynamic programming. Sophisticated techniques for the exclusion of non-optimal control strategies significantly reduce the computational burden. Since interval techniques can be applied to both continuous-time and discrete-time dynamical systems, the interval arithmetic optimization approach presented in this chapter is applicable to both cases. In addition, the inclusion of effects of uncertain parameters in the underlying optimality criteria is demonstrated. For that purpose, interval arithmetic routines for analysis and design of optimal and robust controllers have been developed. Details about computationally efficient implementations of interval arithmetic optimization procedures and numerical results for a mechanical positioning system with statedependent switchings between different dynamical models for viscous and Coulomb friction are summarized.
KeywordsUncertain Parameter Control Sequence Interval Arithmetic Interval Method Optimal Control Strategy
Unable to display preview. Download preview PDF.
- 1.E. Auer, A. Rauh, E. P. Hofer, and W. Luther. Validated Modeling of Mechanical Systems with SmartMOBILE: Improvement of Performance by ValEncIA-IVP. In Proc. of Dagstuhl Seminar 06021: Reliable Implementation of Real Number Algorithms: Theory and Practice, Lecture Notes in Computer Science 5045, Springer-Verlag, pages 1–27, 2008.Google Scholar
- 2.R. Bellman. Dynamic Programming. Princeton University Press, Princeton, NJ, 1957.Google Scholar
- 5.A. A. Feldbaum. Optimal Control Systems. Academic Press, New York, 1965.Google Scholar
- 6.L. Jaulin, M. Kieffer, O. Didrit, and É. Walter. Applied Interval Analysis. Springer–Verlag, London, 2001.Google Scholar
- 9.Y. Lin and M. A. Stadtherr. Validated Solution of Initial Value Problems for ODEs with Interval Parameters. In Proc. of the 2nd NSF Workshop on Reliable Engineering Computing, Savannah GA, 2006.Google Scholar
- 10.Y. Lin and M. A. Stadtherr. Deterministic Global Optimization for Dynamic Systems Using Interval Analysis. In CD-Proc. of the 12th GAMM-IMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
- 12.K. Makino. Rigorous Analysis of Nonlinear Motion in Particle Accelerators. PhD thesis, Michigan State University, 1998.Google Scholar
- 13.J. Minisini, A. Rauh, and E. P. Hofer. Carleman Linearization for Approximate Solutions of Nonlinear Control Problems: Part 1 – Theory. In Proc. of the 14th Intl.Workshop on Dynamics and Control, Moscow-Zvenigorod, Russia, 2007, Advances in Mechanics: Dynamics and Control, F. L. Chernousko, G. V. Kostin, V. V. Saurin (Eds), pages 215–222, Nauka, Moscow, 2008.Google Scholar
- 15.N. S. Nedialkov. Computing Rigorous Bounds on the Solution of an Initial Value Problem for an Ordinary Differential Equation. PhD thesis, Graduate Department of Computer Science, University of Toronto, 1999.Google Scholar
- 16.N. S. Nedialkov. The Design and Implementation of an Object-Oriented Validated ODE Solver. Kluwer Academic Publishers, Dordrecht, 2002.Google Scholar
- 17.N. S. Nedialkov. Interval Tools for ODEs and DAEs. In CD-Proc. of the 12th GAMMIMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
- 18.N. S. Nedialkov and M. v. Mohrenschildt. Rigorous Simulation of Hybrid Dynamic Systems with Symbolic and Interval Methods. In Proc. of the American Control Conference ACC, pages 140–147, Anchorage, USA, 2002.Google Scholar
- 20.A. Rauh, E. Auer, and E. P. Hofer. VALENCIA-IVP: A Comparison with Other Initial Value Problem Solvers. In CD-Proc. of the 12th GAMM-IMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
- 21.A. Rauh and E. P. Hofer. Interval Arithmetic Optimization Techniques for Uncertain Discrete-Time Systems. In E. P. Hofer and E. Reithmeier, editors, Proc. of the 13th Intl. Workshop on Dynamics and Control, Modeling and Control of Autonomous Decision Support Based Systems, pages 141–148, Wiesensteig, Germany, 2005. Shaker Verlag, Aachen.Google Scholar
- 22.A. Rauh, M. Kletting, H. Aschemann, and E. P. Hofer. Robust Controller Design for Bounded State and Control Variables and Uncertain Parameters Using Interval Methods. In Proc. of the Intl. Conference on Control and Automation ICCA’05, pages 777–782, Budapest, Hungary, 2005.Google Scholar
- 23.A. Rauh, M. Kletting, H. Aschemann, and E. P. Hofer. Interval Methods for Simulation of Dynamical Systems with State-Dependent Switching Characteristics. In Proc. of the IEEE Intl. Conference on Control Applications CCA 2006, pages 355–360, Munich, Germany, 2006.Google Scholar
- 24.A. Rauh, J. Minisini, and E. P. Hofer. Carleman Linearization for Approximate Solutions of Nonlinear Control Problems: Part 2 – Applications. In Proc. of the 14th Intl. Workshop on Dynamics and Control, Moscow-Zvenigorod, Russia, 2007, Advances in Mechanics: Dynamics and Control, F. L. Chernousko, G. V. Kostin, V. V. Saurin (Eds), pages 266–273, Nauka, Moscow, 2008.Google Scholar
- 25.A. Rauh, J. Minisini, and E. P. Hofer. Interval Techniques for Design of Optimal and Robust Control Strategies. In CD-Proc. of the 12th GAMM-IMACS Intl. Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics SCAN 2006, Duisburg, Germany, 2007. IEEE Computer Society.Google Scholar
- 26.R. Rihm. Über Einschließungsverfahren für gewöhnliche Anfangswertprobleme und ihre Anwendung auf Differentialgleichungen mit unstetiger rechter Seite (in German). PhD thesis, University of Karlsruhe, Germany, 1993.Google Scholar
- 27.S. M. Rump. IntLab (Version 5.4). http://www.ti3.tu-harburg.de/rump/intlab/.
- 28.S. M. Rump. INTLAB – INTerval LABoratory. In T. Csendes, editor, Developments in Reliable Computing, pages 77–104. Kluver Academic Publishers, 1999.Google Scholar
- 29.The MathWorks, Inc. MATLAB Distributed Computing Toolbox – User’s Guide. http://www.mathworks.com.