Abstract
The paper provides an overview on necessary and, whenever available, on sufficient conditions of optimality for optimal control problems with differential-algebraic equations (DAEs) and on numerical approximation techniques. Local and global minimum principles of Pontryagin type are discussed for convex linear-quadratic optimal control problems and for non-convex problems. The main steps for the derivation of such conditions will be explained. The basic working principles of different approaches towards the numerical solution of DAE optimal control problems are illustrated for direct shooting methods, full discretization techniques, projected gradient methods, and Lagrange–Newton methods in a function space setting.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alt, W.: The Lagrange-Newton method for infinite dimensional optimization problems. Numer. Funct. Anal. Optim. 11, 201–224 (1990)
Alt, W.: Sequential quadratic programming in banach spaces. In: Oettli, W., Pallaschke, D. (eds.) Advances in Optimization, pp. 281–301. Springer, Berlin (1991)
Alt, W., Malanowski, K.: The Lagrange-Newton method for nonlinear optimal control problems. Comput. Optim. Appl. 2, 77–100 (1993)
Alt, W., Malanowski, K.: The Lagrange-Newton method for state constrained optimal control problems. Comput. Optim. Appl. 4, 217–239 (1995)
Amodio, P., Mazzia, F.: Numerical solution of differential algebraic equations and computation of consistent initial/boundary conditions. J. Comput. Appl. Math. 87, 135–146 (1997)
Ascher, U.M., Mattheij, R.M.M., Russell, R.D.: Numerical solution of boundary value problems for ordinary differential equations, In: Classics in Applied Mathematics, vol. 13. SIAM, Philadelphia (1995)
Ascher, U.M., Spiteri, R.J.: Collocation software for boundary value differential-algebraic equations. SIAM J. Sci. Comput. 15(4), 938–952 (1994)
Backes, A.: Extremalbedingungen für optimierungs-probleme mit algebro-differentialgleichungen. PhD thesis, Mathematisch-naturwissenschaftliche fakultät, Humboldt-Universität Berlin (2006)
Balla, K., Kurina, G.A., März, R.: Index criteria for differential algebraic equations arising from linear-quadratic optimal control problems. J. Dyn. Control Syst. 12(3), 289–311 (2006)
Balla, K., März, R.: A unified approach to linear differential algebraic equations and their adjoints. Z. Anal. Anwendungen 21(3), 783–802 (2002)
Bauer, I.: Numerical methods for the solution of initial value problems and for the generation of first and second-order derivatives in optimisation problems of chemistry and process engineering. (Numerische verfahren zur lösung von anfangswertaufgaben und zur generierung von ersten und zweiten ableitungen mit anwendungen bei optimierungsaufgaben in chemie und verfahrenstechnik.). PhD thesis, Mathematisch-Naturwissenschaftliche Gesamtfakultät, iv, p. 169, Heidelberg (2000)
Bauer, I., Bock, H.G., Körkel, S., Schlöder, J.P.: Numerical methods for optimum experimental design in DAE systems. J. Comput. Appl. Math. 120(1–2), 1–25 (2000)
Bertolazzi, E., Biral, F., Da Lio, M.: Symbolic-numeric efficient solution of optimal control problems for multibody systems. J. Comput. Appl. Math. 185(2), 404–421 (2006)
Betts, J.T.: Practical methods for optimal control using nonlinear programming. In: Advances in Design and Control, vol. 3. SIAM, Philadelphia (2001)
Betts, J.T., Huffman, W.P.: Mesh refinement in direct transcription methods for optimal control. Optim. Control Appl. Meth. 19, 1–21 (1998)
Biegler, L.T., Campbell, S.L., Mehrmann, V.(eds.): Control and optimization with differential-algebraic constraints. In: Advances in Design and Control, vol. 23. SIAM, Philadelphia (2012)
Biehn, N., Campbell, S.L., Jay, L., Westbrook, T.: Some comments on DAE theory for IRK methods and trajectory optimization. J. Comput. Appl. Math. 120(1–2), 109–131 (2000)
Bock, H.G.: Randwertproblemmethoden zur parameteridentifizierung in systemen nichtlinearer differentialgleichungen. In: Bonner Mathematische Schriften, vol. 183. Fakultät der Universität, Bonn (1987)
Bock, H.G., Plitt, K.J.: A multiple shooting algorithm for direct solution of optimal control problems. Proceedings of the 9th IFAC Worldcongress, Budapest, Hungary (1984)
Brenan, K.E.: Differential-algebraic equations issues in the direct transcription of path constrained optimal control problems. Ann. Numer. Math. 1, 247–263 (1994)
Brenan, K.E., Campbell, S.L., Petzold, L.R.: Numerical solution of initial-value problems in differential-algebraic equations. In: Classics In Applied Mathematics, vol. 14. SIAM, Philadelphia (1996)
Brown, P.N., Hindmarsh, A.C., Petzold, L.R.: Consistent initial condition calculation for differential-algebraic systems. SIAM J. Sci. Comput. 19(5), 1495–1512 (1998)
Büskens, C.: Optimierungsmethoden und Sensitivitätsanalyse für optimale Steuerprozesse mit Steuer- und Zustandsbeschränkungen. PhD thesis, Fachbereich Mathematik, Westfälische Wilhems-Universität Münster, Munster (1998)
Büskens, C., Gerdts, M.: Real-time optimization of DAE systems. In: Grötschel, M., Krumke, S.O., Rambau, J. (eds.) Online Optimization of Large Scale Systems, pp. 117–128. Springer, Heidelberg (2001)
Campbell, S.L., Kunkel, P.: On the numerical treatment of linear-quadratic optimal control problems for general linear time-varying differential-algebraic equations. J. Comput. Appl. Math. 242, 213–231 (2013)
Campbell, S.L., Marszalek, W.: The index of an infinite dimensional implicit system. Math. Comput. Model. Dyn. Syst. 5(1), 18–42 (1999)
Campbell, S.L., März, R.: Direct transcription solution of high index optimal control problems and regular Euler-Lagrange equations. J. Comput. Appl. Math. 202(2), 186–202 (2007)
Campbell, S.L., Kelley, C.T., Yeomans, K.D.: Consistent initial conditions for unstructured higher index DAEs: A computational study. In: Proceedings of the Computational Engineering in Systems Applications, pp. 416–421, France (1996)
Cao, Y., Li, S., Petzold, L.R., Serban, R.: Adjoint sensitivity analysis for differential-algebraic equations: The adjoint DAE system and its numerical solution. SIAM J. Sci. Comput. 24(3), 1076–1089 (2003)
Caracotsios, M., Stewart, W.E.: Sensitivity analysis of initial-boundary-value problems with mixed PDEs and algebraic equations. Comput. chem. Eng. 19(9), 1019–1030 (1985)
Chen, J., Gerdts, M.: Smoothing technique of nonsmooth Newton methods for control-state constrained optimal control problems. SIAM J. Numer. Anal. 50(4), 1982–2011 (2012)
Cherednichenko, S., Krumbiegel, K., Rösch, A.: Error estimates for the Lavrientiev regularization of elliptic optimal control problems. Inverse Prob. 24, 1–21 (2008)
de Pinho, M., Ilchmann, A.: Weak maximum principle for optimal control problems with mixed constraints. Nonlinear Anal. Theory Meth. Appl. 48(8), 1179–1196 (2002)
de Pinho, M., Vinter, R.B.: Necessary conditions for optimal control problems involving nonlinear differential algebraic equations. J. Math. Anal. Appl. 212, 493–516 (1997)
Deuflhard, P., Pesch, H.J., Rentrop, P.: A modified continuation method for the numerical solution of nonlinear two-point boundary value problems by shooting techniques. Numer. Math. 26, 327–343 (1976)
Devdariani, E.N., Ledyaev, Yu. S.: Maximum principle for implicit control systems. Appl. Math. Optim. 40, 79–103 (1999)
Diehl, M.: Real- time optimization for large scale nonlinear processes. PhD thesis, Naturwissenschaftlich-Mathematische Gesamtfakultät, Universität Heidelberg (2001)
Diehl, M., Bock, H.G., Schlöder, J.P.: A real-time iteration scheme for nonlinear optimization in optimal feedback control. SIAM J. Control Optim. 43(5), 1714–1736 (2005)
Engelsone, A., Campbell, S.L., Betts, J.T.: Direct transcription solution of higher-index optimal control problems and the virtual index. Appl. Numer. Math. 57(3), 281–296 (2007)
Fabien, B.C.: dsoa: The implementation of a dynamic system optimization algorithm. Optim. Control Appl. Meth. 31(3), 231–247 (2010)
Feehery, W.F., Tolsma, J.E., Barton, P.I.: Efficient sensitivity analysis of large-scale differential-algebraic systems. Appl. Numer. Math. 25, 41–54 (1997)
Führer, C., Leimkuhler, B.J.: Numerical solution of differential-algebraic equations for constraint mechanical motion. Numer. Math. 59, 55–69 (1991)
Gear, C.W., Leimkuhler, B., Gupta, G.K.: Automatic integration of Euler-Lagrange equations with constraints. J. Comput. Appl. Math. 12/13, 77–90 (1985)
Gerdts, M.: Direct shooting method for the numerical solution of higher index DAE optimal control problems. J. Optim. Theory Appl. 117(2), 267–294 (2003)
Gerdts, M.: A variable time transformation method for mixed-integer optimal control problems. Optim. Control Appl. Meth. 27(3), 169–182 (2006)
Gerdts, M.: Local minimum principle for optimal control problems subject to index-two differential-algebraic equations. J. Optim. Theory Appl. 130(3), 443–462 (2006)
Gerdts, M.: Representation of the lagrange multipliers for optimal control problems subject to differential-algebraic equations of index two. J. Optim. Theory Appl. 130(2), 231–251 (2006)
Gerdts, M.: Optimal Control of ODEs and DAEs. Walter de Gruyter, Berlin (2012)
Gerdts, M., Büskens, C.: Consisstent initialization of sensitivity matrices for a class of parametric DAE systems. BIT Numer. Math. 42(4), 796–813 (2002)
Gerdts, M., Hüpping, B.: Virtual control regularization of state constrained linear quadratic optimal control problems. Comput. Optim. Appl. 51(2), 867–882 (2012)
Gerdts, M., Kunkel, M.: A globally convergent semi-smooth Newton method for control-state constrained DAE optimal control problems. Comput. Optim. Appl. 48(3), 601–633 (2011)
Gerdts, M., Sager, S.: Mixed-integer DAE optimal control problems: necessary conditions and bounds. In: Control and Optimization with Differential-Algebraic Constraints. Advances in Design and Control, vol. 23, pp. 189–212. SIAM, Philadelphia (2012)
Goh, C.J., Teo, K.L.: Control parametrization: A unified approach to optimal control problems with general constraints. Automatica 24, 3–18 (1988)
Gopal, V., Biegler, L.T.: A successive linear programming approach for initialization and reinitialization after discontinuities of differential-algebraic equations. SIAM J. Sci. Comput. 20(2), 447–467 (1998)
Griewank, A.: Evaluating Derivatives. Principles and Techniques of Algorithmic Differentiation. In: Frontiers in Applied Mathematics, vol. 19. SIAM, Philadelphia (2000)
Griewank, A., Walther, A.: Evaluating Derivatives. Principles and Techniques of Algorithmic Differentiation. 2nd edn. SIAM, Philadelphia (2008)
Gritsis, D.M., Pantelides, C.C., Sargent, R.W.H.: Optimal control of systems described by index two differential-algebraic equations. SIAM J. Sci. Comput. 16(6), 1349–1366 (1995)
Hairer, E., Wanner, G.: Solving ordinary differential equations II: Stiff and differential-algebraic problems. 2nd edn. In: Computational Mathematics, vol. 14. Springer, New York (1996)
Hairer, E., Lubich, Ch., Roche, M.: The numerical solution of differential-algebraic systems by Runge-Kutta methods. In: Lecture Notes in Mathematics, vol. 1409. Springer, New York (1989)
Hargraves, C.R., Paris, S.W.: Direct trajectory optimization using nonlinear programming and collocation. J. Guid. Control Dyn. 10, 338–342 (1987)
Hinze, M., Pinnau, R., Ulbrich, M., Ulbrich, S.: Optimization with PDE Constraints. In: Mathematical Modelling: Theory and Applications, vol. 23, p. 270. Springer, Dordrecht (2009)
Ito, K., Kunisch, K.: Lagrange Multiplier Approach to Variational Problems and Applications. In: Advances in Design and Control, vol. 15, p. 341. SIAM, Philadelphia (2008)
Jeon, M.: Parallel optimal control with multiple shooting, constraints aggregation and adjoint methods. J. Appl. Math. Comput. 19(1–2), 215–229 (2005)
Kameswaran, S., Biegler, L.T.: Advantages of nonlinear-programming-based methodologies for inequality path-constrained optimal control problems-A numerical study. SIAM J. Sci. Comput. 30(2), 957–981 (2008)
Kitzhofer, G., Koch, O., Pulverer, G., Simon, Ch. Weinmüller, E.B.: The new MATLAB code bvpsuite for the solution of singular implicit BVPs. J. Numer. Anal, Ind. Appl. Math. 5(1–2), 113–134 (2010)
Krumbiegel, K., Rösch, A.: On the regularization error of state constrained Neumann control problems. Control Cybern. 37(2), 369–392 (2008)
Kunkel, P., Mehrmann, V.: The linear quadratic optimal control problem for linear descriptor systems with variable coefficients. Math. Control Signal Syst. 10(3), 247–264 (1997)
Kunkel, P., Mehrmann, V.: Differential-Algebraic Equations. Analysis and Numerical Solution., p. 377. European Mathematical Society, Zürich (2006)
Kunkel, P., Mehrmann, V.: Optimal control for unstructured nonlinear differential-algebraic equations of arbitrary index. Math. Control Signal Syst. 20(3), 227–269 (2008)
Kunkel, P., Mehrmann, V.: Formal adjoints of linear DAE operators and their role in optimal control. Electron. J. Linear Algebra 22, 672–693 (2011)
Kunkel, P., Mehrmann, V., Stöver, R.: Symmetric collocation for unstructered nonlinear differential-algebraic equations of arbitrary index. Numer. Math. 98(2), 277–304 (2004)
Kunkel, P., Mehrmann, V., Stöver, R.: Multiple shooting for unstructured nonlinear differential-algebraic equations of arbitrary index. SIAM J. Numer. Anal. 42(6), 2277–2297 (2005)
Kunkel, P., Stöver, R.: Symmetric collocation methods for linear differential-algebraic boundary value problems. Numer. Math. 91(3), 475–501 (2002)
P. Kunkel, von dem Hagen, O.: Numerical solution of infinite-horizon optimal-control problems. Comput. Econ. 16(3), 189–205 (2000)
Kurcyusz, S.: On the existence and nonexistence of lagrange multipliers in banach spaces. J. Optim. Theory Appl. 20(1), 81–110 (1976)
Kurina, G.A., März, R.: On linear-quadratic optimal control problems for time-varying descriptor systems. SIAM J. Control Optim. 42(6), 2062–2077 (2004)
Kurina, G.A., März, R.: Feedback solutions of optimal control problems with DAE constraints. SIAM J. Control Optim. 46(4), 1277–1298 (2007)
Lamour, R.: A well-posed shooting method for transferable DAE’s. Numer. Math. 59(8), 815–830 (1991)
Lamour, R.: A shooting method for fully implicit index-2 differential algebraic equations. SIAM J. Sci. Comput. 18(1), 94–114 (1997)
Lamour, R., März, R., Tischendorf, C.: Differential-Algebraic Equations: A Projector Based Analysis. In: Differential-Algebraic Equations Forum. Springer, Berlin (2013)
Lee, H.W.J., Teo, K.L., Rehbock, V., Jennings. L.S.: Control parametrization enhancing technique for optimal discrete-valued control problems. Automatica 35(8), 1401–1407 (1999)
Leimkuhler, B., Petzold, L.R., Gear, C.W.: Approximation methods for the consistent initialization of differential-algebraic equations. SIAM J. Numer. Anal. 28(1), 205–226 (1991)
Lempio, F.: Tangentialmannigfaltigkeiten und infinite Optimierung. Habilitationsschrift, Universität Hamburg (1972)
Leyendecker, S., Ober-Blöbaum, S., Marsden, J.E., Ortiz, M.: Discrete mechanics and optimal control for constrained systems. Optim. Control Appl. Meth. 31(6), 505–528 (2010)
Machielsen, K.C.P.: Numerical solution of optimal control problems with state constraints by sequential quadratic programming in function space. CWI Tract, vol. 53. Centrum voor Wiskunde en Informatica, Amsterdam (1988)
Maly, T., Petzold, L.R.: Numerical methods and software for sensitivity analysis of differential-algebraic systems. Appl. Numer. Math. 20(1), 57–79 (1996)
Mehrmann, V.: The autonomous linear quadratic control problem. theory and numerical solution. In: Lecture Notes in Control and Information Sciences, vol 163. Springer, Berlin (1991)
Morison, K.R., Sargent, R.W.H.: Optimization of multistage processes described by differential-algebraic equations. In: Numerical Aanalysis, Proceedings of the 4th IIMAS Workshop, Guanajuato/Mex. 1984. Lecture Notes in Mathematics, 1230, pp. 86–102. Springer, Berlin (1986)
Pantelides, C.C.: The consistent initialization of differential-algebraic systems. SIAM J. Sci. Stat. Comput. 9(2), 213–231 (1988)
Pantelides, C.C., Sargent, R.W.H., Vassiliadis, V.S.: Optimal control of multistage systems described by high-index differential-algebraic equations. In: Bulirsch, R. (ed.) Computational Optimal Control. International Series of Numerical Mathematics, vol. 115, pp. 177–191. Birkhäuser, Basel (1994)
Pytlak, R.: Runge-Kutta based procedure for the optimal control of differential-algebraic equations. J. Optim. Theory Appl. 97(3), 675–705 (1998)
Pytlak, R.: Numerical Methods for Optimal Control Problems with State Constraints. In: Lecture Notes in Mathematics, vol. 1707. Springer, New York (1999)
Pytlak, R.: Optimal control of differential-algebraic equations of higher index. I: First-order approximations. J. Optim. Theory Appl. 134(1), 61–75 (2007)
Pytlak, R.: Optimal control of differential-algebraic equations of higher index. II: Necessary optimality conditions. J. Optim. Theory Appl. 134(1), 77–90 (2007)
Pytlak, R.: Numerical procedure for optimal control of higher index DAEs. Discrete Contin. Dyn. Syst. 29(2), 647–670 (2011)
Reich, S.: On an existence and uniqueness theory for nonlinear differential-algebraic equations. Circ. Syst. Signal Process. 10(3), 343–359 (1991)
Roubicek, T., Valásek, M.: Optimal control of causal differential-algebraic systems. J. Math. Anal Appl. 269(2), 616–641 (2002)
Sager, S.: Numerical methods for mixed-integer optimal control problems. PhD thesis, Naturwissenschaftlich-Mathematische Gesamtfakultät (Diss.), p. 219, Heidelberg (2006)
Sager, S., Bock, H.G., Reinelt, G.: Direct methods with maximal lower bound for mixed-integer optimal control problems. Math. Program.(A) 118(1), 109–149 (2009)
Schanzer, G.F., Callies, R.: Multiple constrained rivaling actuators in the optimal control of miniaturized manipulators. Multibody Syst. Dyn. 19(1–2), 21–43 (2008)
Schiela, A.: An interior point method in function space for the efficient solution of state constrained optimal control problems. Math. Program. 138(1–2 (A)), 83–114 (2013)
Schulz, V.H.: Reduced SQP methods for large-scale optimal control problems in DAE with application to path planning problems for satellite mounted robots. PhD thesis, Interdisziplinäres Zentrum für Wissenschaftliches Rechnen, Universität Heidelberg (1996)
Schulz, V.H., Bock, H.G., Steinbach, M.C.: Exploiting invariants in the numerical solution of multipoint boundary value problems for DAE. SIAM J. Sci. Comput. 19(2), 440–467 (1998)
Stöver, R.: Collocation methods for solving linear differential-algebraic boundary value problems. Numer. Math. 88(4), 771–795 (2001)
Teo, K.L., Jennings, L.S., Lee, H.W.J., Rehbock, V.: The control parametrization enhancing transform for constrained optimal control problems. J. Aust. Math. Soc. B 40, 314–335 (1999)
Trenn, S.: Solution concepts for linear DAEs: a survey. In: Ilchmann, A., Reis, T. (eds.) Surveys in Differential-Algebraic Equations I. Differential-Algebraic Equations Forum, pp. 137–172. Springer, Berlin (2013)
Tröltzsch, F.: Optimal control of partial differential equations. Theory, methods and applications. American Mathematical Society (AMS), Providence (2010)
Ulbrich, M.: Semismooth newton methods for operator equations in function spaces. SIAM J. Optim. 13(3), 805–841 (2003)
Ulbrich, M.: Nonsmooth newton-like methods for variational inequalities and constrained optimization problems in function spaces. Habilitation, Technical University of Munich, Munich (2002)
Ulbrich, M., Ulbrich, S.: Primal-dual interior-point methods for PDE-constrained optimization. Math. Program. 117(1–2 (B)), 435–485 (2009)
Vassiliades, V.C., Sargent, R.W.H., Pantelides, C.C.: Solution of a class of multistage dynamic optimization problems. 2. Problems with path constraints. Ind. Eng. Chem. Res. 33, 2123–2133 (1994)
von Stryk, O.: Numerische Lösung optimaler Steuerungsprobleme: Diskretisierung, Parameteroptimierung und Berechnung der adjungierten Variablen. In: VDI Fortschrittberichte Reihe 8: Meß-, Steuerungs- und Regeleungstechnik, vol. 441. VDI, Düsseldorf (1994)
Weiser, M.: Interior point methods in function space. SIAM J. Control Optim. 44(5), 1766–1786 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Gerdts, M. (2015). A Survey on Optimal Control Problems with Differential-Algebraic Equations. In: Ilchmann, A., Reis, T. (eds) Surveys in Differential-Algebraic Equations II. Differential-Algebraic Equations Forum. Springer, Cham. https://doi.org/10.1007/978-3-319-11050-9_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-11050-9_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11049-3
Online ISBN: 978-3-319-11050-9
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)