Abstract
The optimization and control of systems governed by partial differential equations (PDEs) usually requires numerous evaluations of the forward problem or the optimality system. Despite the fact that many recent efforts, many of which are reported in this book, have been made to limit or reduce the number of evaluations to 5–10, this cannot be achieved in all situations and even if this is possible, these evaluations may still require a formidable computational effort. For situations where this effort is not acceptable, model order reduction can be a means to significantly reduce the required computational resources. Here, we will survey some of the most popular approaches that can be used for this purpose. In particular, we address the issues arising in the strategies discretize-then-optimize, in which the optimality system of the reduced-order model has to be solved, and optimize-then-discretize, where a reduced-order model of the optimality system has to be found. The methods discussed include versions of proper orthogonal decomposition (POD) adapted to PDE constrained optimization as well as system-theoretic methods.
This work was supported by the DFG Priority Program 1253 “Optimization with Partial Differential Equations”, grants BE 2174/8-2, SA 289/20-1, and the DFG project “A-posteriori-POD Error Estimators for Nonlinear Optimal Control Problems governed by Partial Differential Equations”, grant VO 1658/2-1.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Not to be confused with the “reduced-order” terminology used in the model reduction context—here, “reduced” means that the cost functional is written in dependence of the control only, using the fact that the weak solution y(u) is uniquely determined by the chosen u!
References
K. Afanasiev, M. Hinze, Adaptive control of a wake flow using proper orthogonal decomposition. Lect. Notes Pure Appl. Math. 216, 317–332 (2001)
A. Alla, S. Volkwein, Asymptotic stability of POD based model predictive control for a semilinear parabolic PDE. Advances in Computational Mathematics, to appear (2014). http://kops.ub.uni-konstanz.de/handle/urn:nbn:de:bsz:352-253400
A.C. Antoulas, Approximation of Large-Scale Dynamical Systems (SIAM, Philadelphia, 2005)
E. Arian, M. Fahl, E.W. Sachs, Trust-region proper orthogonal decomposition for flow control. Technical report 2000–25, ICASE, 2000
P. Astrid, S. Weiland, K. Willcox, T. Backx, Missing point estimation in models described by proper orthogonal decomposition. IEEE Trans. Autom. Control 53(10), 2237–2251 (2008)
J.A. Atwell, J.T. Borggaard, B.B. King, Reduced-order controllers for Burgers’ equation with a nonlinear observer. Int. J. Appl. Math. Comput. Sci. 11(6), 1311–1330 (2001)
Z. Bai, Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems. Appl. Numer. Math. 43, 9–44 (2002)
H.T. Banks, M.L. Joyner, B. Winchesky, W.P. Winfree, Nondestructive evaluation using a reduced-order computational methodology. Inverse Probl. 16, 1–17 (2000)
U. Baur, Control-oriented model reduction for parabolic systems, Dissertation, TU Berlin, 2008
U. Baur, P. Benner, L. Feng, Model order reduction for linear and nonlinear systems: a system-theoretic perspective. Arch. Comput. Methods Eng. 2014 (electronic). DOI: 10.1007/s11831-014-9111-2
P. Benner, System-theoretic methods for model reduction of large-scale systems: simulation, control, and inverse problems, in Proceedings of MathMod 2009, Vienna, February 11–13, ed. by I. Troch, F. Breitenecker. Volume 35 of ARGESIM Report (2009), pp. 126–145
P. Benner, Balancing-related model reduction for parabolic control systems, in Proceedings of the 1st IFAC Workshop on Control of Systems Governed by Partial Differential Equations (IFAC Papers Online, Paris, 2013), pp. 257–262
P. Benner, J. Heiland, LQG-balanced truncation low-order controller for stabilization of laminar flows, ed. by R. King. Active Flow and Combustion Control 2014, Notes on Numerical Fluid Mechanics and Multidisciplinary Design, vol. 127 (Springer Internatinal Publishing, 2014), pp. 365–379
P. Benner, V. Mehrmann, D.C. Sorensen, Dimension Reduction of Large-Scale Systems. Lecture Notes in Computational Science and Engineering, vol. 45 (Springer, Berlin/New York, 2005)
P. Benner, E.S. Quintana-Ortí, G. Quintana-Ortí, Balanced truncation model reduction of large-scale dense systems on parallel computers. Math. Comput. Model. Dyn. Syst. 6(4), 383–405 (2000)
P. Benner, J. Saak, Numerical solution of large and sparse continuous time algebraic matrix Riccati and Lyapunov equations: a state of the art survey. GAMM Mitt. 36(1), 32–52 (2013)
M. Bergmann, L. Cordier, Optimal control of the cylinder wake in the laminar regime by trust-region methods and {POD} reduced-order models. J. Comput. Phys. 227(16), 7813–7840 (2008)
J.T. Borggaard, S. Gugercin, Model reduction for DAEs with an application to flow control. Department of Mathematics, Virginia Tech, Blacksburg, 2014
E. Casas, Pontryagin’s principle for state-constrained boundary control problems of semilinear parabolic equations. SIAM J. Control Optim. 35, 1297–1327 (1997)
D. Chapelle, A. Gariah, J. Saint-Marie, Galerkin approximation with proper orthogonal decomposition: new error estimates and illustrative examples. ESAIM: Math. Model. Numer. Anal. 46, 731–757 (2012)
X. Chen, S. Akella, I.M. Navon, A dual-weighted trust-region adaptive POD 4-D VAR applied to a finite-volume shallow water equations model on the sphere. Int. J. Numer. Methods Fluids 68(3), 377–402 (2012)
R. Cont, N. Lantos, O. Pironneau, A reduced basis for option pricing. SIAM J. Financ. Math. 2(1), 287–316 (2011)
R.F. Curtain, Model reduction for control design for distributed parameter systems, in Research Directions in Distributed Parameter Systems. Volume 27 of Frontiers Applied Mathematics (SIAM, Philadelphia, 2003), pp. 95–121
L. Dedé, Reduced basis method and a posteriori error estimation for parametrized linear-quadratic optimal control problems. SIAM J. Sci. Comput. 32, 997–1019 (2010)
J.C. De Los Reyes, T. Stykel, A balanced truncation based strategy for the optimal control of evolution problems. Optim. Methods Softw. 26(4–5), 673–694 (2011)
M. Dihlmann, B. Haasdonk, Certified nonlinear parameter optimization with reduced basis surrogate models. Proc. Appl. Math. Mech. 13, 3–6 (2013)
A.L. Dontchev, W.W. Hager, A.B. Poore, B. Yang, Optimality, stability, and convergence in nonlinear control. Appl. Math. Optim. 31, 297–326 (1995)
P. Feldmann, R.W. Freund, Efficient linear circuit analysis by Padé approximation via the Lanczos process. IEEE Trans. Computer-Aided Design 14, 639–649 (1995)
R. Freund, Model reduction methods based on Krylov subspaces. Acta Numer. 12, 267–319 (2003)
K. Gallivan, E. Grimme, P. Van Dooren, Asymptotic waveform evaluation via the Lanczos method. Appl. Math. Lett. 7, 75–80 (1994)
J. Ghiglieri, S. Ulbrich, Optimal flow control based on POD and MPC and an application to the cancellation of Tollmien-Schlichting waves. Optim. Methods Softw. 29(5), 1042–1074 (2014)
K. Glover, R.F. Curtain, J.R. Partington, Realisation and approximation of linear infinite-dimensional systems with error bounds. SIAM J. Control Optim. 26(4), 863–898 (1988)
S. Rogg, Trust Region POD for Optimal Boundary Control of a Semilinear Heat Equation, Diploma thesis, Department of Mathematics and Statistics, University of Konstanz (2014)
M.A. Grepl, M. Kärcher, Reduced basis a posteriori error bounds for parametrized linear-quadratic elliptic optimal control problems. Comptes Rendus de l’Académie des Sciences—Series I 349, 873–877 (2011)
M.A. Grepl, Y. Maday, N.C. Nguyen, A.T. Patera, Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations. ESAIM: Math. Model. Numer. Anal. 41, 575–605 (2007)
E. Grimm, Optimality system POD and a-posteriori error analysis for linear-quadratic optimal control problems. Master thesis, University of Konstanz, 2013
M. Gubisch, S. Volkwein, Proper orthogonal decomposition for linear-quadratic optimal control (2013, submitted). http://kops.ub.uni-konstanz.de/handle/urn:nbn:de:bsz:352-250378
M. Gubisch, S. Volkwein, POD a-posteriori error analysis for optimal control problems with mixed control-state constraints. Comput. Optim. Appl. 58, 619–644 (2014)
S. Gugercin, Projection methods for model reduction of large-scale dynamical systems. Ph.D. thesis, Rice University, Houston, 2003
S. Gugercin, A.C. Antoulas, C. Beattie, \(\mathcal{H}_{2}\) Model reduction for large-scale dynamical systems. SIAM J. Matrix Anal. Appl. 30(2), 609–638 (2008)
B. Haasdonk, Convergence rates of the POD-Greedy method. ESAIM: Math. Model. Numer. Anal. 47, 859–873 (2013)
B. Haasdonk, M. Ohlberger. Reduced basis method for finite volume approximations of parametrized linear evolution equations. ESAIM: Math. Model. Numer. Anal. 42, 277–302 (2008)
M. Heinkenschloss, D.C. Sorensen, K. Sun. Balanced truncation model reduction for a class of descriptor systems with application to the Oseen equations. SIAM J. Sci. Comput. 30, 1038–1063 (2008)
C. Himpe, M. Ohlberger. Cross-gramian based combined state and parameter reduction (2013, submitted)
M. Hintermüller, K. Ito, K. Kunisch, The primal-dual active set strategy as a semismooth Newton method. SIAM J. Optim. 13, 865–888 (2003)
M. Hinze, R. Pinnau, M. Ulbrich, M. Ulbrich, Optimization with PDE Constraints. Mathematical Modeling: Theory and Applications, vol. 23 (Springer, Berlin, 2009)
M. Hinze, F. Tröltzsch, Discrete concepts versus error analysis in PDE constrained optimization. GAMM Mitt. 33, 148–162 (2010)
M. Hinze, S. Volkwein, Proper orthogonal decomposition surrogate models for nonlinear dynamical systems: error estimates and suboptimal control (Chapter 10), in Dimension Reduction of Large-Scale Systems, ed. by P. Benner, V. Mehrmann, D.C. Sorensen. Lecture Notes in Computational Science and Engineering, vol. 45 (Springer, Berlin/New York, 2005), pp. 261–306
M. Hinze, S. Volkwein, Error estimates for abstract linear-quadratic optimal control problems using proper orthogonal decomposition. Comput. Optim. Appl. 39, 319–345 (2008)
P. Holmes, J.L. Lumley, G. Berkooz, C.W. Rowley, Turbulence, Coherent Structures, Dynamical Systems and Symmetry, 2nd edn. Cambridge Monographs on Mechanics (Cambridge University Press, Cambridge/New York, 2012)
K. Ito, S.S. Ravindran, A reduced basis method for control problems governed by PDEs, in Control and Estimation of Distributed Parameter Systems, ed. by W. Desch, F. Kappel, K. Kunisch. Proceedings of the International Conference in Vorau, vol. 126 (Birkhäuser-Verlag, Basel, 1996), pp. 153–168 (1998)
M. Kahlbacher, S. Volkwein, POD a-posteriori error based inexact SQP method for bilinear elliptic optimal control problems. ESAIM: Math. Model. Numer. Anal. 46, 491–511 (2012)
E. Kammann, F. Tröltzsch, S. Volkwein, A method of a-posteriori error estimation with application to proper orthogonal decomposition, ESAIM: Math. Model. Numer. Anal. 47, 555–581 (2013)
K. Kunisch, S. Volkwein, Proper orthogonal decomposition for optimality systems. ESAIM: Math. Model. Numer. Anal. 42, 1–23 (2008)
K. Kunisch, S. Volkwein, L. Xie, HJB-POD based feedback design for the optimal control of evolution problems. SIAM J. Appl. Dyn. Syst. 3, 701–722 (2004)
S. Lall, J.E. Marsden, S. Glavaski. A subspace approach to balanced truncation for model reduction of nonlinear control systems. Int. J. Robust Nonlin. Control 12, 519–535 (2002)
O. Lass, S. Volkwein, Parameter identification for nonlinear elliptic-parabolic systems with application in lithium-ion battery modeling (2013, submitted) http://kops.ub.uni-konstanz.de/handle/urn:nbn:de:bsz:352-253400
F. Leibfritz, S. Volkwein, Reduced order output feedback control design for PDE systems using proper orthogonal decomposition and nonlinear semidefinite programming. Lin. Algebra Appl. 415, 542–575 (2006)
S. Li, L. Feng, P. Benner, A. Seidel-Morgensterna, Using surrogate models for efficient optimization of simulated moving bed chromatography. Comput. Chem. Eng. (2014). doi:10.1016/j.compchemeng.2014.03.024
H.V. Ly, H.T. Tran, Modeling and control of physical processes using proper orthogonal decomposition. Math. Comput. Model. 33, 223–236 (2001)
V. Mehrmann, T. Stykel, Balanced truncation model reduction for large-scale systems in descriptor form (Chapter 3), in Dimension Reduction of Large-Scale Systems, ed. by P. Benner, V. Mehrmann, D.C. Sorensen. Lecture Notes in Computational Science and Engineering, vol. 45 (Springer, Berlin/New York, 2005), pp. 83–115
M. Müller, Uniform convergence of the POD method and applications to optimal control. Ph.D thesis, University of Graz, 2011
F. Negri, G. Rozza, A. Manzoni, A. Quarteroni, Reduced basis method for parametrized elliptic optimal control problems. SIAM J. Sci. Comput. 35(5), A2316–A2340 (2013)
B. Noack, K. Afanasiev, M. Morzynski, G. Tadmor, F. Thiele, A hierarchy of low-dimensional models for the transient and post-transient cylinder wake. J. Fluid. Mech. 497, 335–363 (2003)
J. Nocedal, S.J. Wright, Numerical Optimization. Springer Series in Operations Research and Financial Engineering, 2nd edn. (Springer-Verlag, 2006)
A.T. Patera, G. Rozza, Reduced Basis Approximation and A Posteriori Error Estimation for Parametrized Partial Differential Equations. MIT Pappalardo Graduate Monographs in Mechanical Engineering (2006)
O. Pironneau, Calibration of options on a reduced basis. J. Comput. Appl. Math. 232, 139–147 (2009)
M. Ohlberger, M. Schäfer, Error control based model reduction for parameter optimization of elliptic homogenization problems, in Proceedings of the 1st IFAC Workshop on Control of Systems Governed by Partial Differential Equations (IFAC Papers Online, Paris, 2013), pp. 251–256
M.R. Opmeer, Model order reduction by balanced proper orthogonal decomposition and by rational interpolation. IEEE Trans. Autom. Control 57(2), 472–477 (2012)
M.R. Opmeer, T. Reis, W. Wollner, Finite-rank ADI iteration for operator Lyapunov equations. SIAM J. Control Optim. 51(5), 4084–4117 (2013)
M. Rathinam, L. Petzold, Dynamic iteration using reduced order models: a method for simulation of large scale modular systems. SIAM J. Numer. Anal. 40, 1446–1474 (2002)
S.S. Ravindran, Reduced-order adaptive controllers for fluid flows using POD. SIAM J. Sci. Comput. 15, 457–478 (2000)
J.-P. Raymond, H. Zidani, Hamiltonian Pontryagin’s principle for state-constrained control problems governed by semilinear parabolic equations. Appl. Math. Optim. 39, 143–177 (1999)
M. Reed, B. Simon, Methods of Modern Mathematical Physics I: Functional Analysis (Academic, New York, 1980)
C.W. Rowley, Model reduction for fluids, using balanced proper orthogonal decomposition. Int. J. Bifurc. Chaos 15, 997–1013 (2005)
E.W. Sachs, S. Volkwein, POD Galerkin approximations in PDE-constrained optimization. GAMM Mitt. 33, 194–208 (2010)
A. Schiela, M. Weiser, Superlinear convergence of the control reduced interior point method for PDE constrained optimization. Comput. Optim. Appl. 39, 369–393 (2008)
W.H.A. Schilders, H.A. van der Vorst, J. Rommes, Model Order Reduction: Theory, Research Aspects and Applications. Mathematics in Industry, vol. 13 (Springer, Berlin, 2008)
E.W. Sachs, M. Schneider, Reduced order models for the implied variance und local volatility. Technical report, Trier University, 2014
E.W. Sachs, M. Schu, A-priori error estimates for reduced order models in finance. ESAIM: Math. Model. Numer. Anal. 47, 449–469 (2013)
V. Simoncini, Computational methods for linear matrix equations (Preprint, March 2013). http://www.dm.unibo.it/~simoncin/.
J.R. Singler, New POD expressions, error bounds, and asymptotic results for reduced order models of parabolic PDEs. SIAM J. Numer. Anal. 52, 852–876 (2014)
A. Studinger, S. Volkwein, Numerical analysis of POD a-posteriori error estimation for optimal control. Int. Ser. Numer. Math. 164, 137–158 (2013)
T. Tonn, K. Urban, S. Volkwein, Comparison of the reduced-basis and POD a-posteriori error estimators for an elliptic linear quadratic optimal control problem. Math. Comput. Model. Dyn. Syst. 17, 355–369 (2011)
F. Tröltzsch, Optimal Control of Partial Differential Equations. American Mathematical Society, Graduate Studies Mathematics, vol. 112 (Springer, New York, 2010)
F. Tröltzsch, S. Volkwein, POD a-posteriori error estimates for linear-quadratic optimal control problems. Comput. Optim. Appl. 44, 83–115 (2009)
M. Ulbrich, S.Ulbrich, Primal-dual interior-point methods for PDE-constrained optimization. Math. Prog. 117, 435–485 (2008)
S. Volkwein, Optimality system POD and a-posteriori error analysis for linear-quadratic problems. Control Cybern. 40, 1109–1125 (2011)
G. Vossen, S. Volkwein, Model reduction techniques with a-posteriori error analysis for linear-quadratic optimal control problems. Numer. Algebra Control Optim. 2, 465–485 (2012)
K. Willcox, J. Peraire, Balanced model reduction via the proper orthogonal decomposition. American Institute of Aeronautics and Astronautics (AIAA) (2002), pp. 2323–2330
Y. Yue, K. Meerbergen, Accelerating optimization of parametric linear systems by model order reduction. SIAM J. Optim. 23(2), 1344–1370 (2013)
K. Zhou, J.C. Doyle, K. Glover, Robust and Optimal Control (Prentice-Hall, Upper Saddle River, 1996)
Acknowledgements
Our thanks go to Günter Leugering for his well-structured and focused leadership throughout the six years of existence of the DFG Priority Program 1253 “Optimization with Partial Differential Equations”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Benner, P., Sachs, E., Volkwein, S. (2014). Model Order Reduction for PDE Constrained Optimization. In: Leugering, G., et al. Trends in PDE Constrained Optimization. International Series of Numerical Mathematics, vol 165. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-05083-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-05083-6_19
Published:
Publisher Name: Birkhäuser, Cham
Print ISBN: 978-3-319-05082-9
Online ISBN: 978-3-319-05083-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)