Skip to main content

Model Order Reduction for PDE Constrained Optimization

  • Chapter
  • First Online:
Trends in PDE Constrained Optimization

Part of the book series: International Series of Numerical Mathematics ((ISNM,volume 165))

Abstract

The optimization and control of systems governed by partial differential equations (PDEs) usually requires numerous evaluations of the forward problem or the optimality system. Despite the fact that many recent efforts, many of which are reported in this book, have been made to limit or reduce the number of evaluations to 5–10, this cannot be achieved in all situations and even if this is possible, these evaluations may still require a formidable computational effort. For situations where this effort is not acceptable, model order reduction can be a means to significantly reduce the required computational resources. Here, we will survey some of the most popular approaches that can be used for this purpose. In particular, we address the issues arising in the strategies discretize-then-optimize, in which the optimality system of the reduced-order model has to be solved, and optimize-then-discretize, where a reduced-order model of the optimality system has to be found. The methods discussed include versions of proper orthogonal decomposition (POD) adapted to PDE constrained optimization as well as system-theoretic methods.

This work was supported by the DFG Priority Program 1253 “Optimization with Partial Differential Equations”, grants BE 2174/8-2, SA 289/20-1, and the DFG project “A-posteriori-POD Error Estimators for Nonlinear Optimal Control Problems governed by Partial Differential Equations”, grant VO 1658/2-1.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Not to be confused with the “reduced-order” terminology used in the model reduction context—here, “reduced” means that the cost functional is written in dependence of the control only, using the fact that the weak solution y(u) is uniquely determined by the chosen u!

References

  1. K. Afanasiev, M. Hinze, Adaptive control of a wake flow using proper orthogonal decomposition. Lect. Notes Pure Appl. Math. 216, 317–332 (2001)

    MathSciNet  Google Scholar 

  2. A. Alla, S. Volkwein, Asymptotic stability of POD based model predictive control for a semilinear parabolic PDE. Advances in Computational Mathematics, to appear (2014). http://kops.ub.uni-konstanz.de/handle/urn:nbn:de:bsz:352-253400

  3. A.C. Antoulas, Approximation of Large-Scale Dynamical Systems (SIAM, Philadelphia, 2005)

    Book  MATH  Google Scholar 

  4. E. Arian, M. Fahl, E.W. Sachs, Trust-region proper orthogonal decomposition for flow control. Technical report 2000–25, ICASE, 2000

    Google Scholar 

  5. P. Astrid, S. Weiland, K. Willcox, T. Backx, Missing point estimation in models described by proper orthogonal decomposition. IEEE Trans. Autom. Control 53(10), 2237–2251 (2008)

    Article  MathSciNet  Google Scholar 

  6. J.A. Atwell, J.T. Borggaard, B.B. King, Reduced-order controllers for Burgers’ equation with a nonlinear observer. Int. J. Appl. Math. Comput. Sci. 11(6), 1311–1330 (2001)

    MATH  MathSciNet  Google Scholar 

  7. Z. Bai, Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems. Appl. Numer. Math. 43, 9–44 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  8. H.T. Banks, M.L. Joyner, B. Winchesky, W.P. Winfree, Nondestructive evaluation using a reduced-order computational methodology. Inverse Probl. 16, 1–17 (2000)

    Article  Google Scholar 

  9. U. Baur, Control-oriented model reduction for parabolic systems, Dissertation, TU Berlin, 2008

    MATH  Google Scholar 

  10. U. Baur, P. Benner, L. Feng, Model order reduction for linear and nonlinear systems: a system-theoretic perspective. Arch. Comput. Methods Eng. 2014 (electronic). DOI: 10.1007/s11831-014-9111-2

    Google Scholar 

  11. P. Benner, System-theoretic methods for model reduction of large-scale systems: simulation, control, and inverse problems, in Proceedings of MathMod 2009, Vienna, February 11–13, ed. by I. Troch, F. Breitenecker. Volume 35 of ARGESIM Report (2009), pp. 126–145

    Google Scholar 

  12. P. Benner, Balancing-related model reduction for parabolic control systems, in Proceedings of the 1st IFAC Workshop on Control of Systems Governed by Partial Differential Equations (IFAC Papers Online, Paris, 2013), pp. 257–262

    Google Scholar 

  13. P. Benner, J. Heiland, LQG-balanced truncation low-order controller for stabilization of laminar flows, ed. by R. King. Active Flow and Combustion Control 2014, Notes on Numerical Fluid Mechanics and Multidisciplinary Design, vol. 127 (Springer Internatinal Publishing, 2014), pp. 365–379

    Google Scholar 

  14. P. Benner, V. Mehrmann, D.C. Sorensen, Dimension Reduction of Large-Scale Systems. Lecture Notes in Computational Science and Engineering, vol. 45 (Springer, Berlin/New York, 2005)

    Google Scholar 

  15. P. Benner, E.S. Quintana-Ortí, G. Quintana-Ortí, Balanced truncation model reduction of large-scale dense systems on parallel computers. Math. Comput. Model. Dyn. Syst. 6(4), 383–405 (2000)

    Article  MATH  Google Scholar 

  16. P. Benner, J. Saak, Numerical solution of large and sparse continuous time algebraic matrix Riccati and Lyapunov equations: a state of the art survey. GAMM Mitt. 36(1), 32–52 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  17. M. Bergmann, L. Cordier, Optimal control of the cylinder wake in the laminar regime by trust-region methods and {POD} reduced-order models. J. Comput. Phys. 227(16), 7813–7840 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  18. J.T. Borggaard, S. Gugercin, Model reduction for DAEs with an application to flow control. Department of Mathematics, Virginia Tech, Blacksburg, 2014

    Google Scholar 

  19. E. Casas, Pontryagin’s principle for state-constrained boundary control problems of semilinear parabolic equations. SIAM J. Control Optim. 35, 1297–1327 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  20. D. Chapelle, A. Gariah, J. Saint-Marie, Galerkin approximation with proper orthogonal decomposition: new error estimates and illustrative examples. ESAIM: Math. Model. Numer. Anal. 46, 731–757 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  21. X. Chen, S. Akella, I.M. Navon, A dual-weighted trust-region adaptive POD 4-D VAR applied to a finite-volume shallow water equations model on the sphere. Int. J. Numer. Methods Fluids 68(3), 377–402 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  22. R. Cont, N. Lantos, O. Pironneau, A reduced basis for option pricing. SIAM J. Financ. Math. 2(1), 287–316 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  23. R.F. Curtain, Model reduction for control design for distributed parameter systems, in Research Directions in Distributed Parameter Systems. Volume 27 of Frontiers Applied Mathematics (SIAM, Philadelphia, 2003), pp. 95–121

    Google Scholar 

  24. L. Dedé, Reduced basis method and a posteriori error estimation for parametrized linear-quadratic optimal control problems. SIAM J. Sci. Comput. 32, 997–1019 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  25. J.C. De Los Reyes, T. Stykel, A balanced truncation based strategy for the optimal control of evolution problems. Optim. Methods Softw. 26(4–5), 673–694 (2011)

    Google Scholar 

  26. M. Dihlmann, B. Haasdonk, Certified nonlinear parameter optimization with reduced basis surrogate models. Proc. Appl. Math. Mech. 13, 3–6 (2013)

    Article  Google Scholar 

  27. A.L. Dontchev, W.W. Hager, A.B. Poore, B. Yang, Optimality, stability, and convergence in nonlinear control. Appl. Math. Optim. 31, 297–326 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  28. P. Feldmann, R.W. Freund, Efficient linear circuit analysis by Padé approximation via the Lanczos process. IEEE Trans. Computer-Aided Design 14, 639–649 (1995)

    Article  Google Scholar 

  29. R. Freund, Model reduction methods based on Krylov subspaces. Acta Numer. 12, 267–319 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  30. K. Gallivan, E. Grimme, P. Van Dooren, Asymptotic waveform evaluation via the Lanczos method. Appl. Math. Lett. 7, 75–80 (1994)

    Article  MATH  Google Scholar 

  31. J. Ghiglieri, S. Ulbrich, Optimal flow control based on POD and MPC and an application to the cancellation of Tollmien-Schlichting waves. Optim. Methods Softw. 29(5), 1042–1074 (2014)

    Article  MATH  MathSciNet  Google Scholar 

  32. K. Glover, R.F. Curtain, J.R. Partington, Realisation and approximation of linear infinite-dimensional systems with error bounds. SIAM J. Control Optim. 26(4), 863–898 (1988)

    Article  MATH  MathSciNet  Google Scholar 

  33. S. Rogg, Trust Region POD for Optimal Boundary Control of a Semilinear Heat Equation, Diploma thesis, Department of Mathematics and Statistics, University of Konstanz (2014)

    Google Scholar 

  34. M.A. Grepl, M. Kärcher, Reduced basis a posteriori error bounds for parametrized linear-quadratic elliptic optimal control problems. Comptes Rendus de l’Académie des Sciences—Series I 349, 873–877 (2011)

    Google Scholar 

  35. M.A. Grepl, Y. Maday, N.C. Nguyen, A.T. Patera, Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations. ESAIM: Math. Model. Numer. Anal. 41, 575–605 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  36. E. Grimm, Optimality system POD and a-posteriori error analysis for linear-quadratic optimal control problems. Master thesis, University of Konstanz, 2013

    Google Scholar 

  37. M. Gubisch, S. Volkwein, Proper orthogonal decomposition for linear-quadratic optimal control (2013, submitted). http://kops.ub.uni-konstanz.de/handle/urn:nbn:de:bsz:352-250378

  38. M. Gubisch, S. Volkwein, POD a-posteriori error analysis for optimal control problems with mixed control-state constraints. Comput. Optim. Appl. 58, 619–644 (2014)

    Article  MATH  MathSciNet  Google Scholar 

  39. S. Gugercin, Projection methods for model reduction of large-scale dynamical systems. Ph.D. thesis, Rice University, Houston, 2003

    Google Scholar 

  40. S. Gugercin, A.C. Antoulas, C. Beattie, \(\mathcal{H}_{2}\) Model reduction for large-scale dynamical systems. SIAM J. Matrix Anal. Appl. 30(2), 609–638 (2008)

    Google Scholar 

  41. B. Haasdonk, Convergence rates of the POD-Greedy method. ESAIM: Math. Model. Numer. Anal. 47, 859–873 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  42. B. Haasdonk, M. Ohlberger. Reduced basis method for finite volume approximations of parametrized linear evolution equations. ESAIM: Math. Model. Numer. Anal. 42, 277–302 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  43. M. Heinkenschloss, D.C. Sorensen, K. Sun. Balanced truncation model reduction for a class of descriptor systems with application to the Oseen equations. SIAM J. Sci. Comput. 30, 1038–1063 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  44. C. Himpe, M. Ohlberger. Cross-gramian based combined state and parameter reduction (2013, submitted)

    Google Scholar 

  45. M. Hintermüller, K. Ito, K. Kunisch, The primal-dual active set strategy as a semismooth Newton method. SIAM J. Optim. 13, 865–888 (2003)

    Article  MATH  Google Scholar 

  46. M. Hinze, R. Pinnau, M. Ulbrich, M. Ulbrich, Optimization with PDE Constraints. Mathematical Modeling: Theory and Applications, vol. 23 (Springer, Berlin, 2009)

    Google Scholar 

  47. M. Hinze, F. Tröltzsch, Discrete concepts versus error analysis in PDE constrained optimization. GAMM Mitt. 33, 148–162 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  48. M. Hinze, S. Volkwein, Proper orthogonal decomposition surrogate models for nonlinear dynamical systems: error estimates and suboptimal control (Chapter 10), in Dimension Reduction of Large-Scale Systems, ed. by P. Benner, V. Mehrmann, D.C. Sorensen. Lecture Notes in Computational Science and Engineering, vol. 45 (Springer, Berlin/New York, 2005), pp. 261–306

    Google Scholar 

  49. M. Hinze, S. Volkwein, Error estimates for abstract linear-quadratic optimal control problems using proper orthogonal decomposition. Comput. Optim. Appl. 39, 319–345 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  50. P. Holmes, J.L. Lumley, G. Berkooz, C.W. Rowley, Turbulence, Coherent Structures, Dynamical Systems and Symmetry, 2nd edn. Cambridge Monographs on Mechanics (Cambridge University Press, Cambridge/New York, 2012)

    Google Scholar 

  51. K. Ito, S.S. Ravindran, A reduced basis method for control problems governed by PDEs, in Control and Estimation of Distributed Parameter Systems, ed. by W. Desch, F. Kappel, K. Kunisch. Proceedings of the International Conference in Vorau, vol. 126 (Birkhäuser-Verlag, Basel, 1996), pp. 153–168 (1998)

    Google Scholar 

  52. M. Kahlbacher, S. Volkwein, POD a-posteriori error based inexact SQP method for bilinear elliptic optimal control problems. ESAIM: Math. Model. Numer. Anal. 46, 491–511 (2012)

    Article  MATH  Google Scholar 

  53. E. Kammann, F. Tröltzsch, S. Volkwein, A method of a-posteriori error estimation with application to proper orthogonal decomposition, ESAIM: Math. Model. Numer. Anal. 47, 555–581 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  54. K. Kunisch, S. Volkwein, Proper orthogonal decomposition for optimality systems. ESAIM: Math. Model. Numer. Anal. 42, 1–23 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  55. K. Kunisch, S. Volkwein, L. Xie, HJB-POD based feedback design for the optimal control of evolution problems. SIAM J. Appl. Dyn. Syst. 3, 701–722 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  56. S. Lall, J.E. Marsden, S. Glavaski. A subspace approach to balanced truncation for model reduction of nonlinear control systems. Int. J. Robust Nonlin. Control 12, 519–535 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  57. O. Lass, S. Volkwein, Parameter identification for nonlinear elliptic-parabolic systems with application in lithium-ion battery modeling (2013, submitted) http://kops.ub.uni-konstanz.de/handle/urn:nbn:de:bsz:352-253400

  58. F. Leibfritz, S. Volkwein, Reduced order output feedback control design for PDE systems using proper orthogonal decomposition and nonlinear semidefinite programming. Lin. Algebra Appl. 415, 542–575 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  59. S. Li, L. Feng, P. Benner, A. Seidel-Morgensterna, Using surrogate models for efficient optimization of simulated moving bed chromatography. Comput. Chem. Eng. (2014). doi:10.1016/j.compchemeng.2014.03.024

    Google Scholar 

  60. H.V. Ly, H.T. Tran, Modeling and control of physical processes using proper orthogonal decomposition. Math. Comput. Model. 33, 223–236 (2001)

    Article  MATH  Google Scholar 

  61. V. Mehrmann, T. Stykel, Balanced truncation model reduction for large-scale systems in descriptor form (Chapter 3), in Dimension Reduction of Large-Scale Systems, ed. by P. Benner, V. Mehrmann, D.C. Sorensen. Lecture Notes in Computational Science and Engineering, vol. 45 (Springer, Berlin/New York, 2005), pp. 83–115

    Google Scholar 

  62. M. Müller, Uniform convergence of the POD method and applications to optimal control. Ph.D thesis, University of Graz, 2011

    Google Scholar 

  63. F. Negri, G. Rozza, A. Manzoni, A. Quarteroni, Reduced basis method for parametrized elliptic optimal control problems. SIAM J. Sci. Comput. 35(5), A2316–A2340 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  64. B. Noack, K. Afanasiev, M. Morzynski, G. Tadmor, F. Thiele, A hierarchy of low-dimensional models for the transient and post-transient cylinder wake. J. Fluid. Mech. 497, 335–363 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  65. J. Nocedal, S.J. Wright, Numerical Optimization. Springer Series in Operations Research and Financial Engineering, 2nd edn. (Springer-Verlag, 2006)

    Google Scholar 

  66. A.T. Patera, G. Rozza, Reduced Basis Approximation and A Posteriori Error Estimation for Parametrized Partial Differential Equations. MIT Pappalardo Graduate Monographs in Mechanical Engineering (2006)

    Google Scholar 

  67. O. Pironneau, Calibration of options on a reduced basis. J. Comput. Appl. Math. 232, 139–147 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  68. M. Ohlberger, M. Schäfer, Error control based model reduction for parameter optimization of elliptic homogenization problems, in Proceedings of the 1st IFAC Workshop on Control of Systems Governed by Partial Differential Equations (IFAC Papers Online, Paris, 2013), pp. 251–256

    Google Scholar 

  69. M.R. Opmeer, Model order reduction by balanced proper orthogonal decomposition and by rational interpolation. IEEE Trans. Autom. Control 57(2), 472–477 (2012)

    Article  MathSciNet  Google Scholar 

  70. M.R. Opmeer, T. Reis, W. Wollner, Finite-rank ADI iteration for operator Lyapunov equations. SIAM J. Control Optim. 51(5), 4084–4117 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  71. M. Rathinam, L. Petzold, Dynamic iteration using reduced order models: a method for simulation of large scale modular systems. SIAM J. Numer. Anal. 40, 1446–1474 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  72. S.S. Ravindran, Reduced-order adaptive controllers for fluid flows using POD. SIAM J. Sci. Comput. 15, 457–478 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  73. J.-P. Raymond, H. Zidani, Hamiltonian Pontryagin’s principle for state-constrained control problems governed by semilinear parabolic equations. Appl. Math. Optim. 39, 143–177 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  74. M. Reed, B. Simon, Methods of Modern Mathematical Physics I: Functional Analysis (Academic, New York, 1980)

    MATH  Google Scholar 

  75. C.W. Rowley, Model reduction for fluids, using balanced proper orthogonal decomposition. Int. J. Bifurc. Chaos 15, 997–1013 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  76. E.W. Sachs, S. Volkwein, POD Galerkin approximations in PDE-constrained optimization. GAMM Mitt. 33, 194–208 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  77. A. Schiela, M. Weiser, Superlinear convergence of the control reduced interior point method for PDE constrained optimization. Comput. Optim. Appl. 39, 369–393 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  78. W.H.A. Schilders, H.A. van der Vorst, J. Rommes, Model Order Reduction: Theory, Research Aspects and Applications. Mathematics in Industry, vol. 13 (Springer, Berlin, 2008)

    Google Scholar 

  79. E.W. Sachs, M. Schneider, Reduced order models for the implied variance und local volatility. Technical report, Trier University, 2014

    Google Scholar 

  80. E.W. Sachs, M. Schu, A-priori error estimates for reduced order models in finance. ESAIM: Math. Model. Numer. Anal. 47, 449–469 (2013)

    Article  MathSciNet  Google Scholar 

  81. V. Simoncini, Computational methods for linear matrix equations (Preprint, March 2013). http://www.dm.unibo.it/~simoncin/.

  82. J.R. Singler, New POD expressions, error bounds, and asymptotic results for reduced order models of parabolic PDEs. SIAM J. Numer. Anal. 52, 852–876 (2014)

    Article  MATH  MathSciNet  Google Scholar 

  83. A. Studinger, S. Volkwein, Numerical analysis of POD a-posteriori error estimation for optimal control. Int. Ser. Numer. Math. 164, 137–158 (2013)

    Google Scholar 

  84. T. Tonn, K. Urban, S. Volkwein, Comparison of the reduced-basis and POD a-posteriori error estimators for an elliptic linear quadratic optimal control problem. Math. Comput. Model. Dyn. Syst. 17, 355–369 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  85. F. Tröltzsch, Optimal Control of Partial Differential Equations. American Mathematical Society, Graduate Studies Mathematics, vol. 112 (Springer, New York, 2010)

    Google Scholar 

  86. F. Tröltzsch, S. Volkwein, POD a-posteriori error estimates for linear-quadratic optimal control problems. Comput. Optim. Appl. 44, 83–115 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  87. M. Ulbrich, S.Ulbrich, Primal-dual interior-point methods for PDE-constrained optimization. Math. Prog. 117, 435–485 (2008)

    Google Scholar 

  88. S. Volkwein, Optimality system POD and a-posteriori error analysis for linear-quadratic problems. Control Cybern. 40, 1109–1125 (2011)

    MathSciNet  Google Scholar 

  89. G. Vossen, S. Volkwein, Model reduction techniques with a-posteriori error analysis for linear-quadratic optimal control problems. Numer. Algebra Control Optim. 2, 465–485 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  90. K. Willcox, J. Peraire, Balanced model reduction via the proper orthogonal decomposition. American Institute of Aeronautics and Astronautics (AIAA) (2002), pp. 2323–2330

    Google Scholar 

  91. Y. Yue, K. Meerbergen, Accelerating optimization of parametric linear systems by model order reduction. SIAM J. Optim. 23(2), 1344–1370 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  92. K. Zhou, J.C. Doyle, K. Glover, Robust and Optimal Control (Prentice-Hall, Upper Saddle River, 1996)

    MATH  Google Scholar 

Download references

Acknowledgements

Our thanks go to Günter Leugering for his well-structured and focused leadership throughout the six years of existence of the DFG Priority Program 1253 “Optimization with Partial Differential Equations”.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter Benner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Benner, P., Sachs, E., Volkwein, S. (2014). Model Order Reduction for PDE Constrained Optimization. In: Leugering, G., et al. Trends in PDE Constrained Optimization. International Series of Numerical Mathematics, vol 165. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-05083-6_19

Download citation

Publish with us

Policies and ethics