Summary
In applied optimization, an understanding of the sensitivity of the optimal value to changes in structural parameters is often essential. Applications include parametric optimization, saddle point problems, Benders decompositions, and multilevel optimization. In this paper we adapt a known automatic differentiation (AD) technique for obtaining derivatives of implicitly defined functions for application to optimal value functions. The formulation we develop is well suited to the evaluation of first and second derivatives of optimal values. The result is a method that yields large savings in time and memory. The savings are demonstrated by a Benders decomposition example using both the ADOL-C and CppAD packages. Some of the source code for these comparisons is included to aid testing with other hardware and compilers, other AD packages, as well as future versions of ADOL-C and CppAD. The source code also serves as an aid in the implementation of the method for actual applications. In addition, it demonstrates how multiple C++ operator overloading AD packages can be used with the same source code. This provides motivation for the coding numerical routines where the floating point type is a C++ template parameter.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Azmy, Y.: Post-convergence automatic differentiation of iterative schemes. Nuclear Science and Engineering 125(1), 12–18 (1997)
Beck, T.: Automatic differentiation of iterative processes. Journal of Computational and Applied Mathematics 50(1–3), 109–118 (1994)
Bell, B.: CppAD: a package for C++ algorithmic differentiation (2007). http://www.coin-or.org/CppAD
Büskens, C., Griesse, R.: Parametric sensitivity analysis of perturbed PDE optimal control problems with state and control constraints. Journal of Optimization Theory and Applications 131(1), 17–35 (2006)
Christianson, B.: Reverse accumulation and implicit functions. Optimization Methods and Software 9, 307–322 (1998)
Gilbert, J.: Automatic differentiation and iterative processes. Optimization Methods and Software 1(1), 13–21 (1992)
Griewank, A., Bischof, C., Corliss, G., Carle, A., Williamson, K.: Derivative convergence for iterative equation solvers. Optimization Methods and Software 2(3–4), 321–355 (1993)
Griewank, A., Faure, C.: Reduced functions, gradients and Hessians from fixed-point iterations for state equations. Numerical Algorithms 30(2), 113–39 (2002)
Griewank, A., Juedes, D., Mitev, H., Utke, J., Vogel, O., Walther, A.: ADOL-C: A package for the automatic differentiation of algorithms written in C/C++. Tech. rep., Institute of Scientific Computing, Technical University Dresden (1999). Updated version of the paper published in ACM Trans. Math. Software 22, 1996, 131–167
Schachtner, R., Schaffler, S.: Critical stationary points and descent from saddlepoints in constrained optimization via implicit automatic differentiation. Optimization 27(3), 245–52 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bell, B.M., Burke, J.V. (2008). Algorithmic Differentiation of Implicit Functions and Optimal Values. In: Bischof, C.H., Bücker, H.M., Hovland, P., Naumann, U., Utke, J. (eds) Advances in Automatic Differentiation. Lecture Notes in Computational Science and Engineering, vol 64. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68942-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-68942-3_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68935-5
Online ISBN: 978-3-540-68942-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)