Summary
This manuscript introduces a new approach for increasing the efficiency of automatic differentiation (AD) computations for estimating the first order derivatives comprising the Jacobian matrix of a complex large-scale computational model. The objective is to approximate the entire Jacobian matrix with minimized computational and storage resources. This is achieved by finding low rank approximations to a Jacobian matrix via the Efficient Subspace Method (ESM). Low rank Jacobian matrices arise in many of today’s important scientific and engineering problems, e.g. nuclear reactor calculations, weather climate modeling, geophysical applications, etc. A low rank approximation replaces the original Jacobian matrix J (whose size is dictated by the size of the input and output data streams) with matrices of much smaller dimensions (determined by the numerical rank of the Jacobian matrix). This process reveals the rank of the Jacobian matrix and can be obtained by ESM via a series of r randomized matrix-vector products of the form: J q, and J T ω which can be evaluated by the AD forward and reverse modes, respectively.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abdel-Khalik, H.S.: Adaptive core simulation. Ph.D. thesis, North Carolina State University (2004)
Abdel-Khalik, H.S., Turinsky, P.J., Jessee, M.A.: Efficient subspace methods-based algorithms for performing sensitivity, uncertainty, and adaptive simulation of large-scale computational models (2008)
Averick, B.M., Moré, J.J., Bischof, C.H., Carle, A., Griewank, A.: Computing large sparse Jacobian matrices using automatic differentiation. SIAM J. Sci. Comput. 15(2), 285–294 (1994)
Bischof, C.H., Khademi, P.M., Bouaricha, A., Carle, A.: Efficient computation of gradients and jacobians by dynamic exploitation of sparsity in automatic differentiation. Optimization Methods and Software 7(1), 1–39 (1996). DOI 10.1080/ 10556789608805642
Bücker, H.M., Lang, B., Rasch, A., Bischof, C.H.: Computation of sensitivity information for aircraft design by automatic differentiation. In: P.M.A. Sloot, C.J.K. Tan, J.J. Dongarra, A.G. Hoekstra (eds.) Computational Science – ICCS 2002, Proceedings of the International Conference on Computational Science, Amsterdam, The Netherlands, April 21–24, 2002. Part II, Lecture Notes in Computer Science, vol. 2330, pp. 1069–1076. Springer, Berlin (2002)
Finnemann, H., Bennewitz, F., Wagner, M.: Interface current techniques for multi-dimensional reactor calculations. Atomkernenergie (ATKE) 30, 123–128 (1977)
Gebremedhin, A.H., Manne, F., Pothen, A.: What color is your Jacobian? Graph coloring for computing derivatives. SIAM Review 47(4), 629–705 (2005). DOI 10.1137/ S0036144504444711. URL http://link.aip.org/link/?SIR/47/629/1
Jessee, M.A., Abdel-Khalik, H.S., Turinsky, P.J.: Evaluation of BWR core attributes uncertainties due to multi-group cross-section uncertainties. In: Joint International Meeting on Mathematics and Computation, and Supercomputing in Nuclear Applications (2007)
Losch, M., Heimbach, P.: Adjoint Sensitivity of an Ocean General Circulation Model to Bottom Topography. Journal of Physical Oceanography 37(2), 377–393 (2007)
Zienkiewicz, O., Taylor, R.: The Finite Element Method, fourth edition edn. McGraw-Hill, New York (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Abdel-Khalik, H.S., Hovland, P.D., Lyons, A., Stover, T.E., Utke, J. (2008). A Low Rank Approach to Automatic Differentiation. In: Bischof, C.H., Bücker, H.M., Hovland, P., Naumann, U., Utke, J. (eds) Advances in Automatic Differentiation. Lecture Notes in Computational Science and Engineering, vol 64. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68942-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-68942-3_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68935-5
Online ISBN: 978-3-540-68942-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)