Skip to main content

On the Effectiveness of the Fast Automatic Differentiation Methodology

  • Conference paper
  • First Online:
Optimization and Applications (OPTIMA 2018)

Abstract

In this paper, we compare the three approaches for calculating the gradient of a complex function of many variables. The compared approaches are: the use of precise, analytically derived formulas; the usage of formulas derived with the aid of the Fast Automatic Differentiation methodology; the use of standard software packages that implement the ideas of Fast Automatic Differentiation methodology. Comparison of approaches is carried out with the help of a complex function that represents the energy of atoms system whose interaction potential is the Tersoff potential. As a comparison criterion, the computer time required to calculate the gradient of the function is used. The results show the superiority of the Fast Automatic Differentiation methodology in comparison with the approach using analytical formulas. Standard packages compute the function gradient around the same time as using the formula of the Fast Automatic Differentiation methodology.

This work was partially supported by the Russian Foundation for Basic Research (project no. 17-07-00493 a).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abgaryan, K.K., Posypkin, M.A.: Optimization methods as applied to parametric identification of interatomic potentials. Comput. Math. Math. Phys. 54, 1929–1935 (2014). https://doi.org/10.1134/S0965542514120021

    Article  MathSciNet  MATH  Google Scholar 

  2. Evtushenko, Y.G.: Computation of exact gradients in distributed dynamic systems. Optim. Methods Softw. 9, 45–75 (1998). https://doi.org/10.1080/10556789808805686

    Article  MathSciNet  MATH  Google Scholar 

  3. Albu, A.F.: Application of the fast automatic differentiation to the computation of the gradient of the tersoff potential. Informacionnye tekhnologii i vychislitel’nye sistemy 1, 43–49 (2016)

    Google Scholar 

  4. Evtushenko, Y.G., Lurie, S.A., Posypkin, M.A., et al.: Application of optimization methods for finding equilibrium states of two-dimensional crystals. Comput. Math. Math. Phys. 56, 2001–2010 (2016). https://doi.org/10.1134/S0965542516120083

    Article  MathSciNet  MATH  Google Scholar 

  5. Evtushenko, Y., Lurie, S., Posypkin, M.: New optimization problems arising in modelling of 2D-crystal lattices. In: AIP Conference Proceedings, vol. 1776 (2016). https://doi.org/10.1063/1.4965341

  6. Albring, T., et al.: An aerodynamic design framework based on algorithmic differentiation. ERCOFTAC Bull. 102, 10–16 (2015)

    Google Scholar 

  7. Hogan, R.J.: Fast reverse-mode automatic differentiation using expression templates in C++. ACM Trans. Math. Softw. (TOMS) 40(4), 26–42 (2014). https://doi.org/10.1145/2560359

    Article  MathSciNet  MATH  Google Scholar 

  8. Gorchakov, A.Y.: On software packages of fast automatic differentiation. Informacionnye tekhnologii i vychislitel’nye sistemy 1, 30–36 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vladimir Zubov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Albu, A., Gorchakov, A., Zubov, V. (2019). On the Effectiveness of the Fast Automatic Differentiation Methodology. In: Evtushenko, Y., Jaćimović, M., Khachay, M., Kochetov, Y., Malkova, V., Posypkin, M. (eds) Optimization and Applications. OPTIMA 2018. Communications in Computer and Information Science, vol 974. Springer, Cham. https://doi.org/10.1007/978-3-030-10934-9_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-10934-9_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-10933-2

  • Online ISBN: 978-3-030-10934-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics