Skip to main content

Hybrid CPU-GPU Generation of the Hamiltonian and Overlap Matrices in FLAPW Methods

  • Conference paper
  • First Online:
Book cover High-Performance Scientific Computing (JHPCS 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10164))

  • 1003 Accesses

Abstract

In this paper we focus on the integration of high-performance numerical libraries in ab initio codes and the portability of performance and scalability. The target of our work is FLEUR, a software for electronic structure calculations developed in the Forschungszentrum Jülich over the course of two decades. The presented work follows up on a previous effort to modernize legacy code by re-engineering and rewriting it in terms of highly optimized libraries. We illustrate how this initial effort to get efficient and portable shared-memory code enables fast porting of the code to emerging heterogeneous architectures. More specifically, we port the code to nodes equipped with multiple GPUs. We divide our study in two parts. First, we show considerable speedups attained by minor and relatively straightforward code changes to off-load parts of the computation to the GPUs. Then, we identify further possible improvements to achieve even higher performance and scalability. On a system consisting of 16-cores and 2 GPUs, we observe speedups of up to 5\(\times \) with respect to our optimized shared-memory code, which in turn means between 7.5\(\times \) and 12.5\(\times \) speedup with respect to the original FLEUR code.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. cuBLAS: The NVIDIA CUDA Basic Linear Algebra Subroutines. https://developer.nvidia.com/cublas

  2. Di Napoli, E., Peise, E., Hrywniak, M., Bientinesi, P.: High-performance generation of the hamiltonian and overlap matrices in FLAPW methods. Comput. Phys. Commun. 211, 61–72 (2016). doi:10.1016/j.cpc.2016.10.003

    Article  Google Scholar 

  3. FLEUR: The Jülich FLAPW code family, October 2016. http://www.flapw.de/pm/index.php

  4. Jansen, H.J.F., Freeman, A.J.: Total-energy full-potential linearized augmented-plane-wave method for bulk solids - electronic and structural-properties of tungsten. Phys. Rev. B 30(2), 561–569 (1984)

    Article  Google Scholar 

  5. Kohn, W., Sham, L.J.: Self-consistent equations including exchange and correlation effects. Phys. Rev. 140, A1133–A1138 (1965)

    Article  MathSciNet  Google Scholar 

  6. Nogueira, F., Marques, M.A.L., Fiolhais, C.: A Primer in Density Functional Theory. Lecture Notes in Physics. Springer, Heidelberg (2003)

    MATH  Google Scholar 

  7. Sholl, D., Steckel, J.A.: Density Functional Theory: A Practical Introduction. Wiley, New York (2011)

    Google Scholar 

  8. Tomov, S., Nath, R., Ltaief, H., Dongarra, J.: Dense linear algebra solvers for multicore with GPU accelerators. In: Proceedings of the IEEE IPDPS 2010, pp. 1–8. IEEE Computer Society, Atlanta, GA, 19–23 April 2010. doi:10.1109/IPDPSW.2010.5470941

  9. Wang, L., Wu, W., Xu, Z., Xiao, J., Yang, Y.: BLASX: A high performance level-3 BLAS library for heterogeneous multi-GPU computing. In: Proceedings of the 2016 International Conference on Supercomputing, ICS 2016, pp. 20:1–20:11. ACM, New York (2016)

    Google Scholar 

  10. Wimmer, E., Krakauer, H., Weinert, M., Freeman, A.J.: Full-potential self-consistent linearized-augmented-plane-wave method for calculating the electronic-structure of molecules and surfaces - O2 molecule. Phys. Rev. B 24(2), 864–875 (1981)

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially funded by the Ministry of Science and Education of the Republic of Croatia and the Deutsche Akademische Austauschdienst (DAAD) from funds of the Bundesministeriums für Bildung und Forschung (BMBF) through project “PPP Kroatien” ID 57216700. Financial support from the Jülich Aachen Research Alliance-High Performance Computing and the Deutsche Forschungsgemeinschaft (DFG) through grant GSC 111 is also gratefully acknowledged. Furthermore, the authors thank the RWTH IT Center and the Jülich Supercomputing Centre for the computational resources.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Diego Fabregat-Traver .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Fabregat-Traver, D., Davidović, D., Höhnerbach, M., Di Napoli, E. (2017). Hybrid CPU-GPU Generation of the Hamiltonian and Overlap Matrices in FLAPW Methods. In: Di Napoli, E., Hermanns, MA., Iliev, H., Lintermann, A., Peyser, A. (eds) High-Performance Scientific Computing. JHPCS 2016. Lecture Notes in Computer Science(), vol 10164. Springer, Cham. https://doi.org/10.1007/978-3-319-53862-4_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-53862-4_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-53861-7

  • Online ISBN: 978-3-319-53862-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics