Abstract
Using GPUs to accelerate the performance of HPC applications has recently gained great momentum. Energy Exascale Earth System Model (E3SM) is a state-of-the-science earth system model development and simulation project and has gained national recognition. It has a large code base with over a million lines of code. How to make effective use of GPUs, however, remains a challenge. In this paper, we use the modal aerosol module (MAM) of E3SM as a driving example to investigate how to effectively offload computational tasks to GPUs using the OpenACC directives. In particular, we are interested in the performance advantage of using GPUs and in understanding performance-limiting factors from both application characteristics and the GPU or OpenACC.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
excluding loadaer time
References
Bertagna, L., et al.: HOMMEXX 1.0: a performance portable atmospheric dynamical core for the energy exascale earth eystem model. Geosci. Model Dev. 12, 1423–1441 (2019)
Dennis, J.M., et al.: CAM-SE: a scalable spectral element dynamical core for the Community Atmosphere Model. Int. J. High Perform. Comput. 26, 74–89 (2012)
Energy Exascale System Scale. https://e3sm.org
Gettelman, A., Morrison, H.: Advanced two-moment bulk microphysics for global models. Part I: off-line tests and comparison with other schemes. J. Clim. 28, 1268–1287 (2015)
Gettelman, A., Morrison, H.: Advanced two-moment bulk microphysics for global models. Part II: global model solutions and aerosol-cloud interactions. J. Clim. 28, 1288–1307 (2015)
Larkin, J.: OpenACC, Performance Portability Delivered? https://drive.google.com/drive/folders/1f5Txw6hnlp5YhcJUfa_bX7uBYDfQqwf0
Norman, C., et al.: The OpenACC port of the Cloud Resolving Model (CRM) in the E3SM-Multi-scale Modeling Framework. https://www2.cisl.ucar.edu/sites/default/files/Norman-multicore_2018.pdf
OpenACC: More science, less programming. https://www.openacc.org
The OpenACC Application Programming Interface, version 2.7. https://www.openacc.org/sites/default/files/inline-files/OpenACC.2.7.pdf
Worley, P.H., Drake, J.B.: Performance portability in the physical parameterizations of the community atmospheric model. Int. J. High Perform. Comput. Appl. 19, 187–201 (2005)
Summit: Summit User Guide. https://www.olcf.ornl.gov/for-users/system-user-guides/summit/summit-user-guide/
Trott, C.: The Kokkos C++ Performance Portability EcoSystem. https://drive.google.com/drive/folders/1f5Txw6hnlp5YhcJUfa_bX7uBYDfQqwf0
Acknowledgements
All authors from Lawrence Berkeley National Laboratory were supported by the Office of Advanced Scientific Computing Research in the Department of Energy Office of Science under contract number DE-AC02-05CH11231. This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2020 This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply
About this paper
Cite this paper
Shan, H., Zhao, Z., Wagner, M. (2020). Accelerating the Performance of Modal Aerosol Module of E3SM Using OpenACC. In: Wienke, S., Bhalachandra, S. (eds) Accelerator Programming Using Directives. WACCPD 2019. Lecture Notes in Computer Science(), vol 12017. Springer, Cham. https://doi.org/10.1007/978-3-030-49943-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-49943-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49942-6
Online ISBN: 978-3-030-49943-3
eBook Packages: Computer ScienceComputer Science (R0)