Abstract
For generality, MPI collective operations support arbitrary dense communication patterns. However, in many applications where collective operations would be beneficial, only sparse communication patterns are required. This paper presents one such application: Octopus, a production-quality quantum mechanical simulation. We introduce new sparse collective operations defined on graph communicators and compare their performance to MPI_Alltoallv. Besides the scalability improvements to the collective operations due to sparsity, communication overhead in the application was reduced by overlapping communication and computation. We also discuss the significant improvement to programmability offered by sparse collectives.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hoefler, T., et al.: Optimizing a Conjugate Gradient Solver with Non-Blocking Collective Operations. Journal of Parallel Computing 33(9), 624–633 (2007)
Castro, A., Marques, M.A.L., Rubio, A.: Propagators for the time-dependent kohn-sham equations. The Journal of Chemical Physics 121(8), 3425–3433 (2004)
Castro, A.: Octopus: a tool for the application of time-dependent density functional theory. Phys. stat. sol (b) 243(11), 2465–2488 (2006)
Alexandrov, A., et al.: LogGP: Incorporating Long Messages into the LogP Model. Journal of Parallel and Distributed Computing 44(1), 71–79 (1995)
Hoefler, T., et al.: A Case for Standard Non-Blocking Collective Operations. In: Recent Advances in Parallel Virtual Machine and Message Passing Interface 2007, vol. 4757, pp. 125–134. Springer, Heidelberg (2007)
Hoefler, T., et al.: Implementation and Performance Analysis of Non-Blocking Collective Operations for MPI. In: 2007 International Conference on High Performance Computing, Networking, Storage and Analysis, SC 2007, IEEE Computer Society/ACM (November 2007)
Hoefler, T., et al.: Optimizing non-blocking Collective Operations for InfiniBand. In: 22nd International Parallel & Distributed Processing Symposium (April 2008)
Hoefler, T., Lorenzen, F., Gregor, D., Lumsdaine, A.: Topological Collectives for MPI-2. Technical report, Open Systems Lab, Indiana University (February 2008)
Karypis, G., Kumar, V.: A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20(1), 359–392 (1998)
Kohn, W., Sham, L.J.: Self-consistent equations including exchange and correlation effects. Phys. Rev. 140, A1133 (1965)
Runge, E., Gross, E.K.U.: Density-functional theory for time-dependent systems. Phys. Rev. Lett. 52(12), 997 (1984)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hoefler, T., Lorenzen, F., Lumsdaine, A. (2008). Sparse Non-blocking Collectives in Quantum Mechanical Calculations. In: Lastovetsky, A., Kechadi, T., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2008. Lecture Notes in Computer Science, vol 5205. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87475-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-87475-1_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87474-4
Online ISBN: 978-3-540-87475-1
eBook Packages: Computer ScienceComputer Science (R0)