Abstract
In this paper we compare various design alternatives for synchronization in MPI-2 passive one-sided communication on InfiniBand clusters. We discuss several requirements for synchronization in passive one-sided communication. Based on these requirements, we present four design alternatives, which can be classified into two categories: thread-based and atomic operation-based. In thread-based designs, synchronization is achieved with the help of extra threads. In atomic operation-based designs, we exploit InfiniBand atomic operations such as Compare-and-Swap and Fetch-and-Add. Our performance evaluation results show that the atomic operation-based design can require less synchronization overhead, achieve better concurrency, and consume fewer computing resources compared with the thread based design.
This research is supported by Department of Energy’s grant #DE-FC02-01ER25506, National Science Foundation’s grants #CNS-0204429 and #CCR-0311542, and Post-doctoral Fellowship Program of Korea Science & Engineering Foundation(KOSEF). This work is also supported by the Mathematical, Information, and Computational Sciences Division subprogram of the Office of Advanced Scientific Computing Research, Office of Science, U.S. Department of Energy, under Contract W-31-109-ENG-38.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Argonne National Laboratory. MPICH2, http://www.mcs.anl.gov/mpi/mpich2/
Asai, N., Kentemich, T., Lagier, P.: MPI-2 Implementation on Fujitsu Generic Message Passing Kernel. In: SC (1999)
Booth, S., Mourao, F.E.: Single Sided MPI Implementations for SUN MPI. In: SC (2000)
Golebiewski, M., Traff, J.L.: MPI-2 One-Sided Communications on a Giganet SMP Cluster. In: EuroPVM/MPI (2001)
InfiniBand Trade Association. InfiniBand Architecture Specification, Release 1.0, October 24 (2000)
Jiang, W., Liu, J., Jin, H.-W., Panda, D.K., Buntinas, D., Thakur, R., Gropp, W.: Efficient Implementation of MPI-2 Passive One-Sided Communication over Infini-Band Clusters. Technical Report OSU-CISRC-5/04-TR34 (May 2004)
Jiang, W., Liu, J., Jin, H.-W., Panda, D.K., Gropp, W., Thakur, R.: High Performance MPI-2 One-Sided Communication over InfiniBand. In: IEEE/ACM CCGrid (2004)
LAM Team, Indiana University. LAM 7.0.4
Liu, J., Jiang, W., Wyckoff, P., Panda, D.K., Ashton, D., Buntinas, D., Gropp, W., Toonen, B.: Design and Implementation of MPICH2 over InfiniBand with RDMA Support. In: IPDPS (April 2004)
Mellor-Crummey, J.M., Scott, M.L.: Algorithms for Scalable Synchronization on Shared-Memory Multiprocessors. ACM Trans. on Computer System (1991)
Message Passing Interface Forum. MPI-2: A Message Passing Interface Standard. High Performance Computing Applications 12(1-2), 1–299 (1998)
Mourao, E., Booth, S.: Single Sided Communications in Multi-Protocol MPI. In: EuroPVM/MPI (2000)
Mourao, F.E., Silva, J.G.: Implementing MPI’s One-Sided Communications for WMPI. In: EuroPVM/MPI (September 1999)
Network-Based Computing Laboratory. MVAPICH2: MPI-2 for InfiniBand on VAPI Layer (January 2003), http://nowlab.cis.ohio-state.edu/projects/mpi-iba/index.html
Schulz, M.: Efficient Coherency and Synchronization Management in SCI based DSM systems. In: SCI-Europe, Conference Stream of Euro-Par (2000)
Traff, J., Ritzdorf, H., Hempel, R.: The Implementation of MPI-2 One-Sided Communication for the NEC SX. In: SC (2000)
Worringen, J., Gaer, A., Reker, F.: Exploiting Transparent Remote Memory Access for Non-Contiguous and One-Sided-Communication. In: CAC (April 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, W. et al. (2004). Efficient Implementation of MPI-2 Passive One-Sided Communication on InfiniBand Clusters. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2004. Lecture Notes in Computer Science, vol 3241. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30218-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-30218-6_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23163-9
Online ISBN: 978-3-540-30218-6
eBook Packages: Springer Book Archive