Abstract
A new software package BC-MPI which allows an MPI application to run on several clusters with various MPI implementations is presented. It uses vendor MPI implementations for communication inside clusters and exploits the multithreaded MPI_THREAD_MULTIPLE mode for handling inter-cluster communication in additional threads of the MPI application. Furthermore, a BC-MPI application can be automatically compiled and started by the BeesyCluster middleware. The latter allows users to manage and use cluster accounts via a single BeesyCluster account and WWW or Web Services. The middleware connects to clusters via SSH and does not require any software installation on the clusters. Results of various latency and bandwidth tests for intra and inter-cluster communication are presented for BC-MPI using OpenMPI and LAM/MPI and Infiniband or TCP within clusters.
Partially covered by MNiI grant No N516 035 31/3499.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Official Crossgrid Information Portal. supported by Grant No. IST-2001-32243 of the European Commission, http://www.crossgrid.org/main.html
CLUSTERIX: The National Linux Cluster, http://clusterix.pcz.pl .
Karonis, N., Toonen, B., Foster, I.: MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface. Journal of Parallel and Distributed Computing (JPDC) 63(5), 551–563 (2003)
Sotomayor, B.: The Globus Toolkit 4 Programmer’s Tutorial (November 2005), http://www.casasotomayor.net/gt4-tutorial/
Karonis, N., Toonen, B.: MPICH-G2, http://www3.niu.edu/mpi/
Keller, R., Mller, M.: The Grid-Computing library PACX-MPI: Extending MPI for Computational Grids, www.hlrs.de/organization/amt/projects/pacx-mpi/
LAM/MPI Parallel Computing, http://www.lam-mpi.org/
National Institute of Standards and Technology: Interoperable MPI, http://impi.nist.gov/
Lusk, E., et al.: MPI-2: Extensions to the Message-Passing Interface: MPI and Threads, http://www-unix.mcs.anl.gov/mpi/mpi-standard/mpi-report-2.0node162.htm#Node162
Czarnul, P., Bajor, M., Fraczak, M., Banaszczyk, A., Fiszer, M., Ramczykowska, K.: Remote Task Submission and Publishing in BeesyCluster: Security and Efficiency of Web Service Interface. In: Wyrzykowski, R., Dongarra, J., Meyer, N., Waśniewski, J. (eds.) PPAM 2005. LNCS, vol. 3911, Springer, Heidelberg (2006)
Czarnul, P.: Integration of Compute-Intensive Tasks into Scientific Workflows in BeesyCluster. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2006. LNCS, vol. 3993, Springer, Heidelberg (2006)
Gropp, W., Lusk, E.: MPI Tutorial: Benchmarking point to point performance, http://www-unix.mcs.anl.gov/mpi/tutorial/mpiexmpl/src3/pingpong/C/main.html
Barrett, B.: Open MPI User’s Mailing List Archives, http://www.openmpi.org/community/lists/users/2006/04/1076.php
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Czarnul, P. (2008). BC-MPI: Running an MPI Application on Multiple Clusters with BeesyCluster Connectivity. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2007. Lecture Notes in Computer Science, vol 4967. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68111-3_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-68111-3_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68105-2
Online ISBN: 978-3-540-68111-3
eBook Packages: Computer ScienceComputer Science (R0)