Abstract
In this paper we present two solutions to dynamic interoperable MPI communication. These solutions use the Inter-Cluster Interface library that we have developed. The first solution relies on the MPI-2 Standard; specifically on general requests, threads and “external32” encoding. The second solution discusses adjustments to the first solution that allow its implementation in environments where some parts of the MPI-2 Standard are not implemented, and can even work independently of MPI. We have successfully implemented these solutions in a number of scenarios, including parallelizing SAT solvers, with good speedup results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aumage, O., Mercier, G., Namyst, R.: MPICH/Madeleine: a True Multi-Protocol MPI for High Performance Networks. In: IPDPS (2001)
Dongarra, J., Fagg, G.E., Geist, G.A., Kohl, J.A., Papadopoulos, P.M., Scott, S.L., Sunderam, V., Magliardi, M.: HARNESS: Heterogeneous Adaptable Reconfigurable NEtworked SystemS. In: HPDC (1998)
Moskewicz, M.W., Madigan, C., Zhao, Y., Zhang, L., Malik, S.: Engineering an Efficient SAT Solver. In: Proceedings of the 38th ACM/IEEE Design Automation Conference (2001)
Fagg, G.E., London, K.S., Dongarra, J.: MPI_Connect Managing Heterogeneous MPI Applications Interoperation and Process Control. In: Proc. of the 5th European PVM/MPI Users’ Group. Springer, Heidelberg (1998)
Squyres, J.M., Lumsdaine, A.: A Component Architecture for LAM/MPI. In: Proceedings of 10th European PVM/MPI Users’ Group Meeting. Springer, Heidelberg (2003)
Gabriel, E., Resch, M., Beisel, T., Keller, R.: Distributed Computing in a Heterogeneous Computing Environment. In: Proc. of the 5th European PVM/MPI Users’ Group Meeting. Springer, Heidelberg (1998)
Message Passing Interface Forum. MPI-2: A Message-Passing Interface Standard. The International Journal of Supercomputer Applications and High Performance Computing 12(1-2) (1998)
Gropp, W., Lusk, E., Doss, N., Skjellum, A.: A High-Performance, Portable Imple-mentation of the MPI Message-Passing Interface Standard. In: Parallel Computing (1996)
Kouril, M., Paul, J.L.: A Parallel Backtracking Framework (BkFr) for Single and Multiple Clusters. In: Conf. Computing Frontiers. ACM Press, New York (2004)
IMPI Steering Committee: IMPI - Interoperable Message-Passing Interface (1998), http://impi.nist.gov/IMPI/
Karonis, N., Toonen, B., Foster, I.: MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface. In: Journal of Parallel and Distributed Computing (2003)
Kielmann, T., Hofman, R.F.H., Bal, H.E., Plaat, A., Bhoedjang, R.A.F.: MagPIe: MPI’s Collective Communication Operations for Clustered Wide Area Systems. In: ACM SIG-PLAN Notices (1999)
Kouril, M., Paul, J.L.: Dynamic Interoperable Point-to-Point Connection of MPI Implementations. Brief Announcement. In: Twenty-Fourth Annual ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (2005)
Message Passing Interface Forum: MPI: A Message-Passing Interface Standard. International Journal of Supercomputer. Applications Special issue on MPI 8(3/4) (1994)
Franco, J., Kouril, M., Schlipf, J.S., Ward, J., Weaver, S., Dransfield, M., Vanfleet, W.M.: SBSAT: a state-based, BDD-based Satisfiability solver. In: Giunchiglia, E., Tacchella, A. (eds.) SAT 2003. LNCS, vol. 2919, pp. 398–410. Springer, Heidelberg (2004)
Kouril, M., Franco, J.: Resolution Tunnels for Improved SAT Solver Performance. In: Eighth International Conference on Theory and Applications of Satisfiability Testing (2005)
Franco, J., Kouril, M., Schlipf, J.S., Weaver, S., Dransfield, M., Vanfleet, W.M.: Function-complete lookahead in support of efficient SAT search heuristics. Journal of Universal Computer Science. Know Center and IICM, Graz University, Austria (2004)
Brune, M., Gehring, J., Reinefeld, A.: A Lightweight Communication Interface for Parallel Programming Environments. In: HPCN 1997. Springer, Heidelberg (1997)
Imamura, T., Tsujita, Y., Koide, H., Takemiya, H.: An Architecture of Stampi: MPI Library on a Cluster of Parallel Computers. In: Proc. of the 7th European PVM/MPI Users’ Group Meeting (2000)
Rabenseifner, R.: MPI-GLUE: Interoperable High-Performance MPI Combining Different Vendor’s MPI Worlds. In: Euro-Par (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kouril, M., Paul, J.L. (2005). Dynamic Interoperable Message Passing. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2005. Lecture Notes in Computer Science, vol 3666. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11557265_24
Download citation
DOI: https://doi.org/10.1007/11557265_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29009-4
Online ISBN: 978-3-540-31943-6
eBook Packages: Computer ScienceComputer Science (R0)