Skip to main content

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 3666))

Abstract

In this paper we present two solutions to dynamic interoperable MPI communication. These solutions use the Inter-Cluster Interface library that we have developed. The first solution relies on the MPI-2 Standard; specifically on general requests, threads and “external32” encoding. The second solution discusses adjustments to the first solution that allow its implementation in environments where some parts of the MPI-2 Standard are not implemented, and can even work independently of MPI. We have successfully implemented these solutions in a number of scenarios, including parallelizing SAT solvers, with good speedup results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aumage, O., Mercier, G., Namyst, R.: MPICH/Madeleine: a True Multi-Protocol MPI for High Performance Networks. In: IPDPS (2001)

    Google Scholar 

  2. Dongarra, J., Fagg, G.E., Geist, G.A., Kohl, J.A., Papadopoulos, P.M., Scott, S.L., Sunderam, V., Magliardi, M.: HARNESS: Heterogeneous Adaptable Reconfigurable NEtworked SystemS. In: HPDC (1998)

    Google Scholar 

  3. Moskewicz, M.W., Madigan, C., Zhao, Y., Zhang, L., Malik, S.: Engineering an Efficient SAT Solver. In: Proceedings of the 38th ACM/IEEE Design Automation Conference (2001)

    Google Scholar 

  4. Fagg, G.E., London, K.S., Dongarra, J.: MPI_Connect Managing Heterogeneous MPI Applications Interoperation and Process Control. In: Proc. of the 5th European PVM/MPI Users’ Group. Springer, Heidelberg (1998)

    Google Scholar 

  5. Squyres, J.M., Lumsdaine, A.: A Component Architecture for LAM/MPI. In: Proceedings of 10th European PVM/MPI Users’ Group Meeting. Springer, Heidelberg (2003)

    Google Scholar 

  6. Gabriel, E., Resch, M., Beisel, T., Keller, R.: Distributed Computing in a Heterogeneous Computing Environment. In: Proc. of the 5th European PVM/MPI Users’ Group Meeting. Springer, Heidelberg (1998)

    Google Scholar 

  7. Message Passing Interface Forum. MPI-2: A Message-Passing Interface Standard. The International Journal of Supercomputer Applications and High Performance Computing 12(1-2) (1998)

    Google Scholar 

  8. Gropp, W., Lusk, E., Doss, N., Skjellum, A.: A High-Performance, Portable Imple-mentation of the MPI Message-Passing Interface Standard. In: Parallel Computing (1996)

    Google Scholar 

  9. Kouril, M., Paul, J.L.: A Parallel Backtracking Framework (BkFr) for Single and Multiple Clusters. In: Conf. Computing Frontiers. ACM Press, New York (2004)

    Google Scholar 

  10. IMPI Steering Committee: IMPI - Interoperable Message-Passing Interface (1998), http://impi.nist.gov/IMPI/

  11. Karonis, N., Toonen, B., Foster, I.: MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface. In: Journal of Parallel and Distributed Computing (2003)

    Google Scholar 

  12. Kielmann, T., Hofman, R.F.H., Bal, H.E., Plaat, A., Bhoedjang, R.A.F.: MagPIe: MPI’s Collective Communication Operations for Clustered Wide Area Systems. In: ACM SIG-PLAN Notices (1999)

    Google Scholar 

  13. Kouril, M., Paul, J.L.: Dynamic Interoperable Point-to-Point Connection of MPI Implementations. Brief Announcement. In: Twenty-Fourth Annual ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (2005)

    Google Scholar 

  14. Message Passing Interface Forum: MPI: A Message-Passing Interface Standard. International Journal of Supercomputer. Applications Special issue on MPI 8(3/4) (1994)

    Google Scholar 

  15. Franco, J., Kouril, M., Schlipf, J.S., Ward, J., Weaver, S., Dransfield, M., Vanfleet, W.M.: SBSAT: a state-based, BDD-based Satisfiability solver. In: Giunchiglia, E., Tacchella, A. (eds.) SAT 2003. LNCS, vol. 2919, pp. 398–410. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  16. Kouril, M., Franco, J.: Resolution Tunnels for Improved SAT Solver Performance. In: Eighth International Conference on Theory and Applications of Satisfiability Testing (2005)

    Google Scholar 

  17. Franco, J., Kouril, M., Schlipf, J.S., Weaver, S., Dransfield, M., Vanfleet, W.M.: Function-complete lookahead in support of efficient SAT search heuristics. Journal of Universal Computer Science. Know Center and IICM, Graz University, Austria (2004)

    Google Scholar 

  18. Brune, M., Gehring, J., Reinefeld, A.: A Lightweight Communication Interface for Parallel Programming Environments. In: HPCN 1997. Springer, Heidelberg (1997)

    Google Scholar 

  19. Imamura, T., Tsujita, Y., Koide, H., Takemiya, H.: An Architecture of Stampi: MPI Library on a Cluster of Parallel Computers. In: Proc. of the 7th European PVM/MPI Users’ Group Meeting (2000)

    Google Scholar 

  20. Rabenseifner, R.: MPI-GLUE: Interoperable High-Performance MPI Combining Different Vendor’s MPI Worlds. In: Euro-Par (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kouril, M., Paul, J.L. (2005). Dynamic Interoperable Message Passing. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2005. Lecture Notes in Computer Science, vol 3666. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11557265_24

Download citation

  • DOI: https://doi.org/10.1007/11557265_24

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-29009-4

  • Online ISBN: 978-3-540-31943-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics