Abstract
This paper presents a directive-based programming and runtime environment that provides a lightweight framework for executing task parallelism on top of MPI. It facilitates the development of message-passing applications that follow the master-slave programming paradigm, supports multiple levels of parallelism and provides transparent load balancing with a combination of static and dynamic scheduling of tasks. A source-to-source translator converts C and Fortran master-slave programs, which express their task (RPC-like) parallelism with a set of OpenMP-like directives, to equivalents programs with calls to a runtime library. The result is a unified programming approach that enables the efficient execution of the same code on both shared and distributed memory multiprocessors. Experimental results on a Linux-cluster demonstrate the successful combination of ease of programming with the performance of MPI.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Antoniu, G., Bouge, L., Namyst, R., Perez, C.: Compiling Data-parallel Programs to A Distributed Runtime Environment with Thread Isomigration. Parallel Processing Letters 10(2-3), 201–214 (2000)
Huang, C., Lawlor, O., Kale, L.V.: Adaptive MPI. In: 16th Intl. Workshop on Languages and Compilers for Parallel Computing, College Station, TX, USA (October 2003)
Goux, J.-P., Kulkarni, S., Linderoth, J., Yoder, M.: An Enabling Framework for Master-Worker Applications on the Computational Grid. In: Proc. 9th IEEE Intl. Symposium on High Performance Distributed Computing, Pittsburgh, Pennsylvania, USA (August 2000)
Hadjidoukas, P.E., Polychronopoulos, E.D., Papatheodorou, T.S.: OpenMP for Adaptive Master-Slave Message Passing Applications. In: Proc. Intl. Workshop on OpenMP Expreriences and Implementations, Tokyo, Japan (October 2003)
: Message Passing Interface Forum: MPI: A message-passing interface standard. Intl. Journal of Supercomputer Applications and High Performance Computing 8(3/4) (1994)
OpenMP Architecture Review Board: OpenMP Specifications, Available at: http://www.openmp.org
Sato, M., Boku, T., Takahashi, D.: OmniRPC:a Grid RPC ystem for Parallel Programming in Cluster and Grid Environment. In: Proc. 3rd Intl. Symposium on Cluster Computing and the Grid, Tokyo, Japan (May 2003)
Shao, G., Berman, F., Wolski, R.: Master/Slave Computing on the Grid. In: Proc. 9th Heterogeneous Computing Workshop, Cancun, Mexico (May 2000)
Su, E., Tian, X., Girkar, M., Grant, H., Shah, S., Peterson, P.: Compiler Support of the Workqueuing Execution Model for Intel SMP Architectures. In: Proc. 4th European Workshop on OpenMP, Rome, Italy (September 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hadjidoukas, P.E. (2004). A Lightweight Framework for Executing Task Parallelism on Top of MPI. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2004. Lecture Notes in Computer Science, vol 3241. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30218-6_41
Download citation
DOI: https://doi.org/10.1007/978-3-540-30218-6_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23163-9
Online ISBN: 978-3-540-30218-6
eBook Packages: Springer Book Archive