Abstract
This paper shows, by means of some examples, the suitability and expressiveness of a pattern-based approach to integrate task and data parallelism. Coordination skeletons or patterns express task parallelism among a collection of data parallel HPF tasks. Patterns specify the interaction among domains involved in the application along with the processor and data layouts. On the one hand, the use of domains, i.e. regions together with some interaction information, improves pattern reusability. On the other hand, the knowledge at the coordination level of data distribution belonging to the different HPF tasks is the key for an efficient implementation of the communication among them. Besides that, our system implementation requires no change to the runtime system support of the HPF compiler used. We also present some experimental results that show the efficiency of the model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Agrawal, G., Sussman, A., and Saltz, J.: An integrated runtime and compiletime approach for parallelizing structured and block structured applications. IEEE Transactions on Parallel and Distributed Systems, 6(7) (1995) 747–754.
Bal, H. E. and Haines, M.: Approaches for Integrating Task and Data Parallelism. IEEE Concurrency, 6(3) (1998) 74–84.
Brandes, T.: ADAPTOR Programmer’s Guide (Version 7.0). Technical documentation, GMD-SCAI, Germany. (1999) ftp://ftp.gmd.de/GMD/adaptor/docs/pguide.ps.
Carriero, N. and Gelernter, D.: Coordination Languages and their Significance. Communications of the ACM, 35(2) (1992) 97–107.
Chapman, B., Haines, M., Mehrotra, P., Zima, H., Rosendale, J. Opus: A Coordination Language for Multidisciplinary Applications. Scientific Programming, 6(2) (1997) 345–362.
Ciarpaglini, S., Folchi, L., Orlando, S., Pelagatti, S.,and Perego, R.: Integrating Task and Data Parallelism with taskHPF. International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’00), Las Vegas, Nevada. (2000) 2485–2492.
Cole, M. and Zavanella, A.: Activity Graphs: A Model-Independent Intermediate Layer for Skeletal Coordination. 15th Annual ACM Symposium on Applied Computing (SAC’00). Special Track on Coordination Models, Villa Olmo, Como, Italy. (2000) 255–261.
Díaz, M., Rubio, B., Soler, E., and Troya, J. M.: BCL: A Border-based Coordination Language. International Conference on Parallel and Distributed Processing Techniques and Applications PDPTA’00), Las Vegas, Nevada. (2000) 753–760.
Díaz, M., Rubio, B., Soler, and E., Troya, J. M.: DIP: A Pattern-based Approach for Task and Data Parallelism Integration. To appear in 16th Annual ACM Symposium on Applied Computing (SAC’01). Special Track on Coordination Models, Las Vegas, Nevada. (2001).
Dinda, P., Gross, T., O’Hallaron, D., Segall, E., Stichnoth, J., Subhlok, J., Webb, J., and Yang, B.: The CMU task parallel program suite. Technical Report CMU-CS-94-131, School of Computer Science, Carnegie Mellon University, (1994).
Foster, I., Kohr, D., Krishnaiyer, R. and Choudhary, A.: A library-based approach to task parallelism in a data-parallel language. J. of Parallel and Distributed Computing, 45(2) (1997) 148–158.
High Performance Fortran Forum: High Performance Fortran Language Specification version 2.0 (1997).
Koelbel, C., Loveman, D., Schreiber, R., Steele, G., and Zosel, M.: The High Performance Fortran Handbook. MIT Press (1994).
Orlando S. and Perego, R.: COLTHPF A Run-Time Support for the High-Level Coordination of HPF Tasks. Concurrency: Practice and experience, 11(8) (1999) 407–434.
Pelagatti, S.: Structured Development of Parallel Programs. Taylor&Francis (1997).
Rauber, T. and RÜnger, G.: A Coordination Language for Mixed Task and Data Parallel Programs. 14th Annual ACM Symposium on Applied Computing (SAC’99). Special Track on Coordination Models, San Antonio, Texas. (1999) 146–155.
Skillincorn, D.: The Network of Tasks Model. International Conference on Parallel and Distributed Computing and Systems (PDCS’99). Boston, Massachusetts. (1999).
Skillincorn, D. and Pelagatti, S.: Building Programs in the Network of Tasks Model. 15th Annual ACM Symposium on Applied Computing (SAC’00). Special Track on Coordination Models, Villa Olmo, Como, Italy. (2000) 248–254.
Subhlok, J. and Yang, B.: A New Model for Integrated Nested Task and Data Parallel Programming. 6th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP’97), Las Vegas, Nevada. (2000) 1–12.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Díaz, M., Rubio, B., Soler, E., Troya, J.M. (2001). Integrating Task and Data Parallelism by Means of Coordination Patterns. In: Mueller, F. (eds) High-Level Parallel Programming Models and Supportive Environments. HIPS 2001. Lecture Notes in Computer Science, vol 2026. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45401-2_2
Download citation
DOI: https://doi.org/10.1007/3-540-45401-2_2
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41944-0
Online ISBN: 978-3-540-45401-4
eBook Packages: Springer Book Archive