Abstract
Parallel processing systems use data parallelism to achieve high performance data processing. Data parallelism is normally based on data arrays, which are distributed to separate nodes. Therefore, efficient communication between nodes is required to initialize the distribution. In this paper, we propose a computation and communication overlapping technique to reduce the overhead of communication during array distribution. Our overlapping technique uses task parallelism for the initiate task and the worker tasks, and also the synchronization mechanism supported by Chapel. To show our overlapping technique is effective, we design and develop a parallel version of the Mandelbrot set program, and then evaluate the benefit of overlapping against the execution time of Mandelbrot. From our comparison, the overlapping technique proposed in this paper is effective in that it reduces the impact of communication in the initial array distribution.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Diaconescu, R., Zima, H.P.: An approach to data distributions in Chapel. International Journal of High Performance Computing Applications 21(3), 313–335 (2007)
Cray Inc.: Chapel Specification, 0.795 ed. Seattle, WA (April 2010)
Abdelkhalek, R., Calandra, H., Coulaud, O., Roman, J., Latu, G.: Fast Seismic Modeling and Reverse Time Migration on a GPU Cluster. In: International Conference on High Performance Computing & Simulations, Leipzig, pp. 36–43 (2009)
Steven, J.D., Bradford, L.C., Choi, S.-E., David, I.: Five Powerful Chapel Idioms, Cray User Group 2010 (2010)
Chamberlain, B.L., Callahan, D., Zima, H.P.: Parallel programmability and the Chapel language. International Journal of High Performance Computing Applications 21(3), 291–312 (2007)
Chamberlain, B.L., Deitz, S.J., Iten, D., Choi, S.-G.: User-Defined Distributions and Layouts in Chapel: Philosophy and Framework. In: USENIX Workshop on Hot Topics in Parallelism (2010)
Bikshandi, G., Guo, J., Hoeflinger, D.: Programming for Parallelism and Locality with Hierarchically Titled Arrays. In: PPoPP 2006: Proceedings of the Eleventh ACM SIGPLAN Symposium on Pinciples and Practice of Parallel Programming, pp. 48–57. ACM Press, New York (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gu, B., Yu, W., Kwak, Y. (2011). Communication and Computation Overlap through Task Synchronization in Multi-locale Chapel Environment. In: Park, J.J., Yang, L.T., Lee, C. (eds) Future Information Technology. Communications in Computer and Information Science, vol 184. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22333-4_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-22333-4_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22332-7
Online ISBN: 978-3-642-22333-4
eBook Packages: Computer ScienceComputer Science (R0)