Abstract
In adaptive irregular out-of-core applications, communications and mass disk I/O operations occupy a large portion of the overall execution. This paper presents a program transformation scheme to enable overlap of communication, computation and disk I/O in this kind of applications. We take programs in inspector-executor model as starting point, and transform them to a pipeline fashion. By decomposing the inspector phase and reordering iterations, more overlap opportunities are efficiently utilized. In the experiments, our techniques are applied to two important applications i.e. Partial differential equation solver and Molecular dynamics problems. For these applications, versions employing our techniques are almost 30% faster than inspector-executor versions.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Han, H., Tseng, C.-W.: Improving Locality for Adaptive Irregular Scientific Codes. In: Midkiff, S.P., Moreira, J.E., Gupta, M., Chatterjee, S., Ferrante, J., Prins, J.F., Pugh, B., Tseng, C.-W. (eds.) LCPC 2000. LNCS, vol. 2017, Springer, Heidelberg (2001)
Brezany, P., Dang, M.: CHAOS+ Runtime Library.Internal Report, Institute forSoftware Technology and Parallel Systems, University of Vienna (September 1997)
Brezany, P., Bubak, M.: Irregular and Out-of-Core Parallel Computing on Clusters. In: Wyrzykowski, R., Dongarra, J.J., Paprzycki, M., Waśniewski, J. (eds.) PPAM 2001. LNCS, vol. 2328, pp. 299–306. Springer, Heidelberg (2002)
van Leeuwen, J. (ed.): Computer Science Today. LNCS, vol. 1000. Springer, Heidelberg (1995)
Lonsdale, G., Zimmermann, F., Clinckemaillie, J., Meliciani, S.: HPF+ investigations with crash-simulation kernels. Massively Parallel Programming Models. In: Proceedings. Third Working Conference, (12-14 November, 1997) pp. 206–212 (1997)
Basumallik, A., Eigenmann, R.: Optimizing irregular shared-memory applications for distributed-memory systems. In: Proceedings of the eleventh ACM SIGPLAN symposium on Principles and practice of parallel programming, New York, USA, pp. 119–128
COSMIC group, University of Maryland. COSMIC software for irregular applications. http://www.cs.umd.edu/projects/cosmic/software.html
Brooks, B.R., Bruccoleri, R.E., Olafson, B.D., States, D.J., Swaminathan, S., Karplus, M.: Charmm: A program for macromolecular energy, minimization, and dynamics calculations. J. Comp. Chem. 4, 187–217 (1983)
Simon, H.: Partitioning of unstructured problems for parallel processing. Computing Systems in Engineering 2(2-3), 135–148 (1991)
Abu-Subah, W., Kuck, D., Lawrie, D.: On the performance enhancement of paging systems through program environment. Comm. ACM 12(3), 153–165 (1969)
Abu-Sufah, W., Kuck, D., Lawrie, D.: On the performance enhancement of paging systems through program analysis and transformations. IEEE Trans. Comput. C. 30(5), 341–356 (1981)
Malkawi, M., Patel, J.: Compiler directed memory management policy for numerical programs. In: SOSP 1985. Proc. ACM Symposium on Operating Systems Principles (1985)
Thakur, R., Bordawekar, R., Choudhary, A.: Compiler and Runtime Support for Out-of-Core HPF Programs. In: Proceedings of the 1994 ACM International Conference on Supercomputing, Manchester, pp. 382–391 (July 1994)
Cormen, T.H., Colvin, A.: ViC*: A Preprocessor for Virtual-Memory C*. TR: PCS-TR94-243, Dept. of Computer Science, Dartmouth College (November 1994)
Koelbel, C., Mehrotra, P., Saltz, J., Berryman, S.: Parallel Loops on Distributed Machines. In: Proceedings of the 5th Distributed Memory Computing Conference, pp. 1097–1119. IEEE Computer Society Press, Los Alamitos (1990)
Abdelrahman, T.S., Liu, G.: Overlap of computation and communication on shared-memory networks-of-workstations. Cluster computing, 35–45 (2001)
Danalis, A., Kim, K.-Y., Pollock, L., Swany, M.: Transformations to Parallel Codes for Communication- Computation Overlap. In: Supercomputing, 2005. Proceedings of the ACM/IEE/SC 2005 Conference, pp. 58–58. IEEE Computer Science Press (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hu, C., Yao, G., Wang, J., Li, J. (2007). Transforming the Adaptive Irregular Out-of-Core Applications for Hiding Communication and Disk I/O. In: Meersman, R., Tari, Z. (eds) On the Move to Meaningful Internet Systems 2007: CoopIS, DOA, ODBASE, GADA, and IS. OTM 2007. Lecture Notes in Computer Science, vol 4804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76843-2_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-76843-2_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76835-7
Online ISBN: 978-3-540-76843-2
eBook Packages: Computer ScienceComputer Science (R0)