Abstract
This paper addresses the problem of providing software support for simulating complex physical systems that require multiple physical models, potentially at multiple scales and resolutions and implemented using different programming languages and distinct parallel programming paradigms. The individual models must be coupled to allow them to exchange information either at boundaries where the models align in physical space or in areas where they overlap in space. Employing multiple physical models presents several difficult challenges, both in modeling the physics correctly and in efficiently coupling multiple simulation codes for a complete physical system. As a solution we describe InterComm, a framework that addresses three main parts of the problem: (1) providing comprehensive support for specifying at runtime what data is to be transferred between models, (2) flexibly specifying and efficiently determining when the data should be moved, and (3) effectively deploying multiple simulation codes in a high performance distributed computing environment (the Grid).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brown, D.L., Chesshire, G.S., Henshaw, W.D., Quinlan, D.J.: Overture: An object oriented software systemfor solving partial differential equations in serial and parallel environments. In: Proceedings of the Eighth SIAM Conference on Parallel Processing for Scientific Computing, SIAM, Philadelphia (1997)
Common Component Architecture Forum, http://www.cca-forum.org
Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: Proceedings of the Tenth IEEE International Symposium on High Performance Distributed Computing (HPDC 2001), August 2001, IEEE Computer Society Press, Los Alamitos (2001)
Earth System Modeling Framework, ESMF (2003), http://www.esmf.ucar.edu/
Fedder, J., Slinker, S., Lyon, J., Elphinstone, R.: Global numerical simulation of the growth phase and the expansion onset for substorm observed by Viking. Journal of Geophysical Research 100, 19083 (1995)
Foster, I., Kesselman, C.: The Grid 2: Blueprint for a New Computing Infrastructure, 2nd edn. Morgan Kaufman / Elsevier (2003)
Geist, G.A., Kohl, J.A., Papadopoulos, P.M.: CUMULVS: Providing Fault-Tolerance, Visualization and Steering of Parallel Applications. International Journal of High Performance Computing Applications 11(3), 224–236 (1997)
Gelernter, D., Carriero, N.: Coordination languages and their significance. Commun. ACMÂ 32(2) (February 1992)
High Performance Fortran Forum. HPF language specification, version 2.0 (January 1997), Available from http://www.netlib.org/hpf
Jiao, X., Campbell, M., Heath, M.: Roccom: An object-oriented, data-centric software integration framework formultiphysics simulations. In: Proceedings of the 2003 International Conference on Supercomputing, June 2003, pp. 358–368. ACM Press, New York (2003)
Keahey, K., Fasel, P., Mniszewski, S.: PAWS: Collective Interactions and Data Transfers. In: Proceedings of the Tenth IEEE International Symposium on High Performance Distributed Computing (HPDC 2001), August 2001, IEEE Computer Society Press, Los Alamitos (2001)
Larson, J.W., Jacob, R., Foster, I., Guo, J.: The Model Coupling Toolkit. In: Proceedings of International Conference on Computational Science (2001)
Lee, J.Y., Sussman, A.: Efficient communication between parallel programs with Inter-Comm. Technical Report CS-TR-4557 and UMIACS-TR-2004-04, University of Maryland, Department of Computer Science and UMIACS (January 2004)
Linker, J., Mikic, Z., Biesecker, D., Forsyth, R., Gibson, S., Lazarus, A., Lecinski, A., Riley, P., Szabo, A., Thompson, B.: Magnetohydrodynamic modeling of the solar corona during whole sun month. Journal of Geophysical Research 104, 9809–9830 (1999)
McNutt, R., Lyon, J., Goodrich, C., Wiltberger, M.: 3DMHD simulations of the heliosphere-VLISM interaction. In: AIP Conference Proceedings 471: Solar Wind Nine, p. 823. American Institute of Physics, New York (1999)
Miller, B.P., Callaghan, M.D., Cargille, J.M., Hollingsworth, J.K., Irvin, R.B., Karavanic, K.L., Kunchithapadam, K., Newhall, T.: The Paradyn parallel performance measurement tool. IEEE Computer 28(11), 37–46 (1995)
Saltz, J., Sussman, A., Graham, S., Demmel, J., Baden, S., Dongarra, J.: The high-performance computing continuum: Programming tools and environments. Commun. ACM 41(11), 64–73 (1998)
Shay, M.: The Dynamics of Collisionless Magnetic Reconnection. PhD thesis, University of Maryland, College Park (1999)
Snir, M., Otto, S., Huss-Lederman, S., Walker, D., Dongarra, J.: MPI–The Complete Reference, 2nd edn. Scientific and Engineering Computation Series. MIT Press, Cambridge (1998)
Wang, W., Killeen, T., Burns, A., Roble, R.: A high-resolution, three dimensional, time dependent, nested grid model of the coupled thermosphere-ionosphere. Journal of Atmospheric and Terrestrial Physics 61, 385–397 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sussman, A., Andrade, H. (2006). Enabling Coupled Scientific Simulations on the Grid. In: Dongarra, J., Madsen, K., Waśniewski, J. (eds) Applied Parallel Computing. State of the Art in Scientific Computing. PARA 2004. Lecture Notes in Computer Science, vol 3732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11558958_25
Download citation
DOI: https://doi.org/10.1007/11558958_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29067-4
Online ISBN: 978-3-540-33498-9
eBook Packages: Computer ScienceComputer Science (R0)