Abstract
Automatic Differentiation by program transformation uses static data-flow analysis to produce efficient code. This data-flow analysis must be adapted for parallel programs with Message-Passing communication. Starting from a context-sensitive and flow-sensitive data-flow analysis scheme initially devised for sequential codes, we extend this scheme for parallel codes. This extension is independent of the particular analysis and does not require a modification of the code’s internal representation, i.e. the flow graph. This extension relies on an accurate matching of communication points, which can’t be found automatically in general, and thus new user directives prove useful.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bronevetsky, G.: Communication-sensitive static dataflow for parallel message passing applications pp. 1–12 (2009). DOI URL http://dx.doi.org/10.1109/CGO.2009.32
C.Faure, P.Dutto: Extension of odyssée to the mpi library -reverse mode. Rapport de recherche 3774, INRIA, Sophia Antipolis (1999)
Gopalakrishnan, G., Kirby, R.M., Siegel, S., Thakur, R., Gropp, W., Lusk, E., de Supinski, B., Schulz, M., Bronevetsky, G.: Formal analysis of mpi based parallel programs: Present and future. Communications of the ACM (2011)
Gropp, W., Lusk, E., Skjellum, A.: Using MPI: Portable Parallel Programming with the Message Passing Interface, 2nd edition. MIT Press, Cambridge, MA (1999)
Hascoët, L., Naumann, U., Pascual, V.: “To be recorded” analysis in reverse-mode automatic differentiation. Future Generation Computer Systems 21(8), 1401–1417 (2005). DOI 10.1016/j.future.2004.11.009
Kreaseck, B., Strout, M.M., Hovland, P.: Depth analysis of mpi programs. ANL/MCS-P1754-0510 (2010)
Muchnick, S.S.: Advanced Compiler Design and Implementation. Morgan Kaufmann (1997)
Pacheco, P.S.: Parallel programming with MPI. Morgan Kaufmann Publishers Inc. (1996)
Shires, D., Pollock, L., Sprenkle, S.: Program flow graph construction for static analysis of mpi programs. In: Parallel and Distributed Processing Techniques and Applications, pp. 1847–1853 (1999)
Strout, M.M., Kreaseck, B., Hovland, P.D.: Data-flow analysis for mpi programs. In: Proceedings of the International Conference on Parallel Processing (ICPP) (2006)
Utke, J., Hascoët, L., Heimbach, P., Hill, C., Hovland, P., Naumann, U.: Toward adjoinable MPI. In: Proceedings of the 10th IEEE International Workshop on Parallel and Distributed Scientific and Engineering, PDSEC-09 (2009). http://doi.ieeecomputersociety.org/10.1109/IPDPS.2009.5161165
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pascual, V., Hascoët, L. (2012). Native Handling of Message-Passing Communication in Data-Flow Analysis. In: Forth, S., Hovland, P., Phipps, E., Utke, J., Walther, A. (eds) Recent Advances in Algorithmic Differentiation. Lecture Notes in Computational Science and Engineering, vol 87. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30023-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-30023-3_8
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30022-6
Online ISBN: 978-3-642-30023-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)