Abstract
Historically, high performance systems use schedulers and intelligent resource managers in order to optimize system usage and application performance. Most of the times, applications just issue requests of resources to the central system. This centralized approach is an unnecessary constraint for a class of potentially flexible applications, whose resource usage may be modulated as a function of the system status. In this paper we propose a tool which, in a way essentially transparent to final users, lets the application to self-tune in function of the status of the target execution environment. The approach hinges on the use of the MetaPL/HeSSE methodology, i.e., on the use of simulation to predict execution times and skeletal descriptions of the application to describe run-time resource usage.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Buyya, R., Abramson, D., Giddy, J.: Nimrod/G: An architecture of a resource management and scheduling system in a global computational grid. In: Proc. of HPC Asia 2000, Beijing, China, pp. 283–289 (2000)
luster Resources Inc.: Moab Grid Scheduler (Silver) Administrator’s Guide (2005), http://www.clusterresources.com/products/mgs/docs/index.shtml
Jackson, D.B., Jackson, H.L., Snell, Q.: Simulation based hpc workload analysis. In: IPDPS 2001: Proceedings of the 15th International Parallel & Distributed Processing Symposium, Washington, DC, USA, p. 47. IEEE Computer Society Press, Los Alamitos (2001)
Globus Alliance: WS GRAM: Developer’s Guide (2005), http://www-unix.globus.org/toolkit/docs/3.2/gram/ws/developer
Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the Grid: Enabling scalable virtual organization. The International Journal of High Performance Computing Applications 15(3), 200–222 (2001), http://www.globus.org/research/papers/anatomy.pdf
The Globus Alliance: The Globus Resource Specification Language RSL (2005), http://www-fp.globus.org/gram/rsl_spec1.html
Foster, I., Kesselman, C., Nick, J.M., Tuecke, S.: The physiology of the Grid: An open grid services architecture for distributed systems integration (2002) http://www.globus.org/research/papers/ogsa.pdf
Smith, C., Williams, L.: Software performance engineering for object-oriented systems. In: Proc. CMG, CMG, Orlando, USA (1997)
Kleese van Dam, K., Sufi, S., Drinkwater, G., Blanshard, L., Manandhar, A., Tyer, R., Allan, R., O’Neill, K., Doherty, M., Williams, M., Woolf, A., Sastry, L.: An integrated e-science environment for environmental science. In: Proc. of Tenth ECMWF Workshop, Reading, England, pp. 175–188 (2002)
Keahey, K., Fredian, T., Peng, Q., Schissel, D.P., Thompson, M., Foster, I., Greenwald, M., McCune, D.: Computational grids in action: the national fusion collaboratory. Future Gener. Comput. Syst. 18, 1005–1015 (2002)
Du, C., Ghosh, S., Shankar, S., Sun, X.-H.: A runtime system for autonomic rescheduling of mpi programs. In: ICPP 2004: Proceedings of the 2004 International Conference on Parallel Processing (ICPP 2004), Washington, DC, USA, pp. 4–11. IEEE Computer Society Press, Los Alamitos (2004)
Rak, M.: A Performance Evaluation Environment for Distributed Heterogeneous Computer Systems Based on a Simulation Approach. PhD thesis, Facoltà di Ingegneria, Seconda Università di Napoli, Naples, Italy (2002)
Mazzocca, N., Rak, M., Villano, U.: The transition from a PVM program simulator to a heterogeneous system simulator: The heSSE project. In: Dongarra, J., Kacsuk, P., Podhorszki, N. (eds.) PVM/MPI 2000. LNCS, vol. 1908, pp. 266–273. Springer, Heidelberg (2000)
Mazzocca, N., Rak, M., Villano, U.: Predictive performance analysis of distributed heterogeneous systems with HeSSE. In: Proc. 2001 Conference Italian Society for Computer Simulation (ISCSI 2001), Naples, Italy, pp. 55–60. CUEN (2002)
Mazzocca, N., Rak, M., Villano, U.: The MetaPL approach to the performance analysis of distributed software systems. In: Proc. of 3rd International Workshop on Software and Performance (WOSP 2002), pp. 142–149. IEEE Computer Society Press, Los Alamitos (2002)
Mazzocca, N., Rak, M., Villano, U.: MetaPL: A notation system for parallel program description and performance analysis. In: Malyshkin, V.E. (ed.) PaCT 2001. LNCS, vol. 2127, pp. 80–93. Springer, Heidelberg (2001)
Mancini, E., Rak, M., Torella, R., Villano, U.: Off-line performance prediction of message-passing applications on cluster systems. In: Dongarra, J., Laforenza, D., Orlando, S. (eds.) EuroPVM/MPI 2003. LNCS, vol. 2840, pp. 45–54. Springer, Heidelberg (2003)
Mancini, E., Mazzocca, N., Rak, M., Villano, U.: Integrated tools for performance-oriented distributed software development. In: Proc. SERP 2003 Conference, Las Vegas (NE), USA, vol. 1, pp. 88–94 (2003)
Quinn, M.J.: Parallel Computing: Theory and Practice, 2nd edn. McGraw-Hill, New York (1994)
Papadopoulos, P.M., Katz, M.J., Bruno, G.: NPACI Rocks: tools and techniques for easily deploying manageable linux clusters. Concurrency and Computation: Practice and Experience 15, 707–725 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mancini, E.P., Rak, M., Torella, R., Villano, U. (2005). Self-optimizing MPI Applications: A Simulation-Based Approach. In: Yang, L.T., Rana, O.F., Di Martino, B., Dongarra, J. (eds) High Performance Computing and Communications. HPCC 2005. Lecture Notes in Computer Science, vol 3726. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11557654_20
Download citation
DOI: https://doi.org/10.1007/11557654_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29031-5
Online ISBN: 978-3-540-32079-1
eBook Packages: Computer ScienceComputer Science (R0)