Towards Portable Runtime Support for Irregular and Out-of-Core Computations

  • Marian Bubak
  • Piotr Łuszczek
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1697)


In this paper, we present the lip - a runtime system which enables easy and portable parallelization of irregular and out-of-core computations. Functions for handling irregular data were developed using the same concept as in the CHAOS library. Out-of-core parallelization is based on the idea of in-core section, and functions for out-of-core data are implemented with capabilities provided by MPI-IO. The new library may be used in C, Fortran and Java programs. Results of performance tests for a generic irregular out-of-core program on HP S2000 are presented and possible further extensions are discussed


Message Passing Interface Runtime System Java Virtual Machine Index Array Library Call 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brezany, P.: Input/Output Intensively Parallel Computing, LNCS 1220, Springer, Berlin Heildelberg New York (1997).Google Scholar
  2. 2.
    Saltz, J., et al.: A Manual for the CHAOS Runtime Library, UMIACS Technical Reports CS-TR-3437 and UMIACS-TR-95-34, University of Maryland; March 1995;
  3. 3.
    Bubak, M., Łuszczek, P., and Wierzbowska, A.: Porting CHAOS Library to MPI. In Alexandrov, V., Dongarra, J., (eds.) Recent Advances in Parallel Virtual Machine and Message Passing Interface, Proc. 5th European PVM/MPI Users’ Group Meeting, Liverpool, UK, September 7–9, 1998, LNCS 1497, Springer, pp. 131–136.CrossRefGoogle Scholar
  4. 4.
    Moyer, S. and Sunderam, V.S.: Parallel I/O as a Parallel Application. International Journal of Supercomputer Applications, 9 (1995) 95–107.CrossRefGoogle Scholar
  5. 5.
    Seamons, K. E., Chen, Y., Jones, P., Jozwiak, J., and Winslett, M.: Server Directed Collective I/O in Panda. In Proc. Supercomputing’99, San Diego, California, December 1995,
  6. 6.
    Brezany, P., Mueck, T.A., and Schikuta, E.: A Software Architecture for Massively Parallel Input/Output. In Waśniewski. J., et al.: Applied Parallel Computing, Proc. PARA’96, Lyngby, August 1996, LNCS 1184, Springer, pp. 85–96.Google Scholar
  7. 7.
    Carretro, J., No, J., Park, S., Choudhary, A., and Chen, P.: COMPASSION: A Parallel I/O Runtime System Including Chunking and Compression for Irregular Applications. In: Sloot, P., Bubak, M., Hertzberger, B., (eds.): Proc. Int. Conf. High Performance Computing and Networking, Amsterdam, April 21–23, 1998, LNCS 1401, Springer, 1998, pp. 668–677.CrossRefGoogle Scholar
  8. 8.
    Message Passing Interface Forum: MPI-2: Extensions to the Message-Passing Interface, July 18, 1997;
  9. 9.
    Saphir, W.: Porting Applications from NX to MPI. Talk presented at NAS on July 26, 1994,
  10. 10.
    Bordawekar, R., Choudhary, A.: Issues in Compiling I/O Intensive Problems. In Jain, R., Werth, J., and Browne, J.C. (Eds.) Input/Output in Parallel and Distributed Computer Systems, chapter 3, pp. 69–96, Kluwer, 1996.Google Scholar
  11. 11.
    Brezany, P., Choudhary, A., and Dang, M.: Parallelization of Irregular Codes Including Out-of-Core Data and Index Arrays. In Proceedings of Parallel Computing 1997-PARCO’97, Bonn, Germany, September 1997, Elsevier, pp. 132–140.Google Scholar
  12. 12.
    Thakur, R., Gropp, W., and Lusk, E.: Data Sieving and Collective I/O in ROMIO. In Proc. of the 7th Symposium on the Frontiers of Massively Parallel Computation, February 1999, pp. 182–189.Google Scholar
  13. 13.
    Thakur, R., Gropp, W., and Lusk, E.: A Case for Using MPI’s Derived Datatypes to Improve I/O Performance. In Proc. of SC98: High Performance Networking and Computing November 1998.Google Scholar
  14. 14.
    Thakur, R., Lusk, E., and Gropp, W.: Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. Technical Memorandum ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory, Revised July 1998;
  15. 15.
    MPICH-A Portable Implementation of MPI,
  16. 16.
    Geist, A., et al.: PVM: Parallel Virtual Machine. A Users’ Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge, Massachusetts (1994)Google Scholar
  17. 17.
    Java Grande Forum,
  18. 18.
    LAM/MPI Parallel Computing: LAM/MPI Parallel ComputingGoogle Scholar
  19. 19.
    Brezany, P., Winslett, M.: Advanced Data Repository Support for Java Scientific Programming In: Sloot, P., Bubak, M., Hoekstra, A., Hertzberger, B., (eds.): Proc. Int. Conf. High Performance Computing and Networking, Amsterdam, April 12–14, 1999, LNCS 1593, Springer, 1999, pp. 1127–1136.CrossRefGoogle Scholar
  20. 20.

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • Marian Bubak
    • 1
    • 2
  • Piotr Łuszczek
    • 2
  1. 1.Institute of Computer Science, AGHKrakówPoland
  2. 2.Academic Computer Centre - CYFRONETKrakówPoland

Personalised recommendations