Abstract
As supercomputers become faster, the I/O part of applications can become a real problem in regard to overall execution times. System administrators and developers of hardware or software components reduce execution times by creating new and optimized parts for the supercomputers. While this helps a lot in the struggle to minimize I/O times, adjustment of the execution environment is not the only option to improve overall application behavior.
In this paper we examine if the application programmer can also contribute by making use of non-blocking I/O operations. After an analysis of non-blocking I/O operations and their potential for shortening execution times we present a benchmark which was created and run in order to see if the theoretical promises also hold in practice.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Message Passing Interface Forum: MPI: A Message-Passing Interface Standard (May 1994), http://www.mpi-forum.org
Message Passing Interface Forum: MPI-2: Extensions to the Message-Passing Interface (June 1997), http://www.mpi-forum.org
MPICH2 home page, http://www-unix.mcs.anl.gov/mpi/mpich2/index.htm
Zaki, O., Lusk, E., Gropp, W., Swider, D.: Toward Scalable Performance Visualization with Jumpshot. Int. J. High Perform. Comput. Appl. 13 (1999)
The Parallel Virtual File System – Version 2, http://www.pvfs.org/pvfs2/
The PVFS2 Development Team: PVFS2 Internal Documentation included in the source code package (2006)
Thakur, R., Gropp, W.D.: Test Suite for Evaluating Performance of MPI Implementations That Support MPI_THREAD_MULTIPLE. In: Cappello, F., Herault, T., Dongarra, J. (eds.) PVM/MPI 2007. LNCS, vol. 4757, pp. 46–55. Springer, Heidelberg (2007)
TOP500.org (April 2009), http://top500.org/
Kunkel, J.: Performance Analysis of the PVFS2 Persistency Layer, Bachelor’s Thesis, Ruprecht-Karls-Universität Heidelberg, Germany (March 2006), http://pvs.informatik.uni-heidelberg.de/Theses/2006-kunkel-bsc.pdf
Büttner, D.: Benchmarking of Non-Blocking Input/Output on Compute Clusters, Bachelor’s Thesis, Ruprecht-Karls-Universität Heidelberg, Germany (April 2007), http://www.ub.uni-heidelberg.de/archiv/9217/
Latham, R., Miller, N., Ross, R., Carns, P.: A Next-Generation Parallel File System for Linux Clusters. LinuxWorld Magazine, 56–59
Gropp, W., Lusk, E., Sterling, T.: Beowulf Cluster Computing with Linux, 2nd edn. MIT Press, Cambridge (2003)
Stallings, W.: Betriebssysteme, 4th edn. Pearson Studium, London (2003)
Rabenseifner, R., Koniges, A.E.: Effective Communication and File-I/O Bandwidth Benchmarks. In: Cotronis, Y., Dongarra, J. (eds.) PVM/MPI 2001. LNCS, vol. 2131, p. 24. Springer, Heidelberg (2001)
Krietemayer, M., Versick, D., Tavangarian, D.: THE PRIOmark PARALLEL I/O-BENCHMARK. In: International Conference on Parallel and Distributed Computing and Networks, Insbruck, Austria (February 2005)
Lawry, W., Wilson, C., Maccabe, A.B., Brightwell, R.: COMB: A Portable Benchmark Suite for Assessing MPI Overlap. In: Proceedings of the 4th IEEE International Conference on Cluster Computing (September 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Buettner, D., Kunkel, J., Ludwig, T. (2009). Using Non-blocking I/O Operations in High Performance Computing to Reduce Execution Times. In: Ropo, M., Westerholm, J., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2009. Lecture Notes in Computer Science, vol 5759. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03770-2_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-03770-2_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03769-6
Online ISBN: 978-3-642-03770-2
eBook Packages: Computer ScienceComputer Science (R0)