Abstract
Out-of-core computation needs high I/O performance as the out-of-core data stored in files has to be moved between memory and disks during the execution of an application program. In order to obtain better performance of out-of-core programs, two I/O optimizations are practiced, which are data prefetching and data reuse. This paper focuses on discussing the mechanism and implementation of each method and under which condition a method should be used. Several sets of experiments are taken to test the strategies and the results show that the I/O performance is efficiently improved by using these optimization methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ramanujam, J., Kandemir, M., Choudhary, A., Bordawekar, R.: Compilation techniques for out-of-core parallel computations. Parallel Computing 23(3-4), 597–628 (1998)
Rosario, J., Choudlhary, A.: High performance I/O for parallel computers: problems and prospects. IEEE Computer, 59–68 (March 1994)
Tang, J., Fang, B., Hu, M., Zhang, H.: An Object-Oriented Method for Out-of-Core Parallel Computations on Cluster of Workstations. In: PDCAT 2003, Proceedings of the Fourth International Conference on Parallel and Distributed Computing, Applications and Technologies, Chengdu, China, August 27-29, pp. 507–510. IEEE Press, Los Alamitos (2003)
Cettei, M.M., Ligon III, W.B., Ross, R.B.: Support for Parallel Out of Core Applications on Beowulf Workstations. In: Proceedings of the 1998 IEEE Aerospace Conference, March 1998, pp. 355–365 (1998)
Simitci, H., Reed, D.: A comparison of logical and physical parallel I/O patterns. The International Journal of High Performance Computing Applications 12(3), 364–380 (1998)
Thakur, R., Gropp, W.: Parallel I/O. In: Sourcebook of Parallel Computing, ch. 11, pp. 331–355. Morgan Kaufmann Publishers, San Francisco (2002)
Callahan, D., Kennedy, K., Porterfield, A.: Software prefetching. In: Proceedings of the 4th International Conference on Architectural Support for Programming Languages and Operation Systems, Santa Clara, CA, USA, pp. 40–52 (1991)
Reiqi, L., Zhaoqing, Z., Ruliang, Q.: A data prefetching method used in ILP compilers and its optimization. Journal of Computers 23(6), 576–584 (2000) (in Chinese)
Brown, A.D., Mowry, T.C., Krieger, O.: Compiler-based I/O prefetching for out-of-core applications. ACM Transactions on Computer Systems (TOCS) 19(2), 111–170 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tang, J., Fang, B., Hu, M., Zhang, H. (2004). The Practice of I/O Optimizations for Out-of-Core Computation. In: Liew, KM., Shen, H., See, S., Cai, W., Fan, P., Horiguchi, S. (eds) Parallel and Distributed Computing: Applications and Technologies. PDCAT 2004. Lecture Notes in Computer Science, vol 3320. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30501-9_20
Download citation
DOI: https://doi.org/10.1007/978-3-540-30501-9_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24013-6
Online ISBN: 978-3-540-30501-9
eBook Packages: Computer ScienceComputer Science (R0)