I/O performance of an RAID-10 style parallel file system
- 30 Downloads
Without any additional cost, all the disks on the nodes of a cluster can be connected together through CEFT-PVFS, an RAID-10 style parallel file system, to provide a multi-GB/s parallel I/O performance. I/O response time is one of the most important measures of quality of service for a client. When multiple clients submit data-intensive jobs at the same time, the response time experienced by the user is an indicator of the power of the cluster. In this paper, a queuing model is used to analyze in detail the average response time when multiple clients access CEFT-PVFS. The results reveal that response time is with a function of several operational parameters. The results show that I/O response time decreases with the increases in I/O buffer hit rate for read requests, write buffer size for write requests and the number of server nodes in the parallel file system, while the higher the I/O requests arrival rate, the longer the I/O response time. On the other hand, the collective power of a large cluster supported by CEFT-PVFS is shown to be able to sustain a steady and stable I/O response time for a relatively large range of the request arrival rate.
KeywordsPVFS parallel I/O I/O response time
Unable to display preview. Download preview PDF.
- General Parallel File System (GPFS) 1.4 for AIX_— Architecture and Performance. http://www_1.ibm.com/servers/eserver/clusters/whitepapers.Google Scholar
- Carns P H, Ligon W B, Ross R B, Thakur R. PVFS: A parallel file system for Linux clusters. InProceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, October 2000, pp. 317–327.Google Scholar
- Mache J, Bower-Cooley J, Guchereau Jet al. How to achieve 1GByte/sec I/O throughput with commodity IDE disks. InProceedings of SC2001—14th ACM/IEEE Conference on High-Performance Networking and Computing (refereed poster exhibit), Denver, Colorado, Nov. 2001.Google Scholar
- Myrinet. http://www.myrinet.com/, Oct. 2002.Google Scholar
- Khalil Amiri, David Petrou, Gregory R Ganger, Garth A Gibson. Dynamic function placement for dataintensive cluster computing. InUSENIX Annual Technical Conference, San Diego, CA, June 2000, pp. 307–322.Google Scholar
- Yifeng Zhu, Hong Jiang, Xiao Qinet al. Design, implementation, and performance evaluation of a costeffective fault-tolerant parallel virtual file system. InInternational Workshop on Storage Network Architecture and Parallel I/Os, in conjunctions with12th International Conference on Parallel Architectures and Compilation Techniques, Sept. 27–Oct. 1. 2003, New Orleans, LA.Google Scholar
- Bitton D. Arm scheduling in shadowing disks. InProc. Spring COMPCON 89, San Francisco, CA, February 1989, pp. 132–136.Google Scholar
- Kleinrock L. Queueing System. Volume 1, John Wiley & Sons, New York, 1975.Google Scholar
- Jones R. http://www.cup.hp.com/netperf/Netperfpage. html, Netperf: A network performance monitoring tool.Google Scholar