Skip to main content
SpringerLink
Log in

I/O performance of an RAID-10 style parallel file system

  • Others
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Without any additional cost, all the disks on the nodes of a cluster can be connected together through CEFT-PVFS, an RAID-10 style parallel file system, to provide a multi-GB/s parallel I/O performance. I/O response time is one of the most important measures of quality of service for a client. When multiple clients submit data-intensive jobs at the same time, the response time experienced by the user is an indicator of the power of the cluster. In this paper, a queuing model is used to analyze in detail the average response time when multiple clients access CEFT-PVFS. The results reveal that response time is with a function of several operational parameters. The results show that I/O response time decreases with the increases in I/O buffer hit rate for read requests, write buffer size for write requests and the number of server nodes in the parallel file system, while the higher the I/O requests arrival rate, the longer the I/O response time. On the other hand, the collective power of a large cluster supported by CEFT-PVFS is shown to be able to sustain a steady and stable I/O response time for a relatively large range of the request arrival rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. General Parallel File System (GPFS) 1.4 for AIX_— Architecture and Performance. http://www_1.ibm.com/servers/eserver/clusters/whitepapers.

  2. Carns P H, Ligon W B, Ross R B, Thakur R. PVFS: A parallel file system for Linux clusters. InProceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, October 2000, pp. 317–327.

  3. Mache J, Bower-Cooley J, Guchereau Jet al. How to achieve 1GByte/sec I/O throughput with commodity IDE disks. InProceedings of SC2001—14th ACM/IEEE Conference on High-Performance Networking and Computing (refereed poster exhibit), Denver, Colorado, Nov. 2001.

  4. Myrinet. http://www.myrinet.com/, Oct. 2002.

  5. Khalil Amiri, David Petrou, Gregory R Ganger, Garth A Gibson. Dynamic function placement for dataintensive cluster computing. InUSENIX Annual Technical Conference, San Diego, CA, June 2000, pp. 307–322.

  6. Yifeng Zhu, Hong Jiang, Xiao Qinet al. Design, implementation, and performance evaluation of a costeffective fault-tolerant parallel virtual file system. InInternational Workshop on Storage Network Architecture and Parallel I/Os, in conjunctions with12th International Conference on Parallel Architectures and Compilation Techniques, Sept. 27–Oct. 1. 2003, New Orleans, LA.

  7. Gibson G A, Patterson D A. Designing disk arrays for high data reliability.Journal of Parallel and Distributed Computing, Jan. 1993, 17(1): 4–27.

    Article  Google Scholar 

  8. Chen S, Towsley D. The design and evaluation of RAID 5 and parity striping disk array architectures.Journal of Parallel and Distributed Computing, Jan. 1993, 17: 58–74.

    Article  Google Scholar 

  9. Bitton D. Arm scheduling in shadowing disks. InProc. Spring COMPCON 89, San Francisco, CA, February 1989, pp. 132–136.

  10. Kim M Y, Tantawi A N. Asynchronous disk interleaving: Approximating access delays.IEEE Trans. Computers, July 1991, 40(7): 801–810.

    Article  Google Scholar 

  11. Kleinrock L. Queueing System. Volume 1, John Wiley & Sons, New York, 1975.

    Google Scholar 

  12. Jones R. http://www.cup.hp.com/netperf/Netperfpage. html, Netperf: A network performance monitoring tool.

Download references

Author information

Authors and Affiliations

  1. National Storage System Lab, Department of Computer Science and Engineering, Huazhong University of Science and Technology, 430074, Wuhan, P.R. China

    Dan Feng

  2. Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln, Nebraska, U.S.A.

    Hong Jiang & Yi-Feng Zhu

Authors
  1. Dan Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hong Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi-Feng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dan Feng.

Additional information

This work is supported by the National Natural Science Foundation of China (Grant No.60273074), the Special Foundation for National Excellent Ph.D. Thesis, and Huo YingDong Education Foundation (Grant No.91068).

Dan Feng is a professor of College of Computer Science at Huazhong University of Science and Technology (HUST), China. She obtained the Ph.D. degree from HUST in 1997. Her current interests are computer architecture, redundant array independent disks, mass storage, and information technology.

Hong Jiang is an associate professor of Department of Computer Science and Engineering at University of Nebraska-Lincoln, Lincoln, Nebraska. He obtained the Ph.D. degree from Texas A&M University in 1991. His current interests are computer architecture, parallel I/O, parallel and distributed processing, performance evaluation and real-time systems.

Yi-Feng Zhu is a Ph.D. candidate of Department of Computer Science and Engineering at University of Nebraska-Lincoln, Lincoln, Nebraska. He obtained the M.S. degree from University of Nebraska-Lincoln in 2002. His research interests cover computer architecture, network storage, parallel I/O and cluster computing.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Feng, D., Jiang, H. & Zhu, YF. I/O performance of an RAID-10 style parallel file system. J. Comput. Sci. & Technol. 19, 965–972 (2004). https://doi.org/10.1007/BF02973461

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02973461

Keywords

Search

Navigation