Advertisement

Design and Implementation of the Cooperative Cache for PVFS

  • In-Chul Hwang
  • Hojoong Kim
  • Hanjo Jung
  • Dong-Hwan Kim
  • Hojin Ghim
  • Seung-Ryoul Maeng
  • Jung-Wan Cho
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3036)

Abstract

Recently, there have been many efforts to get high performance in cluster computing with inexpensive PCs connected through high-speed networks. Some of them were to provide high bandwidth and parallelism in file service using a distributed file system. Other researches for distributed file systems include the cooperative cache that reduces servers’ load and improves overall performance. The cooperative cache shares file caches among clients so that a client can request a file to another client, not to the server, through inter-client message passing. In various distributed file systems, PVFS (Parallel Virtual File System) provides high performance with parallel I/O in Linux widely used in cluster computing. However, PVFS doesn’t support any file cache facility. This paper describes the design and implementation of the cooperative cache for PVFS (Coopc-PVFS). We show the efficiency of Coopc-PVFS in comparison to original PVFS. As a result, the response time of Coopc-PVFS is shorter than or similar to that of original PVFS.

References

  1. 1.
    Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: PVFS: A Parallel File System For Linux Clusters. In: Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, October 2000, pp. 317–327 (2000)Google Scholar
  2. 2.
    Ross, R.B.: Providing Parallel I/O on Linux Clusters. In: Second Annual Linux Storage Management Workshop, Miami, FL (October 2000)Google Scholar
  3. 3.
    Vilayannur, M., Kandemir, M., Sivasubramaniam, A.: Kernel-Level Caching for Optimizing I/O by Exploiting Inter-Application Data Sharing. In: IEEE International Conference on Cluster Computing (CLUSTER 2002) (September 2002)Google Scholar
  4. 4.
    Dahlin, M., Wang, R., Anderson, T., Patterson, D.: Cooperative Caching: Using remote client memory to improve file system performance. In: Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation, USENIX Assoc., Berkeley, CA, pp. 267–280 (1994)Google Scholar
  5. 5.
    Feeley, M.J., Morgan, W.E., Pighin, F.H., Karlin, A.R., Levy, H.M.: Implementing global memory management in a workstation cluster. In: Proceedings of the 15th symposium on Operating System Principles(SOSP), pp. 201–212. ACM Press, New york (1995)Google Scholar
  6. 6.
    Sarkar, P., Hartman, J.: Efficient cooperative caching using hints. In: Proceedings of the second USENIX symposium on Operating systems design and implementation, Seattle, Washington, United States, October 29-November 01, pp. 35–46 (1996)Google Scholar
  7. 7.
    Linux Kernel Threads in Device Drivers, http://www.scs.ch/~frey/linux/kernelthreads.html
  8. 8.
  9. 9.
    Wong, P., Van der Wijngaart, R.F.: NAS Parallel Benchmark I/O Version 2.4, NAS Technical Report NAS-03-002, NASA Ames Research Center, Moffett Field, CA 94035-1000Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • In-Chul Hwang
    • 1
  • Hojoong Kim
    • 1
  • Hanjo Jung
    • 1
  • Dong-Hwan Kim
    • 1
  • Hojin Ghim
    • 1
  • Seung-Ryoul Maeng
    • 1
  • Jung-Wan Cho
    • 1
  1. 1.Division of Computer Science, Dept. of Electrical Engineering & Computer ScienceKAISTTaejonRepublic of Korea

Personalised recommendations