Skip to main content

An Efficient Parallel File System for Cluster Grids

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 3666))

Abstract

ePVM is an extension of the well known PVM programming system, whose main goal is to enable PVM applications to run on computing nodes belonging to non-routable private networks, but connected to the Internet through publicly addressable IP front-end nodes. However, in order to enable large-scale PVM applications to effectively manage the enormous volumes of data they usually generate, ePVM needs a parallel file system. This paper presents ePIOUS, the optimized porting of the PIOUS parallel file system under ePVM. ePIOUS has been designed so as to take into account the two-levels physical network topology characterizing the “cluster grids” normally built by ePVM. To this end, ePIOUS exploits the ePVM architecture to implement a file caching service that is able to speed up file accesses across clusters.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Springer, P.L.: PVM support for clusters. In: Procs. of the 3rd IEEE Int. Conf. on Cluster Computing, Newport Beach, CA, USA (2001)

    Google Scholar 

  2. Stefán, P.: The hungarian clustergrid project. In: Procs. of the MIPRO 2003, Opatija, Croatia (2003)

    Google Scholar 

  3. Berman, F., Fox, G., Hey, T. (eds.): Grid Computing: Making the Global Infrastructure a Reality. Wiley & Sons, Chichester (2003)

    Google Scholar 

  4. Foster, I., Kesselman, C. (eds.): The Grid: Blueprint for a New Computing Infrastructure, 2nd edn. Morgan Kaufmann, San Francisco (2004)

    Google Scholar 

  5. Joseph, J., Fellenstein, C.: Grid Computing. Prentice Hall PTR, Englewood Cliffs (2003)

    Google Scholar 

  6. Frattolillo, F.: A PVM extension to exploit cluster grids. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J. (eds.) EuroPVM/MPI 2004. LNCS, vol. 3241, pp. 362–369. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  7. Frattolillo, F.: Running large-scale applications on cluster grids. Intl Journal of High Performance Computing Applications 19, 157–172 (2005)

    Article  Google Scholar 

  8. Geist, A., Beguelin, A., et al.: PVM: Parallel Virtual Machine. A Users’ Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge (1994)

    MATH  Google Scholar 

  9. Frattolillo, F., D’Onofrio, S.: Providing PVM with a parallel file system for cluster grids. In: Procs of the 9th World Multi-Conference on Systemics, Cybernetics and Informatics, Orlando, Florida, USA (2005)

    Google Scholar 

  10. Moyer, S.A., Sunderam, V.S.: PIOUS: a scalable parallel I/O system for distributed computing environments. In: Procs of the Scalable High-Performance Computing Conference, pp. 71–78 (1994)

    Google Scholar 

  11. Crockett, T.W.: File concepts for parallel I/O. In: Procs of the ACM/IEEE Conference on Supercomputing, Reno, Nevada, USA, pp. 574–579 (1989)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Frattolillo, F., D’Onofrio, S. (2005). An Efficient Parallel File System for Cluster Grids. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2005. Lecture Notes in Computer Science, vol 3666. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11557265_16

Download citation

  • DOI: https://doi.org/10.1007/11557265_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-29009-4

  • Online ISBN: 978-3-540-31943-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics