Skip to main content

A Parallel I/O System for High-Performance Distributed Computing

  • Conference paper
Programming Environments for Massively Parallel Distributed Systems

Part of the book series: Monte Verità ((MV))

Abstract

PIOUS is a parallel file system architecture for providing process groups access to permanent storage within a heterogeneous network computing environment. PIOUS supports parallel application development by providing coordinated access to parafile file objects with guaranteed consistency semantics and a dynamically-selectable fault tolerance level. For performance, PIOUS declusters files to exploit the combined file I/O and buffer cache capacities of multiple interconnected computer systems.

Research supported by the National Science Foundation, under Award No. CCR-9118787, U. S. Department of Energy, under Grant No. DE-FG05-91ER25105, and the Office of Naval Research under grant N00014-93-1-0278.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [ABC+90]_M. Arango, D. Berndt, N. Carriero, D. Gelernter, and D. Gilmore. Adventures with network Linda. Supercomputer Review, 10(3):42–46, October 1990.

    Google Scholar 

  2. Philip Bernstein, Vassos Hadzilacos, and Nathan Goodman. Concurrency Control and Recovery in Database Systems. Addison-Wesley Publishing Company, 1987.

    Google Scholar 

  3. Peter F. Corbett, Dror G. Feitelson, Jean-Pierre Prost, and Sandra J. Baylor. Parallel access to files in the Vesta file system. In Proceedings of Supercom-puting’ 93, pages 472–481, November 1993.

    Google Scholar 

  4. Luis-Felipe Cabrera and Darrell D. E. Long. Swift: Using distributed disk striping to provide high I/O data rates. Computing Systems, 4(4), Fall 1991.

    Google Scholar 

  5. Thomas W. Crockett. File concepts for parallel I/O. In Proceedings of Supercomputing’ 89, pages 574–579, 1989.

    Google Scholar 

  6. Erik DeBenedictis and Juan Miguel del Rosario. nCUBE parallel I/O software. In Eleventh Annual IEEE International Phoenix Conference on Computers and Communications (IPCCC), pages 0117–0124, April 1992.

    Google Scholar 

  7. John H. Hartman and John K. Ousterhout. The Zebra striped network file system. In Proceedings of the Fourteenth ACM Symposium on Operating Systems Principles, pages 29–43, December 1993.

    Google Scholar 

  8. The Institute of Electrical and Electronics Engineers, Inc. POSIX: IEEE Standard Portable Operating System Interface for Computer Environments, 1988. IEEE Std 1003.1-1988.

    Google Scholar 

  9. David Kotz. Multiprocessor file system interfaces. In Proceedings of the Second International Conference on Parallel and Distributed Information Systems, pages 194–201, 1993.

    Google Scholar 

  10. Leslie Lamport. How to make a multiprocessor computer that correctly executes multiprocess programs. IEEE Transactions on Computers, C-28(9):690–691, September 1979.

    Article  Google Scholar 

  11. Rodney McElrath. MRJ Inc., Personal Communication, June 1993.

    Google Scholar 

  12. The Message Passing Interface Forum. Document for a Standard Message-Passing Interface (Draft), November 1993.

    Google Scholar 

  13. Steven A. Moyer and V. S. Sunderam. PIOUS: A scalable parallel I/O system for distributed computing environments. In 1994 Scalable High Performance Computing Conference. May, 1994. To appear.

    Google Scholar 

  14. David Patterson, Garth Gibson, and Randy Katz. A case for redundant arrays of inexpensive disks (RAID). In ACM SIGMOD Conference, pages 109–116, June 1988.

    Google Scholar 

  15. Paul Pierce. A concurrent file system for a highly parallel mass storage system. In Fourth Conference on Hypercube Concurrent Computers and Applications, pages 155–160, 1989.

    Google Scholar 

  16. John Salmon. CUBIX: Programming hypercubes without programming hosts. In Proceedings of the Second Conference on Hypercube Multiprocessors, pages 3–9, 1987.

    Google Scholar 

  17. Sun Microsystems, Inc. Network Programming Guide, 1990. External Data Representation Standard: Protocol Specification.

    Google Scholar 

  18. V. S. Sunderam. PVM: A framework for parallel distributed computing. Concurrency: Practice and Experience, 2(4):315–339, December 1990.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1994 Springer Basel AG

About this paper

Cite this paper

Moyer, S.A., Sunderam, V.S. (1994). A Parallel I/O System for High-Performance Distributed Computing. In: Decker, K.M., Rehmann, R.M. (eds) Programming Environments for Massively Parallel Distributed Systems. Monte Verità. Birkhäuser, Basel. https://doi.org/10.1007/978-3-0348-8534-8_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-0348-8534-8_25

  • Publisher Name: Birkhäuser, Basel

  • Print ISBN: 978-3-0348-9668-9

  • Online ISBN: 978-3-0348-8534-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics