Skip to main content

\(\mathit{\mathcal{N}etfiles}\): An Enhanced Stream-Based Communication Mechanism

  • Conference paper
High-Performance Computing (ISHPC 2005, ALPS 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4759))

  • 768 Accesses

Abstract

\(\mathit{\mathcal{N}etfiles}\) is an alternative API for message passing on distributed memory machines. Based on the communication stream model, \(\mathit{\mathcal{N}etfiles}\) provides enhanced functionality such as broadcasts and gather operations. \(\mathit{\mathcal{N}etfiles}\) overload conventional file I/O primitives enabling parallel programs to be developed and tested on a file system before execution on a parallel machine. \(\mathit{\mathcal{N}etfiles}\) is part of a parallel programming system called FAbrIC. This paper also presents the design and implementation of the FAbrIC architecture and demonstrate the effectiveness of this approach by means of two parallel applications: a parallel shallow water model application and parallel Jacobi method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abramson, D., Dix, M., Whiting, P.: A Study of the Shallow Water Equations on Various Parallel Architectures. In: 14th Australian Computer Science Conference, Sydney, Australia, pp. 6:1–6:12 (1991)

    Google Scholar 

  2. Abramson, D., Sosic, R., Giddy, J., Hall, B.: Nimrod: A Tool for Performing Parameterised Simulations using Distributed Workstations. In: 4th IEEE Symposium on High Performance Distributed Computing, IEEE Press, Virginia (1995)

    Google Scholar 

  3. Chan, P., Abramson, D.: NetFiles: A Novel Approach to Parallel Programming of Master/Worker Applications. In: 5th International Conference and Exhibition on High-Performance Computing in the Asia-Pacific Region, Queensland, Australia (2001)

    Google Scholar 

  4. Geist, A., Beguelin, A., Dongarra, J., Jiang, W., Manchek, R., Sunderam, V.: PVM Parallel Virtual Machine: A User’s Guide and Tutorial for Network Parallel Computing. MIT Press, Cambridge (1994)

    Google Scholar 

  5. Hoare, C.A.R.: Communicating Sequential Processes. Prentice-Hall, Englewood Cliffs (1985)

    MATH  Google Scholar 

  6. Johnson, B.K., Ram, D.J.: DP: A Paradigm for Anonymous Remote Computation and Communication for Cluster Computing. IEEE Trans. on Parallel and Distributed Systems 12(10), 1052–1065 (2001)

    Article  Google Scholar 

  7. Jones, G.A., Goldsmith, M.: Programming in OCCAM 2. Prentice Hall Professional Technical Reference, Englewood Cliffs (1989)

    Google Scholar 

  8. Konovalov, A., Samofalov, V., Scharf, S.: Virtual Shared Files: Towards User-Friendly Inter-Process Communications. In: 5th International Conference on Parallel Computing Technologies, St. Petersburg, Russia (1999)

    Google Scholar 

  9. Message Passing Interface Forum. MPI: A Message-Passing Interface Standard (1994)

    Google Scholar 

  10. Sadourny, R.: The Dynamics of Finite-Difference Models of the Shallow Water Equations. J of Atmospheric Sciences 32(4), 680–689 (1975)

    Article  Google Scholar 

  11. Seevers, B.K., Quinn, M.J., Hatcher, P.J.: A Parallel Programming Environment Supporting Multiple Data-Parallel Modules. In: SIGPLAN Workshop on Languages, Compilers, and Run-Time Environments for Distributed Memory Multiprocessors, Boulder, Colorado, pp. 44–47 (1992)

    Google Scholar 

  12. Washington, W.M., Parkinson, C.L.: An Introduction to Three-Dimensional Climate Modeling. Oxford University Press, Oxford (1986)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Jesús Labarta Kazuki Joe Toshinori Sato

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chan, P., Abramson, D. (2008). \(\mathit{\mathcal{N}etfiles}\): An Enhanced Stream-Based Communication Mechanism. In: Labarta, J., Joe, K., Sato, T. (eds) High-Performance Computing. ISHPC ALPS 2005 2006. Lecture Notes in Computer Science, vol 4759. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77704-5_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-77704-5_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-77703-8

  • Online ISBN: 978-3-540-77704-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics