Abstract
PULC (ParaStation User Level Communication) is a user-level communication library for workstation clusters. PULC provides a multi-user, multiprogramming communication library for user-level communication on top of high-speed communication hardware. This paper describes the design of the communication subsystem, a first implementation on top of the ParaStation communication adapter, and benchmark results of this first implementation.
PULC removes the operating system from the communication path and offers a multi-process environment with user-space communication. Additionally, it moves some operating system functionality to the user-level to provide higher efficiency and flexibility. Message demultiplexing, protocol processing, hardware interfacing, and mutual exclusion of critical sections are all implemented in user-level. PULC offers the programmer multiple interfaces including TCP user-level sockets, MPI [CGH94], PVM [BDG+93], and Active Messages [CCHvE96]. Throughput and latency are close to the hardware performance (e.g., the TCP socket protocol has a latency of less than 9 µs).
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
Thomas E. Anderson, David E. Culler, and David A. Patterson. A Case for NOW (Network of Workstations). IEEE Micro, 15(1):54–64, February 1995.
Anindya Basu, Vineet Buch, Werner Vogels, and Thorsten von Eicken. U-net: A user-level network interface for parallel and distributed computing. In Proc. of the 15th ACM Symposium on Operating Systems Principles, Copper Mountain, Colorado, December 3–6, 1995.
A. Beguelin, J. Dongarra, Al Geist, W. Jiang, R. Manchek, and V. Sunderam. PVM 3 User's Guide and Reference Manual. ORNL/TM-12187, Oak Ridge National Laboratory, May 1993.
Ralph Buttler and Ewing Lusk. User's Guide to the p4 Parallel Programmimg System. ANL-92/17, Argonne National Laboratory, October 1992.
Joachim M. Blum, Thomas M. Warschko, and Walter F. Tichy. PSPVM:Implementing PVM on a high-speed Interconnect for Workstation Clusters. In Proc. of 3rd Euro PVM Users’ Group Meeting, Munich, Germany, Oct.7–9, 1996.
G. Chiola and G. Ciaccio. Gamma: a low-cost network of workstations based on active messages. In 5th EUROMICRO workshop on Parallel and Distributed Processing, 1997.
Chi-Chao Chang, Grzegorz Czajkowski, Chris Hawblitzel, and Thorsten von Eicken. Low-Latency Communication on the IBM RISC System/6000 SP. In ACM/IEEE Supercomputing’ 96, Pittsburgh, PA, November 1996.
J. Choi, J. Demmel, I. Dhillon, J. Dongarra, S. Ostrouchov, A. Petitet, K. Stanley, D. Walker, and R. C. Whaley. ScaLAPACK: A Portable Linear Algebra Library for Distributed Memory Computers — Design Issues and Performance. Technical Report UT CS-95-283, LAPACK Working Note #95, University of Tennesee, 1995.
Lyndon Clarke, Ian Glendinning, and Rolf Hempel. The MPI Message Passing Interface Standard. Technical report, March 94.
Chien, Pakin, Lauria, Buchanan, Hane, Giannini, and Prusakova. High Performance Virtual Machines (HPVM): Clusters with Supercomputing APIs and Performance. In Eighth SIAM Conference on Parallel Processing for Scientific Computing (PP97), 1997.
Stefanos N. Damianakis, Angelos Bilas, Cezarz Dubnicki, and Edward W. Felten. Client Server Computing on Shrimp. IEEE Micro, pages 8–17, January/February 1997.
Marco Fillo and Richard B. Gillett. Architecture and implementation of memory channel 2. Technical report, Digital Equipment Coropration, 9 1997.
R. J. Harrison. Portable tools and applications for parallel computers. International Journal on Quantum Chem., 40:847–863, 1991.
Christian G. Herter, Thomas M. Warschko, Walter F. Tichy, and Michael Philippsen. Triton/1: A massively-parallel mixed-mode computer designed to support high level languages. In 7th International Parallel Processing Symposium, Proc. of 2nd Workshop on Heterogeneous Processing, pages 65–70, Newport Beach, CA, April 13–16, 1993.
H. Jin and W. Rehm. Performance of message passing and shared memory on sci-based smp cluster. In Proceedings of Fifth High Performance Computing Symposium, Atlanta, Georgia, April 6–10 1997.
The GM API.
Patrick Ohly, Joachim M. Blum, Thomas M. Warschko, and Walter F. Tichy. PSPVM2:PVM for ParaStation. In Proc. of 1st Workshop on Cluster Computing, Chemnitz, Germany, Nov.6–7, 1997.
Loic Prylli and Bernard Tourancheau. New protocol design for high performance networking. Technical report, LIP-ENS Lyon, 69364 Lyon, France, 1997.
David Culler Steve Rodrigues, Tom Anderson. High-performance local-area communication using fast sockets. In USENIX’ 97, 1997.
Thomas M. Warschko, Joachim M. Blum, and Walter F. Tichy. ParaStation: Efficient Parallel Computing by Clustering Workstations: Design and Evaluation. Journal of Systems Architecture, 1997. Elsevier Science Inc., New York, NY 10010. To appear.
Matt Welsh, Anindya Basu, and Thorsten von Eicken. ATM and Fast Ethernet Network Interfaces for user-level communication. In roceedings of the Third International Symposium on High Performance Computer Architecture (HPCA), San Antonio, 1997.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1999 Springer-Verlag London Limited
About this paper
Cite this paper
Blum, J.M., Warschko, T.M., Tichy, W.F. (1999). ParaStation user level communication. In: Cooperman, G., Jessen, E., Michler, G. (eds) Workshop on wide area networks and high performance computing. Lecture Notes in Control and Information Sciences, vol 249. Springer, London. https://doi.org/10.1007/BFb0110080
Download citation
DOI: https://doi.org/10.1007/BFb0110080
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-85233-642-4
Online ISBN: 978-1-84628-578-3
eBook Packages: Springer Book Archive