Supporting Shared Memory and Message Passing on Clusters of PCs with a SMiLE

  • Wolfgang Karl
  • Markus Leberecht
  • Martin Schulz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1602)


With the rise of fast interconnection technologies and new concepts to utilize them without operating system interaction (like VIA [4]), compute clusters are becoming increasingly commonplace. Most of the interconnection networks focus only on message passing as their prime programming model neglecting the large code basis for shared memory. However, by utilizing the Scalable Coherent Interface (SCI) [19] with its ability to transparently perform remote memory operations, it is possible to support both efficient message passing and transparent shared memory on one single platform. This introduces a previously unknown flexibility into the cluster architecture.


Message Passing Global Memory Address Space Remote Memory Active Message 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Amza, C., Cox, A., Dwarkadas, S., Keleher, P., Lu, H., Rajamony, R., Yu, W., Zwaenepoel, W.: TreadMarks: Shared Memory Computing on Networks of Workstations. IEEE Computer (February 1995)Google Scholar
  2. 2.
    Basu, A., Buch, V., Vogels, W., von Eicken, T.: U-Net: A User-Level Network Interface for Parallel and Distributed Computing. In: Proc. of the 15th ACM Symposium on Operating Systems Principles, Copper Mountain, Colorado, ACM Press, New York (1995)Google Scholar
  3. 3.
    Blumrich, M.A., Li, K., Alpert, R., Dubnicki, C., Felten, E.W., Sandberg, J.: Virtual Memory Mapped Network Interface for the SHRIMP Multicomputer. In: Proceedings of the 21st ISCA, Chicago, Illinois. CAN, vol. 22, pp. 142–153. ACM, New York (1994)Google Scholar
  4. 4.
    Compaq Computer Corp. and Intel Corporation and Microsoft Corporation. Virtual Interface Architecture Specification (December 1997), Available with NDA via
  5. 5.
    Culler, D., Liu, L.T., Martin, R.P., Yoshikawa, C.O.: Assessing Fast Network Interfaces. IEEE MICRO 16(1), 35–43 (1996)CrossRefGoogle Scholar
  6. 6.
    Dolphin Interconnect Solutions, AS. PCI–SCI Cluster Adapter Specification (May 1996), Version 1.2 Google Scholar
  7. 7.
    Geist, A., Beguelin, A., Dongarra, J., Jiang, W., Manchek, R., Sunderam, V.: PVM: Parallel Virtual Machine A Users’ Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge (1994)zbMATHGoogle Scholar
  8. 8.
    Gillett, R.B.: Memory Channel Network for PCI. IEEE Micro 16(1), 12–18 (1996)CrossRefGoogle Scholar
  9. 9.
    Hellwagner, H., Karl, W., Leberecht, M.: Fast Communication Mechanisms–Coupling Hardware Distributed Shared Memory and User-Level Messaging. In: Proceedings of PDPTA 1997, Las Vegas, Nevada, June 30–July 3 (1997)Google Scholar
  10. 10.
    Herland, B.G., Eberl, M., Hellwagner, H.: A Common Messaging Layer for MPI and PVM over SCI. In: Bubak, M., Hertzberger, B., Sloot, P.M.A. (eds.) HPCN-Europe 1998. LNCS, vol. 1401, pp. 576–587. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  11. 11.
    Ibel, M., Schauser, K., Scheiman, C., Weis, M.: High-Performance Cluster Computing Using SCI. In: Hot Interconnects V (August 1997)Google Scholar
  12. 12.
    Itzkovitz, A., Schuster, A., Shalev, L.: Millipede: a User-Level NT-Based Distributed Shared Memory System with Thread Migration and Dynamic Run-Time Optimization of Memory References. In: Proceedings of the 1st USENIX Windows NT Workshop (August 1997)Google Scholar
  13. 13.
    Koch, P., Cecchet, E., de Pina, X.: Global Management of Coherent Shared Memory on an SCI Cluster. In: Proceedings of SCI-Europe 1998, a conference stream of EMMSEC 1998, September 1998, pp. 51–57 (1998)Google Scholar
  14. 14.
    Leffler, S.J., McKusick, M.K., Karels, M.J., Quarterman, J.S.: The Design and Implementation of the 4.3BSD UNIX Operating System. Addison-Wesley, Reading (1989)zbMATHGoogle Scholar
  15. 15.
    Mainwaring, A., Culler, D.: Active Messages Applications Programming Interface and Communication Subsystem Organization. Technical report, Computer Science Division, University of California at Berkeley (November 1995)Google Scholar
  16. 16.
    Paas, S., Dormanns, M., Bemmerl, T., Scholtyssik, K., Lankes, S.: Computing on a Cluster of PCs: Project Overview and Early Experiences. In: Rehm, W. (ed.) Tagungsband zum 1. Workshop Cluster Computing, number CSR-97-05 in Chemnitzer Informatik–Berichte, November 1997, pp. 217–229 (1997)Google Scholar
  17. 17.
    Pakin, S., Karamcheti, V., Chien, A.: Fast Messages (FM): Efficient, Portable Communication for Workstation Clusters and Massively-Parallel Processors. IEEE Concurrency (1997)Google Scholar
  18. 18.
    Schulz, M., Hellwagner, H.: Global Virtual Memory based on SCI-DSM. In: Proceedings of SCI-Europe 1998, a conference stream of EMMSEC 1998, September 1998, pp. 59–67 (1998)Google Scholar
  19. 19.
    Society, I.C.: IEEE Std 1596–1992: IEEE Standard for Scalable Coherent Interface. The Institute of Electrical and Electronics Engineers, Inc., 345 East 47th Street, New York, NY 10017, USA (August 1993)Google Scholar
  20. 20.
    Speight, E., Bennett, J.: Brazos: A Third Generation DSM System. In: Proceedings of the 1st USENIX Windows NT Workshop (August 1997)Google Scholar
  21. 21.
    Stets, R., Dwarkadas, S., Hardavellas, N., Hunt, G., Kontothanassis, L., Parthasarathy, S., Scott, M.: CASHMERE-2L: Software Coherent Shared Memory on a Clustered Remote-Write Network. In: Proceedings of SOSP 1997 (October 1997)Google Scholar
  22. 22.
    von Eicken, T., Culler, D.E., Goldstein, S.C., Schauser, K.E.: Active Messages: a Mechanism for Integrated Communication and Computation. In: Proceedings of the 19th ISCA, Gold Cost, Australia. CAN, vol. 20, pp. 256–266. ACM Press, New York (1992)Google Scholar
  23. 23.
    Weidendorfer, J.: Entwurf und Implementierung einer Socket-Bibliothek für ein SCI-Netzwerk. Master’s thesis, Technische Universität München (1997)Google Scholar
  24. 24.
    WWW: CRAY T3E Series (November 1998),

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • Wolfgang Karl
    • 1
  • Markus Leberecht
    • 1
  • Martin Schulz
    • 1
  1. 1.Lehrstuhl für Rechnertechnik und Rechnerorganisation, LRR-TUM Institut für InformatikTechnische Universität München 

Personalised recommendations