LLM: A Low Latency Messaging Infrastructure for Linux Clusters

  • R. K. Shyamasundar
  • Basant Rajan
  • Manish Prasad
  • Amit Jain
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2552)


In this paper, we develop a messaging infrastructure, called LLM, to arrive at a robust and efficient low latency message passing infrastructure for kernel-to-kernel communication. The main focus is to overcome the high latencies associated with the conventional communication protocol stack management of TCP/IP. The LLM provides a transport protocol that offers high reliability at the fragment level keeping the acknowledgment overhead low given the high reliability levels of the LAN. The system utilizes some of the architectural facilities provided by the Linux kernel specially designed for optimization in the respective areas. Reliability against fragment losses is ensured by using a low overhead negative acknowledgment scheme. The implementation is in the form of loadable modules extending the Linux OS. In a typical implementation on a cluster of two nodes, each of uniprocessor Intel Pentium 400 MHz on a 10/100 Mbps LAN achieved an average round trip latency of .169ms as compared to the .531ms obtained by ICMP (Ping) protocol. A relative comparison of LLM with others is also provided.


Cluster Node Memory Allocation Original Packet Negative Acknowledgment Object Cache 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    A. Barak, I. Metrik, Performance of the communication layers of TCP/IP with the Myrinet Gigabit LAN, Computer Communications, Vol. 22, No.11, July 1999,
  2. [2]
    Jeff Bonwick, The slab allocator: An object caching kernel memory allocator, USENIX Summer Tech. Conf., Boston, Mass. 1994.Google Scholar
  3. [3]
  4. [5]
    A. Mainwarning, D. E. Culler, Active Message Application Programming Interface and Communication Subsystem Organization, TR, Univ. of Calif., Berkeley,1995.Google Scholar
  5. [6]
    S.P.V. Karamcheti, A. A. Chien,Fast Messages: Efficient, Portable Communication for Workstation Clusters and MPP’s, IEEE Concurrency 5(2):60–73, 1997.CrossRefGoogle Scholar
  6. [7]
    H. Tezuka, A. Hori, Y. Ishikawa, M. Sato, PM: An Operating System Coordinated High Performance Communication Library, in Proc.Int.Conf. on High-Performance Computing and Networking (HPCN Europe 1997), pp. 708–717, April 1997.Google Scholar
  7. [8]
    T. von Eicken, A. Basu, W. Vogels, U-Net: A user level network interface for parallel and distributed computing, in Proc.15th ACM Symp on Operating Systems Principle, pp. 40–53, 1995.Google Scholar
  8. [9]
    J. Peterson, T. Norman, Buddy Systems, CACM, June 1977.Google Scholar
  9. [10]
    Giuseppe Ciaccio A Communication system for Efficient Parallel Processing on Clusters of Personal Computers, PhD Thesis DISI-TH-1999-02, June 1999.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • R. K. Shyamasundar
    • 1
  • Basant Rajan
    • 1
  • Manish Prasad
    • 1
  • Amit Jain
    • 1
  1. 1.School Of Technology and Computer ScienceTata Institute of Fundamental ResearchMumbaiIndia

Personalised recommendations