Lightning Network and Systems Architecture

  • David C. Hoffmeister
  • John Chu
  • James A. Perreault
  • Patrick Dowd
Part of the The Springer International Series in Engineering and Computer Science book series (SECS, volume 468)


Lightning is a dynamically reconfigurable, hierarchical, WDM network testbed project designed to interconnect a large number of supercomputers and create a distributed shared memory environment. The hierarchical architecture achieves scalability yet avoid the requirement of multiple wavelength tunable devices per node. Single-hop all-optical communication is achieved: a packet remains in the optical form from source to destination and does not require intermediate routing. The wavelength multiplexed hierarchical structure features wavelength channel re-use at each level, allowing scalability to very large system sizes. It partitions the traffic between different levels of the hierarchy without electronic intervention in a combination of wavelength- and space-division multiplexing. This approach can dynamically vary the bandwidth provided to different levels of the hierarchy. Each node monitors the traffic intensities on its subset of channels and detects any temporal or spatial shift in traffic balance. Bandwidth re-allocation is completely decentralized, any node can initiate it, achieving highly fault tolerant system behavior.


Traffic Load Traffic Intensity Control Packet Channel Allocation Optical Interconnection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    P. W. Dowd, K. Bogineni, K. A. Aly, and J. Perreault, “Hierarchical scalable photonic architectures for high-performance processor interconnection,” IEEE Transactions on Computers, vol. 42, pp. 1105–1120, Sept. 1993.CrossRefGoogle Scholar
  2. [2]
    C. E. Leiserson, “Fat-trees: Universal networks for hardware-efficient supercomputing,” IEEE Transactions on Computers, vol. c-34, pp. 892–901, Oct. 1985.Google Scholar
  3. [3]
    L. Hutcheson, “High speed optical interconnects for computing applications,” in Proc. SPIE, vol. 862, pp. 2–10, 1987.Google Scholar
  4. [4]
    P. W. Dowd, “Optical bus and star-coupled parallel interconnection,” in Proc. 4th International Parallel Processing Symposium, (Los Angeles, CA), pp. 824–838, Apr. 1990.Google Scholar
  5. [5]
    C. A. Brackett, “Dense wavelength division multiplexing networks: Principles and applications,” IEEE Journal on Selected Areas of Communications, vol. 8, pp. 948–964, Aug. 1990.CrossRefGoogle Scholar
  6. [6]
    L. Bhuyan and D. P. Agrawal, “Generalized hypercube and hyperbus structures for a computer network,” IEEE Transactions on Computers, vol. c-33, pp. 323–333, Apr. 1984.Google Scholar
  7. [7]
    J. Mogul, “Observing TCP dynamics in real networks,” in Proceedings of ACM SIGCOMM, pp. 305–317, Oct. 1992.Google Scholar
  8. [8]
    K. Claffy, G. Polyzos, and H. Braun, “Traffic characteristics of the T1 NSFNET backbone,” in IEEE INFOCOM’93, pp. 885–892, Mar. 1993.Google Scholar
  9. [9]
    P. W. Dowd and J. Chu, “Photonic architectures for distributed shared memory multiprocessor systems,” in IPPS’94 Workshop on Massively Parallel Processing Through Optical Interconnects, (Cancun, Mexico), IEEE, 1994.Google Scholar
  10. [10]
    I. M. I. Habbab, M. Kavehrad, and C. E. W. Sundberg, “Protocols for very high-speed optical fiber local area networks using a passive star topology,” IEEE Journal on Lightwave Technology, vol. LT-5, pp. 1782–1793, Dec. 1987.CrossRefGoogle Scholar
  11. [11]
    R. Mirchandaney, D. Towsley, and J. Stankovic, “Adaptive load sharing in heterogeneous distributed systems,” Journal of Parallel and Distributed Computing, vol. 9, pp. 331–346, 1990.CrossRefGoogle Scholar
  12. [12]
    A. P. Reeves and M. H. Willebeek-LeMair, “Strategies for dynamic load balancing on highly parallel computers,” IEEE Transactions on Parallel and Distributed Systems, vol. 4, pp. 979–993, Sept. 1993.CrossRefGoogle Scholar
  13. [13]
    J. R. Jump, YACSIM Reference Manual. Rice University, Department of Electrical and Computer Engineering, 1.2 ed., August 1992.Google Scholar
  14. [14]
    M. Lin, R. Tsang, D. Du, A. Klietz, and S. Saroff, “Performance evaluation of the CM-5 interconnection network,” Tech. Rep. AHPCRC Preprint 92-111, University of Minnesota, Army High Performance Computing Research Center, Oct. 1992.Google Scholar
  15. [15]
    T. Bujewski, J. Bannister, and M. Gerla, “ISONet: A dynamically reconfigurable integrated services optical network,” in 7th IEEE LAN/MAN Workshop, pp. 338–341, Mar. 1995.Google Scholar
  16. [16]
    J. Feehrer, J. R. Sauer, and L. Ramfelt, “Design and implementation of a prototype optical deflection network,” in Proc. ACM SIGCOMM’94, Aug. 1994.Google Scholar
  17. [17]
    S. Scott, J. Goodman, and M.K. Vernon, “Performance of SCI Ring,” in Proc. 19th International Symposium Computer Architecture, pp. 403–414, May 1992.Google Scholar
  18. [18]
    P. Dowd and K. M. Sivalingam, “A multi-level WDM access protocol for an optically interconnected parallel computer,” in Proc. IEEE INFOCOM’94, (Toronto, Ontario Canada), pp. 400–408, June 1994.Google Scholar
  19. [19]
    R. G. Minnich and D. V. Pryor, “Mether: Supporting the shared memory model on computing clusters,” in 38th Annual IEEE Computer Society International Computer Conference, pp. 558–567, February 1993.Google Scholar
  20. [20]
    R. Minnich, “Mether-NFS: A Modified NFS Which Supports Virtual Shared Memory,” in Proc SEDMS’93, 1993.Google Scholar
  21. [21]
    L. D. Wittie, G. Hermannsson, and A. Li, “Eager sharing for efficient massive parallelism,” in International Conference on Parallel Processing, (St, Charles, IL), pp. 251–255, August 1992.Google Scholar
  22. [22]
    F. Hady, R. Minnich, and D. Burns, “The memory integrated network interface,” in ACM Hot Interconnects Symposium, (San Jose, CA), 1994.Google Scholar
  23. [23]
    W. G. Schmidt, “The Application of TDMA to the INTELSAT IV Satellite Series,” COMSAT Tech. Rev., vol. 3, pp. 257–276, Fall 1973.Google Scholar
  24. [24]
    C. R. Carter, “Survey of Synchronization Techniques for a TDMA Satellite Switched System,” IEEE Transactions on Communications, vol. COM-28, pp. 1291–1301, Aug. 1980.CrossRefGoogle Scholar
  25. [25]
    K. Aly and P. Dowd, “A class of scalable optical interconnection networks through discrete broadcast-select multi-domain wdm,” in Proc. IEEE INFOCOM’94, (Toronto, Ontario Canada), pp. 392–399, June 1994.Google Scholar
  26. [26]
    Y. Oie, T. Suda, M. Murata, D. Kolson, and H. Miyahara, “Survey of switching techniques in high-speed networks and their performance,” IEEE INFOCOM’ 90, June 1990.Google Scholar

Copyright information

© Kluwer Academic Publishers 1998

Authors and Affiliations

  • David C. Hoffmeister
    • 1
    • 2
  • John Chu
    • 1
    • 2
  • James A. Perreault
    • 1
    • 3
  • Patrick Dowd
    • 2
    • 3
  1. 1.Department of Electrical EngineeringState University of New York at BuffaloBuffalo
  2. 2.Department of Electrical EngineeringUniversity of MarylandCollege Park
  3. 3.Department of DefenseFort Meade

Personalised recommendations