Multimedia Tools and Applications

, Volume 34, Issue 2, pp 179–200 | Cite as

Advanced networking services for distributed multimedia streaming applications

  • Ada Gavrilovska
  • Sanjay Kumar
  • Srikanth SundaragopalanEmail author
  • Karsten Schwan


Increased network speeds coupled with new services delivered via the Internet have increased the demand for intelligence and flexibility in network systems. This paper argues that both can be provided by new hardware platforms comprised of heterogeneous multi-core systems with specialized communication support. We present and evaluate an experimental network service platform that uses an emergent class of devices—network processors—as its communication support, coupled via a dedicated interconnect to a host processor acting as a computational core. A software infrastructure spanning both enables the dynamic creation of application-specific services on the network processor, mediated by middleware and controlled by kernel-level communication support. Experimental evaluations use a Pentium IV-based computational core coupled with an IXP 2400 network processor. The sample application services run on both include an image manipulation application and application-level multicasting.


Network processors IXP Application-specific network services Application-level multicast Streaming applications Fast path processing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Apostolopoulos G, Aubespin D, Peris V, Pradhan P, Debanjan Saha (2000) Design, implementation and performance of a content-based switch, In: Proc. of IEEE INFOCOM 2000, Tel Aviv, Israel (March 2000)Google Scholar
  2. 2.
    Braun F, Lockwood J, Waldvogel M (2002) Protocol wrappers for layered network packet processing in reconfigurable networks. IEEE MICRO 22(1), (Jan/Feb)Google Scholar
  3. 3.
    Bustamante F, Eisenhauer G, Schwan K (2000) Efficient wire formats for high performance computing. In: Supercomputing 2000 (November 2000)Google Scholar
  4. 4.
    Carzagina A, Rosenblum DS, Wolf AL (2001) Design and evaluation of a wide-area event notification service. In: ACM transactions on computer systems, vol 19, no 3 (August)Google Scholar
  5. 5.
    Cisco Press Release (2005) Cisco unveils application oriented networking, In: Networkers’05 (June 2005)Google Scholar
  6. 6.
    Clark C, Lee W, Schimmel D, ContisD, Kone M, Thomas A (2004) A hardware platform for network intrusion detection and prevention. In: Proceedings of the 3rd workshop on network processors and applications (NP3), Madrid, Spain (February 2004)Google Scholar
  7. 7.
    Consel C, Hamdi H, Reveillere L, Singaravelu L, Yu H, Pu C (2003) Spidle: a DSL approach to specifying streaming applications. In: Proceedings of the 2nd international conference on generative programming and component engineering, Erfurt, Germany (September 2003)Google Scholar
  8. 8.
    Diot L, Gautier A (1999) A distributed architecture for multiplayer interactive applications on the Internet. In: Network, vol 13, no 4. IEEE, New York (July–August)Google Scholar
  9. 9.
    Eisenhauer G, Bustamante F, Schwan K (2000) Event services for high performance computing. In: 9th symposium on high performance distributed computing (HPDC-9), Pittsburgh, PA (August)Google Scholar
  10. 10.
    Feng Wu-ching, Bulusu N, Feng Wu-chang (2005) Dissecting the video sensing landscape. In: ACM NOSSDAV 2005, Stevenson, WA (June)Google Scholar
  11. 11.
    Feng W-C, Hurwitz G, Newman H, Ravot S, Cottrell L, Martin O, Coccetti F, Jin C, Wei D, Low S (2003) Optimizing 10-Gigabit ethernet for networks of workstations, clusters and grids: a case study. In: SC2003: high-performance networking and computing conference, Phoenix, AZ (November)Google Scholar
  12. 12.
    Gavrilovska A, Oleson V, Schwan K (2002) Practical approach for zero downtime in an operational information system. In: 22nd IEEE international conference on distributed computing systems (ICDCS-2005), Vienna, Austria (July)Google Scholar
  13. 13.
    Gavrilovska A, Kumar S, Schwan K (2004) The execution of event–action rules on programmable network processors. In: OASIS 2004, held with ASPLOS-XI (October)Google Scholar
  14. 14.
    Gavrilovska A, Kumar S, Sundaragopalan S, Schwan K (2005) Platform overlays: enabling in-network stream processing in large scale distributed applications. In: 15th workshop on network and operating systems principles and design (NOSSDAV’05), Stevenson, WA (June)Google Scholar
  15. 15.
    Gavrilovska A, Schwan K, Nordstrom O, Seifu H (2003) Network processors as building blocks in overlay networks. In: Hot interconnectsGoogle Scholar
  16. 16.
    Guo J, Yao J, Bhuyan L (2005) An efficient packet scheduling algorithm in network processors. In: IEEE infocom (March)Google Scholar
  17. 17.
  18. 18.
    Intel Corporation (2001) Intel IXA programming frameworkGoogle Scholar
  19. 19.
    IXP Intel Network Processor Family,
  20. 20.
    Kong J, Schwan K (2005) K-streams: kernel support for efficient data streaming in proxy servers. In: 15th workshop on network and operating systems principles and design (NOSSDAV’05) (June)Google Scholar
  21. 21.
    Krishnamurthy R, Yalamanchili S, Schwan K, West R (2002) Architecture and hardware for scheduling gigabit packet streams. In: Proceedings of hot interconnects, vol 10, Stanford, CA (August)Google Scholar
  22. 22.
    Kumar V, Cooper B, Cai Z, Eisenhauer G, Schwan K (2005) Resource-aware distributed stream management using dynamic overlays. In: 25th IEEE international conference on distributed computing systems (ICDCS-2005), Columbus, OHGoogle Scholar
  23. 23.
    Kumar S, Gavrilovska A, Sundaragopalan S, Schwan K (2005) C-core: using communication cores for high performance network services. In: 4th IEEE conference on network computing and applications (July)Google Scholar
  24. 24.
    Liao C, Martinosi M, Clark, D W (1998) Performance monitoring in a myrinet-connected shrimp cluster. In: ACM sigmetrics symposium on parallel and distributed tools (SPDT) (August)Google Scholar
  25. 25.
    Lin Y-D, Lin Y-N, Yang S-C, Lin Y-S (2002) DiffServ over network processors: implementation and evaluation. In: Proceedings of hot interconnects, vol 10 (August)Google Scholar
  26. 26.
    [LIN] Linksys Home Router, Linksys Broadband and Wireless Networking,
  27. 27.
    Liu L, Tang W, Buttler D, Pu C (2001) Information monitoring on the web: a scalable solution. In: World Wide Web Journal, vol 4, no 4. Kluwer, New YorkGoogle Scholar
  28. 28.
    Mehra P (2003) Apsara: The quest for the perfect server for network computing applications. In: Proceedings of network computing and applications (NCA), Cambridge, MA (April)Google Scholar
  29. 29.
    [NPF] Network Processing Forum,
  30. 30.
    Otey M, Noronha R, Parthasarathy S, Panda DK (2002) NIC-based intrusion detection: a feasibility study. In: Proceedings of the workshop on data mining for cyber threat analysisGoogle Scholar
  31. 31.
    Oleson V, Eisenhauer G, Schwan K, Plale B, Pu C, Amin D (2000) Operational information systems—an example from the airline industry. In: 1st workshop on industrial experiences and systems software (WEISS 2000), San Diego, CAGoogle Scholar
  32. 32.
    Pai V, Cox A, Pai V, Zwaenepoel W (2003) A flexible and efficient application programming interface (API) for a customizable proxy cache. In: Proceedings of 4th USENIX symposium on internet technologies and systems, Seattle, WA (August)Google Scholar
  33. 33.
    Path 1 Network Technologies (2002) Professional digital video gateways for the broadcaster and multi-service operator: delivered by Path 1 Network Technologies* and Intel® Network Processors. White paper,
  34. 34.
    Regnier G, Minturn D, McAlpine G, Saletore V, Foong A (2003) ETA: experience with an Intel Xeon processor as a packet processing engine, hot interconnects, vol XI, Stanford, CA (August)Google Scholar
  35. 35.
    Rosu M-C, Schwan K, Fujimoto R (1998) Supporting parallel applications on clusters of workstations: the virtual communication machine-based architecture. In: Cluster computing, Special issue on high performance distributed computing, vol. 1 (May)Google Scholar
  36. 36.
    Roy S, Ankcorn J, Wee S (2003) An Architecture for componentized, network-based media services. In: Proceedings of IEEE international conference on multimedia and expo (July)Google Scholar
  37. 37.
    Rowstron A, Kermarrec A-M, Castro M, Druschel P (2001) SCRIBE: the design of a large-scale event notification infrastructure. In: Proceedings of 3rd international workshop on networked group communication, London, UK (November)Google Scholar
  38. 38.
    Shah N, Plishker W, Keutzer K (2003) NP-click: a programming model for the Intel IXP1200. In: 2nd workshop on network processors (NP-2), Anaheim, CA. (February)Google Scholar
  39. 39.
    Shivam P, Wyckoff P, Panda DK (2002) Can user level protocols take advantage of multi-CPU NICs? In: International parallel and distributed processing symposium (IPDPS ‘02) (April)Google Scholar
  40. 40.
    Spalink T, Karlin S, Peterson L, Gottlieb Y (2001) Building a robust software-based router using network processors. In: SOSP 2001, Banff, Canada (December)Google Scholar
  41. 41.
    Sundaragopalan S, Gavrilovska A, Kumar S, Schwan K (2005) An approach towards enabling intelligent networking services for distributed multimedia applications. In: IMMCN’05 (April)Google Scholar
  42. 42.
    Teja NP Software Platform for Intel IXP2xxx Network Processor Family, White Paper,
  43. 43.
    Taylor DE, Lockwood JW, Sproull TS, Turner JS, Parlour DB (2002) Scalable IP lookup for programmable routers. In: Proceedings of IEEE INFOCOM 2002, New York, NY (June)Google Scholar
  44. 44.
    Tibco Software Inc.,
  45. 45.
    Thies W, Karczmarek M, Amarasinghe S (2002) StreamIt: A language for streaming applications, international conference on compiler construction (ICCC’02), Grenoble, France (April)Google Scholar
  46. 46.
    West R, Schwan K (1999) Dynamic window-constrained scheduling for multimedia applications. In: Proceedings of 6th international conference on multimedia computing and systems, Florence, Italy (June)Google Scholar
  47. 47.
    Wolf M, Cai Z, Huang W, Schwan K (2002) WCH02s: Personalized scientific data portals in your hand. In: Supercomputing 2002 (November)Google Scholar
  48. 48.
    Yocum K, Chase J (2001) Payload caching: high-speed data forwarding for network intermediaries. In: Proceedings of USENIX technical conference (USENIX’01), Boston, MA (June)Google Scholar
  49. 49.
    Zhao Y, Storm R (2001) Exploiting event stream interpretation in publish-subscribe systems. In: Proceedings of ACM symposium on principles of distributed computing, Newport, RI (August)Google Scholar
  50. 50.
    Zhuang X, Shi W, Paul I, Schwan K (2002) Efficient implementation of the DWCS algorithm on high-speed programmable network processors. In: Proceedings of multimedia networks and systems (MMNS) (October)Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • Ada Gavrilovska
    • 1
  • Sanjay Kumar
    • 1
  • Srikanth Sundaragopalan
    • 1
    • 2
    Email author
  • Karsten Schwan
    • 1
  1. 1.Center for Experimental Research in Computer SystemsGeorgia Institute of TechnologyAtlantaUSA
  2. 2.Microsoft CorporationRedmondUSA

Personalised recommendations