Abstract
Over the past few years, we have seen the proliferation of Internet-based services ranging from search engines and map services to video-on-demand servers. All of these kinds of services need to be able to provide guarantees of availability and scalability to their users. With millions of users on the Internet today, these services must have the capacity to handle a large number of clients and remain available even in the face of extremely high load.
In this paper, we present a generic architecture for supporting such Internet applications. We provide a substrate for Scalable Network Services (SNS), on top of which application developers can design their services without worrying about the details of service management. We back our design with three real-world services: a web distillation proxy, a proxy-based web-browser for PDAs, and an MBone archive server.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
COM Corporation (1996), ‘3COM PalmPilot’.http://www.palmpilot.com/
Almeroth, K. & Ammar, M. (1998), The Interactive Multimedia Jukebox (IMJ): A new paradigm for the on-demand delivery of audio/video, in `Proceedings of the Seventh International World Wide Web Conference’.
Amir, E., McCanne, S. & Katz, R. (1998), An Active Service Framework and its Application to Real-time Multimedia Transcoding, in `Proceedings of ACM SIGCOMM ‘88’.
Amir, E., McCanne, S. & Zhang, H. (1995), An Application-level Video Gateway, in `Pro-ceedingsof ACM Multimedia ‘85’, San Francisco, CA, pp. 255–265.
Anderson, E. (1995), The Magicrouter: An Application of Fast Packet Interposing. Class report, UC Berkeley.
Anderson, T. E., Culler, D. E., Patterson, D. A. & the NOW team (1994), A Case for Networks of Workstations: NOW, in `Principles of Distributed Computing’.
Anonymizer Inc. (1996), `The Web Anonymizer’.http://www.anonymizer.com/.
Balakrishnan, H., Seshan, S., Amir, E. & Katz, R. (1995), Improving TCP/IP Performance Over Wireless Networks, in`Proceedings of the first ACM Conference on Mobile Computing and Networking’, Berkeley, CA.
Bartlett, J. F. (1981), A NonStop Kernel, in `Proceedings of the 8th SOSP’.
Bolosky, W. J., Fitzgerald, R. P. & Douceur, J. R. (1997), Distributed schedule management in the Tiger video fileserver, in `Proceedings of the Sixteenth ACM Symposium on Operating Systems Principles’.
Borenstein, N. & Freed, N. (1993), MIME (Multipurpose Internet Mail Extensions): Mechanisms for Specifying and Describing the Format of Internet Message Bodies. RFC-1521.
Brisco, T. (1995), DNS Support for Load Balancing. RFC-1764.
Chawathe, Y., Fink, S., McCanne, S. & Brewer, E. (1998), `A Proxy Architecture for Reliable Multicast in Heterogeneous Environments’.
Chen, M. & Hong, J. (1997), Cha-Cha: Contextualizing Hypertext Searches. Class report, UC Berkeley.
Cisco Systems (1996), `Local Director’.http://www.cisco.com/warp/public/751/lodir/. CitySearch Inc. (1997). http://www.citysearch.com/.
Crovella, M. E. & Bestavros, A. (1995), Explaining world wide web traffic self-similarity, Technical Report TR-95–015, Computer Science Department, Boston University.
Deering, S. E. (1991), Multicast Routing in a Datagram Internetwork, PhD thesis, Stanford University.
Deering, S., Estrin, D., Farinacci, D., Jacobson, V., Liu, C.-G. & Wei, L. (1996), `An Architecture for Wide-area Multicast Routing’, IEEE/ACM Transactions on Networking4 (2).
Demers, A., Peterson, K., Spreitzer, M., Terry, D., Theimer, M. & Welch, B. (n.d.), `The Bayou Architecture: Support for Data Sharing Among Mobile Users’.
Digital Corporation (1996), `The AltaVista Search Engine’. http://altavista.digital.com/.
Floyd, S. & Jacobson, V. (1994), `The Synchronization of Periodic Routing Messages’, IEEE/ACM Transactions on Networking2 (2), 122–136.
Fox, A. (1997), The Case For TACC: Scalable Servers for Transformation, Aggregation, Caching and Customization. Qualifying Exam Proposal, UC Berkeley Computer Science Division.
Fox, A., Goldberg, I., Gribble, S. D., Polito, A., Lee, D. C. & Brewer, E. A. (1998), Experience with Top Gun Wingman, A Proxy-Based Graphical Web Browser for the 3COM PalmPilot, in `Proceedings of Middleware ‘88’.
Fox, A., Gribble, S., Brewer, E. & Amir, E. (1996), Adapting to Network and Client Variability via On-demand Dynamic Distillation, in`Proceedings of ASPLOS-VII’, Cambridge, MA.
Fox, A., Gribble, S., Chawathe, Y., Brewer, E. & Gauthier, P. (1997), Cluster-based Scalable Network Services, in`Proceedings of SOSP ‘87’, St. Malo, France, pp. 78–91.
Fox, A., Gribble, S. D., Chawathe, Y. & Brewer, E. A. (1998), Adapting to Network and Client Variation Using Active Proxies: Lessons and Perspectives, in `A special issue of IEEE Personal Communications on Adapation’.
Gray, J. (1981), The Transaction Concept: Virtues and Limitations, in`Proceedings of VLDB ‘81’, Cannes, France, pp. 144–154.
Gribble, S. D. & Brewer, E. A. (1997), System Design Issues for Internet Middleware Services: Deductions from a Large Client Trace, in`Proceedings of the 1997 Usenix Symposium on Internet Technologies and Systems’, Monterey, CA.
Gribble, S. D., Manku, G. S., Roselli, D., Brewer, E. A., Gibson, T. J. & Miller, E. L. (1998), Self-Similarity in File Systems, in `Proceedings of ACM SIGMETRICS ‘88’.
Handley, M. (1996), SAP: Session Announcement Protocol. Internet Draft.
Inktomi Corp. (1996), `The HotBot Search Engine’.http://www.hotbot.com/
Leland, W. E., Taqqu, M. S., Willinger, W. & Wilson, D. V. (1994), `On the Self-Similar Nature of Ethernet Traffic (extended version)’, IEEE/ACM Transactions on Networking2.
MapQuest (1996).http://www.mapquest.com/
McQuillan, J., Richer, I. & Rosen, E. (1980), `The New Routing Algorithm for the ARPANET’, IEEE Transactions on Communications28 (5), 711–719.
Mitzenmacher, M. (1997), How useful is old information? Extended abstract: Using stale information for load balancing in distributed systems.
Mohan et al. (1992), `ARIES: A Transaction Recovery Method Supporting Fine-Granularity
Locking and Partial Rollbacks Using Write-Ahead Logging’, TODS 17(1), 94–162.
National Aeronautics and Space Administration (1997), `The Mars Pathfinder Mission Home Page’.http://mpfwww.jpl.nasa.gov/default 1.html
Nonnenmacher, J. & Biersack, E. W. (1998), Optimal Multicast Feedback, in`Proceedings of IEEE INFOCOM ‘88’, San Francisco, CA.
Raymond, E. S., ed. (1991), `The new hackers dictionary’, MIT Press. Also http://www.ccil.org/jargon/jargon.html
Schuett, A. & Raman, S. (1997), MARS: A Media Archive Server for On-demand Remote Playback. Class report, UC Berkeley.
Schulzrinne, H., Casner, S., Frederick, R. & Jacobson, V. (1996), `RTP: A Transport Protocol for Real-Time Applications’, Internet Engineering Task Force, Audio-Video Transport Working Group. RFC-1889.
Shoch, J. F. & Hupp, J. A. (1982), `The “Worm” programs: Early Experiences with Distributed Systems’, Communications of the Association for Computing Machinery25 (3), 172–180.
Waldspurger, C. & Weihl, W. (1994), Lottery Scheduling: Flexible Proportional Share Resource Management, in `Proceedings of the First OSDI’.
Yahoo! Inc (1995).http://www.yahoo.com/
Yoshikawa, C., Chun, B., Eastham, P., Anderson, T. & Culler, D. (1997), Using Smart Clients to Build Scalable Services, in `Proceedings of USENIX ‘87’.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag London Limited
About this paper
Cite this paper
Chawathe, Y., Brewer, E.A. (1998). System Support for Scalable and Fault Tolerant Internet Services. In: Davies, N., Jochen, S., Raymond, K. (eds) Middleware’98. Springer, London. https://doi.org/10.1007/978-1-4471-1283-9_5
Download citation
DOI: https://doi.org/10.1007/978-1-4471-1283-9_5
Publisher Name: Springer, London
Print ISBN: 978-1-4471-1285-3
Online ISBN: 978-1-4471-1283-9
eBook Packages: Springer Book Archive