Skip to main content

The Time-to-Live Based Consistency Mechanism:

Understanding Performance Issues and Their Impact

  • Chapter
Web Content Delivery

Abstract

The Web is a large distributed database were copies of objects are replicated and used in multiple places. The dominant consistency mechanism deployed for HTTP (Hyper Text Transfer Protocol) and DNS (Domain Name Service) records is Time-to-Live (TTL) based weak consistency. Each object has a lifetimeduration assigned to it by its origin server. A copy of the object fetched from its origin server is received with maximum time-to-live (TTL) that equals its lifetime duration. Cached copies have shorter TTLs since the age (elapsed time since fetched from the origin) is deducted from the objects lifetime duration.

A request served by a cache constitutes a hit if the cache has a fresh copy of the object. Otherwise, the request is considered a miss and is propagated to another server. With HTTP, expired cached copies need to be validated, and if they turned out to be not modified, we refer to the request as a freshness miss.

We study how cache performance is affected by TTL-based consistency. Since cache misses induce user-perceived latency, a cache can reduce user perceived latency by refreshing its copies of popular objects proactively, before they are requested. For hierarchical caches, the number of cache misses depends in subtle ways on the age of the copies the cache receives. Thus, fresh copies obtained through another cache are less effective than fresh copies received from an authoritative server.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Akamai (2001). Akamai. http://www.akamai.com.

    Google Scholar 

  • Banga, G., Douglis, F., and Rabinovich, M. (1997). Optimistic deltas for WWW latency reduction. In Proceedings of the USENIX Annual Technical Conference. USENIX Association.

    Google Scholar 

  • Belady, L. A. (1966). A study of replacement algorithms for virtual storage computers. IBM systems journal, 5:78–101.

    Article  Google Scholar 

  • Berners-Lee, T., Fielding, R., and Frystyk, H. (1996). RFC 1945: Hypertext Transfer Protocol — HTTP/1.0.

    Google Scholar 

  • Bestavros, A., Carter, R., Crovella, M., Cunha, C., Heddaya, A., and Mirdad, S.(1995). Application-level document caching in the internet. In Proceedings of the Second Intl. Workshop on Services in Distributed and Networked Environments (SDNE’ 95). Available as http://cs-www.buc.edu/faculty/crovella/paper-archive/www-sdne95/paper.html.

    Google Scholar 

  • Breslau, L., Cao, P., Fan, L., Phillips, G., and Shenker, S. (1999). Web caching and zipf-like distributions: Evidence and implications. In Proceedings of the IEEE INFOCOM’99 Conference.

    Google Scholar 

  • Cacheman (2001). IBM WebSphere Cache Manager. http://www.software.ibm.com/webservers/cacheman.

    Google Scholar 

  • Cao, P. and Irani, S. (1997). Cost-aware WWW proxy caching algorithms. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, Monterey, California. http://www.usenix.org/events/usits97.

    Google Scholar 

  • Cao, P. and Liu, C. (1998). Maintaining strong cache consistency in the world wide web. IEEE Transactions on Computers, 47(4):445–457.

    Article  MathSciNet  Google Scholar 

  • Cohen, E., Halperin, E., and Kaplan, H. (2001). Performance aspects of distributed caches using TTL-based consistency. full version.

    Google Scholar 

  • Cohen, E. and Kaplan, H. (1999). Exploiting regularities in Web traffic patterns for cache replacement. In Proc. 31st Annual ACM Symposium on Theory of Computing. ACM.

    Google Scholar 

  • Cohen, E. and Kaplan, H. (2001a). The age penalty and its effect on cache performance. In Proceedings of the 3rd USENIX Symposium on Internet Technologies and Systems.

    Google Scholar 

  • Cohen, E. and Kaplan, H. (2001b). Aging through cascaded caches: performance issues in the distribution of Web content. In Proceedings of the ACM SIGCOMM Conference. ACM.

    Google Scholar 

  • Cohen, E. and Kaplan, H. (2001c). Proactive caching of DNS records: addressing a performance bottleneck. In Proceedings of the Symposium on Applications and the Internet. IEEE.

    Google Scholar 

  • Cohen, E. and Kaplan, H. (2002). Refreshment policies for Web content caches. Computer Networks, 38: 795–808.

    Article  Google Scholar 

  • Cohen, E., Krishnamurthy, B., and Rexford, J. (1998a). Evaluating serverassisted cache replacement in the Web. In Proceedings of the 6th European Symposium on Algorithms, pages 307–319. Springer-Verlag, Lecture Notes in Computer Science Vol. 1461.

    Google Scholar 

  • Cohen, E., Krishnamurthy, B., and Rexford, J. (1998b). Improving end-to-end performance of the Web using server volumes and proxy filters. In Proceedings of the ACM SIGCOMM’98 Conference.

    Google Scholar 

  • Cohen, E., Krishnamurthy, B., and Rexford, J. (1999). Efficient algorithms for predicting requests to web servers. In Proceedings of IEEE Infocom’ 99 Conference.

    Google Scholar 

  • Dingle, A. and Partl, T. (1996). Web cache coherence. In Proceedings of the Fifth International World Wide Web Conference, pages 907–920. Computer Networks and ISDN Systems 28:7-11.

    Google Scholar 

  • Duvvuri, V., Shenoy, P., and Tewari, R. (2000). Adaptive leases: a strong consistency mechanism for the World Wide Web. In Proceedings of the 19th IEEE INFOCOM Conference. http://www.ieee-infocom.org/2000/papers/.

    Google Scholar 

  • Feldmann, A., Cáceres, R., Douglis, F., Glass, G., and Rabinovich, M. (1999). Performance of Web proxy caching in heterogeneous bandwidth environments. In Proceedings of the IEEE INFOCOM”99 Conference.

    Google Scholar 

  • Fielding, R., Gettys, J., Mogul, J., Nielsen, H., Masinter, L., Leach, P., and Berners-Lee, T. (1999). RFC 2616: Hypertext Transfer Protocol—HTTP/1.1.

    Google Scholar 

  • Gray, C. and Cheriton, D. (1989). Leases: an efficient fault tolerant mecahnism for distributed file cache consistency. In Proceedings of the 12th ACM symposium on operating systems principles, pages 202–210.

    Google Scholar 

  • Hou, Y., Pan, J., Li, B., Tang, X., and Panwar, S. (2002). Modeling and analysis of an expiration-based hierarchical caching system. In Proceedings of IEEE Globecom Internet Performance Symposium. IEEE.

    Google Scholar 

  • Hou, Y., Pan, J., Wang, C., and Li, B. (2003). On prefetching in hierarchical caching systems. In Proceedings of IEEE ICC Global Services and Infrastructure for Next Generation Networking Symposium. IEEE.

    Google Scholar 

  • Howard, J., Kazar, M., Menees, S., Nichols, D., Satyanarayanan, M., Sidebotham, R., and West, M. (1988). Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51–81.

    Article  Google Scholar 

  • Inktomi (2001). Inktomi Traffic Server. http://www.inktomi.com.

    Google Scholar 

  • InktomiCDS (2001). Inktomi Content Delivery Suite. http://www.inktomi.com.

    Google Scholar 

  • IPWorX (2001). Lucent IPWorX, http://www.lucentipworx.com.

    Google Scholar 

  • IRCache (2001). A Distributed Testbed for National Information Provisioning.http://www.ircache.net.

    Google Scholar 

  • Jung, J., Berger, A., and Balakrishnan, H. (2003). Modeling TTL-based internet caches. In Proceedings of the IEEE Infocom.

    Google Scholar 

  • Jung, J., Sit, E., Balakrishnan, H., and Morris, R. (2001). DNS performance and the effectiveness of caching. In Proc. ACM SIGCOMM Internet Measurement Workshop.

    Google Scholar 

  • Krishnamurthy, Balachander and Wills, Craig E. (1997). Study of piggyback cache validation for proxy caches in the world wide web. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, Monterey, California.

    Google Scholar 

  • Leland, W. E., Taqq, M. S., Willinger, W., and Wilson, D. V. (1993). On the self-similar nature of Ethernet traffic. In Proc. of ACM SIGCOMM’ 93, pages 183–193.

    Google Scholar 

  • Li, D. and Cheriton, D. R. (1999). Scalable web caching of frequently updated objects using reliable multicast. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, pages 1–12.

    Google Scholar 

  • Mockapetris, P. (1987a). Domain names — concepts and facilities. RFC 1034, ISI. http://www.dns.net/dnsrd/rfc/rfc1034/rfc1034.html.

    Google Scholar 

  • Mockapetris, P. (1987b). Domain names — implementation and specification. RFC 1035, ISI. http://www.dns.net/dnsrd/rfc/rfc1035/rfc1035.html.

    Google Scholar 

  • Mogul, J. C. (1999). Errors in timestamp-based HTTP header values. Technical Report 99/3, Compaq Western Research Lab. http://www.research.digital.com/wrl/techreports/abstracts/99.3.html.

    Google Scholar 

  • Nottingham, M. (1999). Optimizing object freshness controls in Web caches. In The 4th International Web Caching Workshop. http://www.ircache.nlanr.net/Cache/workshop99/Papers.

    Google Scholar 

  • Paxson, V. and Floyd, S. (1995). Wide area traffic: the failure of Poisson modeling. IEEE/ACM Transactions on Networking, 3(3):226–244.

    Article  Google Scholar 

  • Squid (2001). Squid internet object cache. http://squid.nlanr.net/Squid.

    Google Scholar 

  • Williams, Stephen, Abrams, Marc, Standbridge, Charles R., Abdulla, Ghaleb, and Fox, Edward A. (1996). Removal policies in network caches for worldwide web documents. In Proceedings of the ACM SIGCOMM Conference, pages 293–305.

    Google Scholar 

  • Yin, J., Alvisi, L., Dahlin, M., and Lin, C. (1999). Volume leases for consistency in large-scale systems. IEEE transactions on knowledge and data engineering.

    Google Scholar 

  • Young, N. (1998). On line file caching. In Proc. 9th ACM-SIAM Symposium on Discrete Algorithms. ACM-SIAM.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer Science+Business Media, Inc.

About this chapter

Cite this chapter

Cohen, E., Kaplan, H. (2005). The Time-to-Live Based Consistency Mechanism:. In: Tang, X., Xu, J., Chanson, S.T. (eds) Web Content Delivery. Web Information Systems Engineering and Internet Technologies Book Series, vol 2. Springer, Boston, MA. https://doi.org/10.1007/0-387-27727-7_3

Download citation

  • DOI: https://doi.org/10.1007/0-387-27727-7_3

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-24356-6

  • Online ISBN: 978-0-387-27727-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics