Advertisement

The Time-to-Live Based Consistency Mechanism:

Understanding Performance Issues and Their Impact
  • Edith Cohen
  • Haim Kaplan
Chapter
  • 433 Downloads
Part of the Web Information Systems Engineering and Internet Technologies Book Series book series (WISE, volume 2)

Abstract

The Web is a large distributed database were copies of objects are replicated and used in multiple places. The dominant consistency mechanism deployed for HTTP (Hyper Text Transfer Protocol) and DNS (Domain Name Service) records is Time-to-Live (TTL) based weak consistency. Each object has a lifetimeduration assigned to it by its origin server. A copy of the object fetched from its origin server is received with maximum time-to-live (TTL) that equals its lifetime duration. Cached copies have shorter TTLs since the age (elapsed time since fetched from the origin) is deducted from the objects lifetime duration.

A request served by a cache constitutes a hit if the cache has a fresh copy of the object. Otherwise, the request is considered a miss and is propagated to another server. With HTTP, expired cached copies need to be validated, and if they turned out to be not modified, we refer to the request as a freshness miss.

We study how cache performance is affected by TTL-based consistency. Since cache misses induce user-perceived latency, a cache can reduce user perceived latency by refreshing its copies of popular objects proactively, before they are requested. For hierarchical caches, the number of cache misses depends in subtle ways on the age of the copies the cache receives. Thus, fresh copies obtained through another cache are less effective than fresh copies received from an authoritative server.

Keywords

TTL Time To Live Cache Web caching Domain Name System 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Akamai (2001). Akamai. http://www.akamai.com.Google Scholar
  2. Banga, G., Douglis, F., and Rabinovich, M. (1997). Optimistic deltas for WWW latency reduction. In Proceedings of the USENIX Annual Technical Conference. USENIX Association.Google Scholar
  3. Belady, L. A. (1966). A study of replacement algorithms for virtual storage computers. IBM systems journal, 5:78–101.CrossRefGoogle Scholar
  4. Berners-Lee, T., Fielding, R., and Frystyk, H. (1996). RFC 1945: Hypertext Transfer Protocol — HTTP/1.0.Google Scholar
  5. Bestavros, A., Carter, R., Crovella, M., Cunha, C., Heddaya, A., and Mirdad, S.(1995). Application-level document caching in the internet. In Proceedings of the Second Intl. Workshop on Services in Distributed and Networked Environments (SDNE’ 95). Available as http://cs-www.buc.edu/faculty/crovella/paper-archive/www-sdne95/paper.html.Google Scholar
  6. Breslau, L., Cao, P., Fan, L., Phillips, G., and Shenker, S. (1999). Web caching and zipf-like distributions: Evidence and implications. In Proceedings of the IEEE INFOCOM’99 Conference.Google Scholar
  7. Cacheman (2001). IBM WebSphere Cache Manager. http://www.software.ibm.com/webservers/cacheman.Google Scholar
  8. Cao, P. and Irani, S. (1997). Cost-aware WWW proxy caching algorithms. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, Monterey, California. http://www.usenix.org/events/usits97.Google Scholar
  9. Cao, P. and Liu, C. (1998). Maintaining strong cache consistency in the world wide web. IEEE Transactions on Computers, 47(4):445–457.MathSciNetCrossRefGoogle Scholar
  10. Cohen, E., Halperin, E., and Kaplan, H. (2001). Performance aspects of distributed caches using TTL-based consistency. full version.Google Scholar
  11. Cohen, E. and Kaplan, H. (1999). Exploiting regularities in Web traffic patterns for cache replacement. In Proc. 31st Annual ACM Symposium on Theory of Computing. ACM.Google Scholar
  12. Cohen, E. and Kaplan, H. (2001a). The age penalty and its effect on cache performance. In Proceedings of the 3rd USENIX Symposium on Internet Technologies and Systems.Google Scholar
  13. Cohen, E. and Kaplan, H. (2001b). Aging through cascaded caches: performance issues in the distribution of Web content. In Proceedings of the ACM SIGCOMM Conference. ACM.Google Scholar
  14. Cohen, E. and Kaplan, H. (2001c). Proactive caching of DNS records: addressing a performance bottleneck. In Proceedings of the Symposium on Applications and the Internet. IEEE.Google Scholar
  15. Cohen, E. and Kaplan, H. (2002). Refreshment policies for Web content caches. Computer Networks, 38: 795–808.CrossRefGoogle Scholar
  16. Cohen, E., Krishnamurthy, B., and Rexford, J. (1998a). Evaluating serverassisted cache replacement in the Web. In Proceedings of the 6th European Symposium on Algorithms, pages 307–319. Springer-Verlag, Lecture Notes in Computer Science Vol. 1461.Google Scholar
  17. Cohen, E., Krishnamurthy, B., and Rexford, J. (1998b). Improving end-to-end performance of the Web using server volumes and proxy filters. In Proceedings of the ACM SIGCOMM’98 Conference.Google Scholar
  18. Cohen, E., Krishnamurthy, B., and Rexford, J. (1999). Efficient algorithms for predicting requests to web servers. In Proceedings of IEEE Infocom’ 99 Conference.Google Scholar
  19. Dingle, A. and Partl, T. (1996). Web cache coherence. In Proceedings of the Fifth International World Wide Web Conference, pages 907–920. Computer Networks and ISDN Systems 28:7-11.Google Scholar
  20. Duvvuri, V., Shenoy, P., and Tewari, R. (2000). Adaptive leases: a strong consistency mechanism for the World Wide Web. In Proceedings of the 19th IEEE INFOCOM Conference. http://www.ieee-infocom.org/2000/papers/.Google Scholar
  21. Feldmann, A., Cáceres, R., Douglis, F., Glass, G., and Rabinovich, M. (1999). Performance of Web proxy caching in heterogeneous bandwidth environments. In Proceedings of the IEEE INFOCOM”99 Conference.Google Scholar
  22. Fielding, R., Gettys, J., Mogul, J., Nielsen, H., Masinter, L., Leach, P., and Berners-Lee, T. (1999). RFC 2616: Hypertext Transfer Protocol—HTTP/1.1.Google Scholar
  23. Gray, C. and Cheriton, D. (1989). Leases: an efficient fault tolerant mecahnism for distributed file cache consistency. In Proceedings of the 12th ACM symposium on operating systems principles, pages 202–210.Google Scholar
  24. Hou, Y., Pan, J., Li, B., Tang, X., and Panwar, S. (2002). Modeling and analysis of an expiration-based hierarchical caching system. In Proceedings of IEEE Globecom Internet Performance Symposium. IEEE.Google Scholar
  25. Hou, Y., Pan, J., Wang, C., and Li, B. (2003). On prefetching in hierarchical caching systems. In Proceedings of IEEE ICC Global Services and Infrastructure for Next Generation Networking Symposium. IEEE.Google Scholar
  26. Howard, J., Kazar, M., Menees, S., Nichols, D., Satyanarayanan, M., Sidebotham, R., and West, M. (1988). Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51–81.CrossRefGoogle Scholar
  27. Inktomi (2001). Inktomi Traffic Server. http://www.inktomi.com.Google Scholar
  28. InktomiCDS (2001). Inktomi Content Delivery Suite. http://www.inktomi.com.Google Scholar
  29. IPWorX (2001). Lucent IPWorX, http://www.lucentipworx.com.Google Scholar
  30. IRCache (2001). A Distributed Testbed for National Information Provisioning.http://www.ircache.net.Google Scholar
  31. Jung, J., Berger, A., and Balakrishnan, H. (2003). Modeling TTL-based internet caches. In Proceedings of the IEEE Infocom.Google Scholar
  32. Jung, J., Sit, E., Balakrishnan, H., and Morris, R. (2001). DNS performance and the effectiveness of caching. In Proc. ACM SIGCOMM Internet Measurement Workshop.Google Scholar
  33. Krishnamurthy, Balachander and Wills, Craig E. (1997). Study of piggyback cache validation for proxy caches in the world wide web. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, Monterey, California.Google Scholar
  34. Leland, W. E., Taqq, M. S., Willinger, W., and Wilson, D. V. (1993). On the self-similar nature of Ethernet traffic. In Proc. of ACM SIGCOMM’ 93, pages 183–193.Google Scholar
  35. Li, D. and Cheriton, D. R. (1999). Scalable web caching of frequently updated objects using reliable multicast. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, pages 1–12.Google Scholar
  36. Mockapetris, P. (1987a). Domain names — concepts and facilities. RFC 1034, ISI. http://www.dns.net/dnsrd/rfc/rfc1034/rfc1034.html.Google Scholar
  37. Mockapetris, P. (1987b). Domain names — implementation and specification. RFC 1035, ISI. http://www.dns.net/dnsrd/rfc/rfc1035/rfc1035.html.Google Scholar
  38. Mogul, J. C. (1999). Errors in timestamp-based HTTP header values. Technical Report 99/3, Compaq Western Research Lab. http://www.research.digital.com/wrl/techreports/abstracts/99.3.html.Google Scholar
  39. Nottingham, M. (1999). Optimizing object freshness controls in Web caches. In The 4th International Web Caching Workshop. http://www.ircache.nlanr.net/Cache/workshop99/Papers.Google Scholar
  40. Paxson, V. and Floyd, S. (1995). Wide area traffic: the failure of Poisson modeling. IEEE/ACM Transactions on Networking, 3(3):226–244.CrossRefGoogle Scholar
  41. Squid (2001). Squid internet object cache. http://squid.nlanr.net/Squid.Google Scholar
  42. Williams, Stephen, Abrams, Marc, Standbridge, Charles R., Abdulla, Ghaleb, and Fox, Edward A. (1996). Removal policies in network caches for worldwide web documents. In Proceedings of the ACM SIGCOMM Conference, pages 293–305.Google Scholar
  43. Yin, J., Alvisi, L., Dahlin, M., and Lin, C. (1999). Volume leases for consistency in large-scale systems. IEEE transactions on knowledge and data engineering.Google Scholar
  44. Young, N. (1998). On line file caching. In Proc. 9th ACM-SIAM Symposium on Discrete Algorithms. ACM-SIAM.Google Scholar

Copyright information

© Springer Science+Business Media, Inc. 2005

Authors and Affiliations

  • Edith Cohen
    • 1
  • Haim Kaplan
    • 2
  1. 1.AT&T Labs-ResearchFlorham ParkUSA
  2. 2.Tel-Aviv UniversityTel AvivIsrael

Personalised recommendations