Skip to main content
SpringerLink
Log in

Introduction

  • Chapter
  • First Online:
Book cover Analysis of TCP Performance in Data Center Networks

Part of the book series: SpringerBriefs in Electrical and Computer Engineering ((BRIEFSELECTRIC))

  • 1017 Accesses

Abstract

Growing adoption of Cloud Computing, by both the IT industry and the general public, is driving service providers into creating new data centers. Data centers are facilities that host hundreds of thousands of servers which concurrently support a myriad of distinct services and applications. Cost and compatibility reasons however, persuade many data center administrators to employ Ethernet as their baseline communication fabric. Unfortunately, TCP—the most widely used transport protocol on Ethernet based communication networks, exhibits several shortcomings when employed in high bandwidth, low latency data center environments. One such grave shortcoming is referred to as the Incast problem and will be the main focus of this manuscript.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. S.L. Garfinkel, H. Abelson, Architects of the Information Society: Thirty-Five Years of the Laboratory for Computer Science at MIT (The MIT Press, Cambridge, 1999)

    Google Scholar 

  2. J. McCarthy, Reminiscences on the history of time sharing. (1983) [Online]. http://www-formal.stanford.edu/jmc/history/timesharing/timesharing.html

  3. R. Buyya, C.S. Yeo, S. Venugopal, J. Broberg, I. Brandic, Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25, 599–616 (2009) [Online]. http://dx.doi.org/10.1016/j.future.2008.12.001

  4. Z. Mahmood, R. Hill, Cloud Computing for Enterprise Architectures (Springer Publishing Company (Incorporated), London, 2011)

    Google Scholar 

  5. D.W. Cearley, Cloud Computing: Key Initiative Overview, Gartner Report, Gartner, Inc., (2010) [Online]. http://www.gartner.com/it/initiatives/pdf/KeyInitiativeOverview_CloudComputing.pdf

  6. J. Rhoton, Cloud Computing Explained: Implementation Handbook for Enterprises. (Recursive Press, London, 2009)

    Google Scholar 

  7. P. Mell, T. Grance, The NIST Definition of Cloud Computing, Special Publication 800–145, National Institute of Standards and Technology, Technical Report, Sep 2011 [Online]. http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf

  8. W.Y. Chang, H. Abu-Amara, J.F. Sanford, Transforming Enterprise Cloud Services. (Springer Publishing Company Incorporated, New York, 2010)

    Google Scholar 

  9. S. Marston, Z. Li, S. Bandyopadhyay, J. Zhang, A. Ghalsasi, Cloud computing—the business perspective. Decis. Support Syst. 51(1), 176–189 (2011) [Online]. http://www.sciencedirect.com/science/article/pii/S0167923610002393

  10. M. Miller, Cloud Computing: Web-Based Applications that Change the Way You Work and Collaborate Online. (Que, Indianapolis, 2008)

    Google Scholar 

  11. C. Takemura, L.S. Crawford, The Book of Xen: A Practical Guide for the System Administrator. (No Starch Press, San Francisco, 2009)

    Google Scholar 

  12. J. Arrasjid, K. Balachandran, D. Conde, G. Lamb, S. Kaplan, Deploying the VMware Infrastructure (The USENIX Association, Berkeley, 2010)

    Google Scholar 

  13. Cloud.com, 2011 Cloud Computing Outlook (2011) [Online]. http://www.cloudstack.org/cloud-computing-docs/cloud-computing-survey.pdf

  14. K. Murray, Microsoft Office 365: Connect and Collaborate Virtually Anywhere, Anytime, 1st edn. (Microsoft Press, Redmond, Washington, 2011)

    Google Scholar 

  15. D. Beaver, S. Kumar, H.C. Li, J. Sobel, P. Vajgel, Finding a needle in Haystack: Facebook’s photo storage, Proceedings of the 9th USENIX conference on Operating systems design and implementation, ser. OSDI’10 (USENIX Association, Berkeley, CA, USA, 2010), pp. 1–8 [Online]. http://dl.acm.org/citation.cfm?id=1924943.1924947

  16. B.F. Cooper, E. Baldeschwieler, R. Fonseca, J.J. Kistler, P.P.S. Narayan, C. Neerdaels, T. Negrin, R. Ramakrishnan, A. Silberstein, U. Srivastava, R. Stata, Building a cloud for Yahoo!. IEEE Data. Eng. Bull. 32, 36–43 (2009)

    Google Scholar 

  17. B.F. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H.-A. Jacobsen, N. Puz, D. Weaver, R. Yerneni, PNUTS: Yahoo!’s hosted data serving platform. Proc. VLDB Endowment 1(2), 1277–1288 (2008) [Online]. http://dx.doi.org/10.1145/1454159.1454167

  18. D. Robinson, Amazon Web Services Made Simple: Learn how Amazon EC2, S3, SimpleDB and SQS Web Services Enables you to Reach Business Goals Faster (Emereo Pty Ltd, London, 2008)

    Google Scholar 

  19. J. E. Burgess, Youtube, in Oxford Bibliographies Online. (Oxford University Press, Oct 2011), final version following copy-editing by OUP [Online]. http://eprints.qut.edu.au/46719/

  20. F.P. Miller, A.F. Vandome, J. McBrewster, Gmail: Gmail. Webmail, Post Office Protocol, Internet Message Access Protocol, Google, Gmail interface, History of Gmail, Paul Buchheit, Google’s hoaxes, Comparison of webmail providers, Gmail Mobile. (Alpha Press, Orlando, 2009)

    Google Scholar 

  21. A. Greenberg, J.R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D.A. Maltz, P. Patel, S. Sengupta, VL2: a scalable and flexible data center network, in Proceedings of the ACM SIGCOMM 2009 Conference on Data communication, ser. SIGCOMM ’09. (ACM, New York, USA, 2009), pp. 51–62 [Online]. http://doi.acm.org/10.1145/1592568.1592576

  22. M. Armbrust, A. Fox, R. Griffith, A.D. Joseph, R.H. Katz, A. Konwinski, G. Lee, D.A. Patterson, A. Rabkin, I. Stoica, M. Zaharia, Above the Clouds: A Berkeley View of Cloud Computing. EECS Department, University of California, Berkeley, Technical Report UCB/EECS-2009-28, Feb 2009 [Online]. http://www.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-28.html

  23. A. Greenberg, J. Hamilton, D.A. Maltz, P. Patel, The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39(1), 68–73 (2008) [Online]. http://doi.acm.org/10.1145/1496091.1496103

  24. K. Kant, Data center evolution: a tutorial on state of the art, issues, and challenges. Comput. Netw. 53(17), 2939–2965 (2009) Virtualized data centers [Online]. http://www.sciencedirect.com/science/article/pii/S1389128609003090

  25. T. Sridhar, Cloud computing: a primer part 1: models and technologies. Internet Protoc. J. 12(3), 2–19 (2009) [Online]. http://www.cisco.com/web/about/ac123/ac147/archived_issues/ipj_12-3/index.html

  26. L.J. Miller, The ISO reference model of open systems interconnection: a first tutorial, in Proceedings of the ACM ’81 conference, ser. ACM ’81. (ACM, New York, USA, 1981), pp. 283–288 [Online]. http://doi.acm.org/10.1145/800175.809901

  27. T. Shanley, Infiniband (Addison-Wesley Longman Publishing Co., Inc., Boston, 2002)

    Google Scholar 

  28. N.J. Boden, D. Cohen, R.E. Felderman, A.E. Kulawik, C.L. Seitz, J.N. Seizovic, W.-K. Su, Myrinet: A gigabit-per-second local area network. IEEE Micro. 15(1), 29–36 (1995) [Online]. http://dx.doi.org/10.1109/40.342015

    Google Scholar 

  29. V. Nagasamy, S. Rajan, P.R. Panda, Fibre channel protocol: formal specification and verification, in Sixth Annual Silicon Valley Networking Conference. SysTech Research, (Apr 1995) [Online]. http://www.csl.sri.com/papers/svnc95/

  30. IEEE Standard for Information Technology—Telecommunications and Information Exchange Between Systems—Local and Metropolitan Area Networks—Specific Requirements—Part 3: Carrier Sense Multiple Access With Collision Detection (CSMA/CD) Access Method and Physical Layer Specifications, LAN/MAN Standards Committee, New York, NY, USA, (2008) [Online]. http://standards.ieee.org/about/get/802/802.3.html

  31. M. Al-Fares, A. Loukissas, A. Vahdat, A scalable, commodity data center network architecture, in Proceedings of the ACM SIGCOMM 2008 Conference on Data communication, ser. SIGCOMM ’08. (ACM, New York, USA, 2008), pp. 63–74 [Online]. http://doi.acm.org/10.1145/1402958.1402967

  32. U. Hoelzle, L.A. Barroso, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 1st edn. (Morgan and Claypool Publishers, San Rafael, 2009)

    Google Scholar 

  33. J. Hamilton, On designing and deploying internet-scale services, in Proceedings of the 21st Conference on Large Installation System Administration Conference, ser. LISA’07. (USENIX Association, Berkeley, USA, 2007), pp. 18:1–18:12 [Online]. http://dl.acm.org/citation.cfm?id=1349426.1349444

  34. G. Regnier, S. Makineni, R. Illikkal, R. Iyer, D. Minturn, R. Huggahalli, D. Newell, L. Cline, A. Foong, TCP onloading for data center servers. Computer 37(11), 48–58 (2004) [Online]. http://dx.doi.org/10.1109/MC.2004.223

    Google Scholar 

  35. J. Postel, DoD standard Internet Protocol, RFC 760, Internet Engineering Task Force, Jan. 1980, obsoleted by RFC 791, updated by RFC 777 [Online]. http://www.ietf.org/rfc/rfc760.txt

  36. Transmission Control Protocol, RFC 793 (Standard), Internet Engineering Task Force, Sep. 1981, updated by RFCs 1122, 3168, 6093, 6528 [Online]. http://www.ietf.org/rfc/rfc793.txt

  37. N. Jani, K. Kant, SCTP Performance in Data Center Environments, in Proceedings of the 2005 International Symposium on Performance Evaluation of Computer and, Telecommunication Systems (SPECTS’05) (2005)

    Google Scholar 

  38. V. Jacobson, R. Braden, D. Borman, TCP Extensions for High Performance. RFC 1323 (Proposed Standard), Internet Engineering Task Force, May 1992 [Online]. http://www.ietf.org/rfc/rfc1323.txt

  39. L.S. Brakmo, S.W. O’Malley, L.L. Peterson, TCP Vegas: new techniques for congestion detection and avoidance, in Proceedings of the conference on Communications architectures, protocols and applications, ser. SIGCOMM ’94. (ACM, New York, USA, 1994), pp. 24–35 [Online]. http://doi.acm.org/10.1145/190314.190317

  40. T. Kelly, Scalable TCP: improving performance in highspeed wide area networks. SIGCOMM Comput. Commun. Rev. 33(2), 83–91 (2003) [Online]. http://doi.acm.org/10.1145/956981.956989

  41. D.X. Wei, C. Jin, S.H. Low, S. Hegde, FAST TCP: motivation, architecture, algorithms, performance. IEEE/ACM Trans. Netw. 14(6), 1246–1259 (2006) [Online]. http://dx.doi.org/10.1109/TNET.2006.886335

  42. S. Ha, I. Rhee, L. Xu, CUBIC: a new TCP-friendly high-speed TCP variant. SIGOPS Oper. Syst. Rev. 42(5), 64–74 (2008) [Online]. http://doi.acm.org/10.1145/1400097.1400105

  43. S. Floyd, HighSpeed TCP for Large Congestion Windows. RFC 3649 (Experimental), Internet Engineering Task Force (Dec. 2003) [Online]. http://www.ietf.org/rfc/rfc3649.txt

  44. L. Xu, K. Harfoush, I. Rhee, Binary Increase Congestion Control (BIC) for fast long-distance networks, in IEEE Infocom. IEEE (2004) [Online]. http://www.ieee-infocom.org/2004/Papers/52_4.PDF

  45. ATM Forum Inc., ATM User Network Interface (UNI) Specification Version 3.1, 1st edn. (Prentice Hall, Upper Saddle River, New Jersy, 1995)

    Google Scholar 

  46. M. Perloff, K. Reiss, Improvements to TCP performance in high-speed ATM networks. Commun. ACM 38(2), 91–100 (1995) [Online]. http://doi.acm.org/10.1145/204826.204849

  47. A. Romanow, S. Floyd, Dynamics of TCP traffic over ATM networks, in Proceedings of the Conference on Communications Architectures, Protocols and Applications, ser. SIGCOMM ’94. (ACM, New York, USA, 1994), pp. 79–88 [Online]. http://doi.acm.org/10.1145/190314.190322

  48. H. Balakrishnan, S. Seshan, E. Amir, R.H. Katz, Improving TCP/IP performance over wireless networks, in Proceedings of the 1st Annual International Conference on Mobile Computing and Networking, ser. MobiCom ’95. (ACM, New York, USA, 1995), pp. 2–11 [Online]. http://doi.acm.org/10.1145/215530.215544

  49. S.R. Cho, H. Sirisena, K. Pawlikowski, An end-to-end freeze TCP with timestamps for ad hoc networks, in ICC 2005, 40th IEEE International Conference on Communications ed. by B.G. Lee. IEEE Communications Society (Piscataway, NJ, USA, May 2005), pp. 3576–3582 [Online]. http://dx.doi.org/10.1109/ICC.2005.1495084

  50. S.E. Kim, J.A. Copeland, TCP for seamless vertical handoff in hybrid mobile data networks, in Global Telecommunications Conference, 2003. GLOBECOM ’03. IEEE, vol. 2 (2003), pp. 661–665 [Online]. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1258321

  51. K. Brown, S. Singh, M-TCP: TCP for mobile cellular networks. SIGCOMM Comput. Commun. Rev. 27(5), 19–43 (1997) [Online]. http://doi.acm.org/10.1145/269790.269794

  52. S.H. Lee, H.G. Ahn, J.S. Lim, S.H. Kwak, S. Kim, Performance analysis of snoop TCP with freezing agent over cdma2000 networks, in Proceedings of the 7th CDMA International Conference on Mobile Communications, ser. CIC’02. (Springer-Verlag, Berlin, Heidelberg 2003), pp. 496–505 [Online]. http://dl.acm.org/citation.cfm?id=1766911.1766973

  53. E. Hossain, N. Parvez, Enhancing TCP performance in wide-area cellular wireless networks: transport level approaches, in Wireless Communications Systems and Networks, ed. by M. Guizani (Plenum Press, New York, USA, 2004), pp. 241–289 [Online]. http://dl.acm.org/citation.cfm?id=1016648.1016658

  54. J. Liu, S. Singh, ATCP: TCP for mobile ad hoc networks. IEEE J. Sel. Areas Commun. 19(7), 1300–1315 (2002) [Online]. http://dx.doi.org/10.1109/49.932698

  55. I.F. Akyildiz, G. Morabito, S. Palazzo, TCP-Peach: a new congestion control scheme for satellite IP networks. IEEE/ACM Trans. Netw. 9(3), 307–321 (2001) [Online]. http://dx.doi.org/10.1109/90.929853

  56. C.P. Fu, S.C. Liew, TCP Veno: TCP enhancement for transmission over wireless access networks. IEEE J. Sel. A. Commun. 21(2), 216–228 (2006) [Online]. http://dx.doi.org/10.1109/JSAC.2002.807336

    Google Scholar 

  57. K. Xu, Y. Tian, N. Ansari, TCP-Jersey for wireless IP communications. IEEE J. Sel. A. Commun. 22(4), 747–756 (2006) [Online]. http://dx.doi.org/10.1109/JSAC.2004.825989

    Google Scholar 

  58. E. H.-K. Wu, M.-Z. Chen, JTCP: jitter-based TCP for heterogeneous wireless networks. IEEE J. Sel. A. Commun. 22(4), 757–766 (2006) [Online]. http://dx.doi.org/10.1109/JSAC.2004.825999

    Google Scholar 

  59. Y. Chen, R. Griffith, J. Liu, R.H. Katz, A.D. Joseph, Understanding TCP incast throughput collapse in datacenter networks, in Proceedings of the 1st ACM Workshop on Research on Enterprise Networking, ser. WREN ’09. (ACM, New York, USA, 2009), pp. 73–82 [Online]. http://doi.acm.org/10.1145/1592681.1592693

  60. D. Nagle, D. Serenyi, A. Matthews, The Panasas activescale storage cluster: delivering scalable high bandwidth storage, in Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, ser. SC ’04. (IEEE Computer Society, Washington, DC, USA, 2004), p. 53 [Online]. http://dx.doi.org/10.1109/SC.2004.57

  61. A. Phanishayee, E. Krevat, V. Vasudevan, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, Measurement and analysis of TCP throughput collapse in cluster-based storage systems, in Proceedings of the 6th USENIX Conference on File and Storage Technologies, ser. FAST’08. (USENIX Association, Berkeley, CA, USA, 2008), pp. 12:1–12:14 [Online]. http://dl.acm.org/citation.cfm?id=1364813.1364825

  62. E. Krevat, V. Vasudevan, A. Phanishayee, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems, in Proceedings of the 2nd International Workshop on Petascale Data Storage: Held in Conjunction with Supercomputing ’07, ser. PDSW ’07. (ACM, New York, USA, 2007), pp. 1–4 [Online]. http://doi.acm.org/10.1145/1374596.1374598

  63. S. Kulkarni, P. Agrawal, A Probabilistic Approach to Address TCP Incast in Data Center Networks, in Proceedings of the 2011 31st International Conference on Distributed Computing Systems Workshops, ser. ICDCSW ’11. (IEEE Computer Society, Washington, DC, USA, 2011), pp. 26–33 [Online]. http://dx.doi.org/10.1109/ICDCSW.2011.41

  64. S. Ghemawat, H. Gobioff, S.-T. Leung, The Google file system. SIGOPS Oper. Syst. Rev. 37(5), 29–43 (2003) [Online]. http://doi.acm.org/10.1145/1165389.945450

  65. R.Y. Wang, T.E. Anderson, xFS: A Wide Area Mass Storage File System (University of California at Berkeley, Berkeley, CA, USA, Technical Report, 1993)

    Google Scholar 

  66. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, W. Vogels, Dynamo: Amazon’s highly available key-value store, in Proceedings of Twenty-first ACM SIGOPS Symposium on Operating Systems Principles, ser. SOSP ’07. (ACM, New York, USA, 2007), pp. 205–220 [Online]. http://doi.acm.org/10.1145/1294261.1294281

  67. F. Schmuck, R. Haskin, GPFS: A shared-disk file system for large computing clusters, in Proceedings of the 1st USENIX Conference on File and Storage Technologies, ser. FAST ’02. (USENIX Association, Berkeley, CA, USA, 2002) [Online]. http://dl.acm.org/citation.cfm?id=1083323.1083349

  68. S. Chakrabarti, M. van den Berg, B. Dom, Focused crawling: a new approach to topic-specific web resource discovery, in Proceedings of the Eighth International Conference on World Wide Web, ser. WWW ’99. (Elsevier North-Holland, Inc., New York, USA, 1999), pp. 1623–1640 [Online]. http://dl.acm.org/citation.cfm?id=313234.313121

  69. J. Cho, H. Garcia-Molina, Parallel crawlers, in Proceedings of the 11th International Conference on World Wide Web, ser. WWW ’02. (ACM, New York, USA, 2002), pp. 124–135 [Online]. http://doi.acm.org/10.1145/511446.511464

  70. J. Luo, Z. Shi, Eliminate redundancy in parallel search: a multi-agent coordination approach, in Proceedings of the 9th Pacific Rim International Conference on Artificial Intelligence, ser. PRICAI’06. (Springer-Verlag, Berlin, Heidelberg, 2006), pp. 91–100 [Online]. http://dl.acm.org/citation.cfm?id=1757898.1757912

  71. M.D. Dikaiakos, A. Katsifodimos, G. Pallis, Minersoft: Software retrieval in grid and cloud computing infrastructures. ACM Trans. Internet Technol. 12(1), 2:1–2:34 (2012) [Online]. http://doi.acm.org/10.1145/2220352.2220354

  72. J. Dean, S. Ghemawat, MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008) [Online]. http://doi.acm.org/10.1145/1327452.1327492

  73. K. Shvachko, H. Kuang, S. Radia, R. Chansler, The Hadoop distributed file system, in Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), ser. MSST ’10. (IEEE Computer Society, Washington, DC, USA, 2010), pp. 1–10 [Online]. http://dx.doi.org/10.1109/MSST.2010.5496972

  74. V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D.G. Andersen, G.R. Ganger, G.A. Gibson, B. Mueller, Safe and effective fine-grained TCP retransmissions for datacenter communication, in Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication, ser. SIGCOMM ’09. (ACM, New York, USA, 2009), pp. 303–314 [Online]. http://doi.acm.org/10.1145/1592568.1592604

  75. M. Alizadeh, A. Greenberg, D.A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, M. Sridharan, Data center TCP (DCTCP), in Proceedings of the ACM SIGCOMM 2010 Conference, ser. SIGCOMM ’10. (ACM, New York, USA, 2010), pp. 63–74 [Online]. http://doi.acm.org/10.1145/1851182.1851192

Download references

Author information

Authors and Affiliations

  1. Electrical and Computer Engineering, Auburn University, Auburn, AL, USA

    Santosh Kulkarni

  2. Auburn University, Auburn, AL, USA

    Prathima Agrawal

Authors
  1. Santosh Kulkarni
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Prathima Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Santosh Kulkarni .

Rights and permissions

Reprints and permissions

Copyright information

© 2014 The Author(s)

About this chapter

Cite this chapter

Kulkarni, S., Agrawal, P. (2014). Introduction. In: Analysis of TCP Performance in Data Center Networks. SpringerBriefs in Electrical and Computer Engineering. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7861-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-7861-4_1

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-7860-7

  • Online ISBN: 978-1-4614-7861-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation