Abstract
The need to service populations of high diversity in the face of high disparity affects all aspects of network operation: planning, routing, engineering, security, and accounting. We analyze diversity/disparity from the perspective of selecting a boundary between mice and elephants in IP traffic aggregated by route, e.g., destination AS. Our goal is to find a concise quantifier of size disparity for IP addresses, prefixes, policy atoms and ASes, similar to the oft-quoted 80/20 split (e.g., 80% of volume in 20% of sources). We define crossover as the fraction c of total volume contributed by a complementary fraction 1-c of large objects. Studying sources and sinks at two Tier 1 backbones and one university, we find that splits of 90/10 and 95/5 are common for IP traffic. We compare the crossover diversity to common analytic models for size distributions such as Pareto/Zipf. We find that AS traffic volumes (by byte) are top-heavy and can only be approximated by Pareto with α=0.5, and that empirical distributions are often close to Weibull with shape parameter 0.2–0.3. We also find that less than 20 ASes send or receive 50% of all traffic in both backbones’ samples, a disparity that can simplify traffic engineering. Our results are useful for developers of traffic models, generators and simulators, for router testers and operators of high-speed networks.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Shaikh, A.,Rexford, J., Shin, K.G.: Load-sensitive routing of long-lived IP flows. In: SIGCOMM (1999)
Claffy, K.C.: Internet traffic characterization. Ph.D. thesis, UCSD (1994)
Brownlee, N., Claffy, K.C.: Understanding Internet traffic streams: Dragonflies and Tortoises. In: IEEE Communications (2002)
Lan, K., Heidemann, J.: On the correlation of Internet flow characteristics. Report ISI-TR-574 (2003), www.isi.edu/trpublic/pubs/au-kclan.html
Papagiannaki, K., Taft, N., Diot, C.: Impact of flow dynamics of traffic engineering principles. In: INFOCOM (2004)
Graham, I., Pearson, M., Martens, J., Donnelly, S.: Dag - a cell capture board for ATM measurement systems (1997), wand.cs.waikato.ac.nz
Endace: Measurement Systems (2004), www.endace.com
Estan, C., Savage, S., Varghese, G.: Automatically inferring patterns of resource consumption in network traffic. In: SIGCOMM (2003)
Odlyzko, A.M.: Privacy, economics, and price discrimination on the Internet. In: ICEC ACM (2003)
Mahajan, R., Bellovin, S.M., Floyd, S., loannidis, J., Paxson, V., Shenker, S.: Controlling High Bandwidth Aggregates in the Network. In: CCR (2002)
Claffy, K.C., Braun, H.W., Polyzos, G.: A Parametrizable methodology for Internet traffic flow profiling. In: IEEE JSAC (1995)
Broido, A., Claffy, K.C.: Analysis of Route Views BGP data: policy atoms. In: Proceedings of NRDM, Santa Barbara (2001)
Moore, D., Keys, K., Koga, R., Lagache, E., Claffy, K.C.: CoralReef software suite as a tool for system and network administrators. In: Usenix LISA (2001)
Feamster, N., Borkenhagen, J., Rexford, J.: Guidelines for interdomain traffic engineering. In: CCR (2003)
Broido, A., E.Nemeth, Claffy, K.C.: Spectroscopy of private DNS update sources. In: WIAPP 2003 (2003)
Korn, G.A., Korn, T.M.: Mathematical handbook for scientists (1968)
Knott, R.: Fibonacci numbers and the golden section (2003), www.mcs.surrey.ac.uk/Personal/R.Knott/Fibonacci/fib.html
Crovella, M.E., Bestavros, A.: Self-similarity in World Wide Web traffic. Evidence and possible causes. In: IEEE/ACM Transactions on Networking (1997)
Simpson, W.: PPP in HDLC-like Framing. In: RFC1662 (1994)
Moore, D., Voelker, G., Savage, S.: Inferring Internet Denial-of-Service Activity. In: USENIX Security Symposium (2001)
Supplement: (2004), www.caida.org/analysis/workload/diversity
Broido, A., Nemeth, E., Claffy, K.C.: Internet expansion, refinement and churn (2002) ETT 13
Yule, G.U.: A mathematical theory of evolution. Phil. Trans. Roy. Soc. London Ser. B 213, 21–87 (1924)
Mitzenmacher, M.: A brief history of generative models for power law and lognormal distributions. In: Internet Mathematics (2003)
Broido, A., Claffy, K.C.: Analysis of routing and topology data (2001), www.caida.org/outreach/presentations/routingtopology2001/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Broido, A., Hyun, Y., Gao, R., claffy, k. (2004). Their Share: Diversity and Disparity in IP Traffic. In: Barakat, C., Pratt, I. (eds) Passive and Active Network Measurement. PAM 2004. Lecture Notes in Computer Science, vol 3015. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24668-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-24668-8_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21492-2
Online ISBN: 978-3-540-24668-8
eBook Packages: Springer Book Archive