Abstract
Providing detailed, accurate, and consistent network measurements is essential to running a service provider network, both for planning, engineering and troubleshooting the network, and for verifying that network performance meets targets that are set by the provider and agreed with its customers. The speed and scale of networks, coupled with increasing need for active and passive measurements differentiated by customer, service class, and network elements, present challenges for providers in deploying and operating the measurement infrastructure. This chapter reviews a spectrum of methods, practices, and standards for the acquisition, management, and interpretation of network measurements.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adams, A., Bu, T., Caceres, R., Duffield, N., Friedman, T., Horowitz, J., Lo Presti, F., Moon, S. B., Paxson, V., & Towsley. D. (2000). The use of end-to-end multicast measurements for characterizing internal network behavior. IEEE Communications Magazine, May 2000, 38(5), 152–159.
Almes, G., Kalidindi, S., & Zekauskas, M. (1999). A one-way delay metric for IPPM. RFC 2679, September 1999.
Almes, G., Kalidindi, S., & Zekauskas, M. (1999). A one-way packet loss metric for IPPM. RFC 2680, September 1999.
Alon, N., Duffield, N., Lund, C., & Thorup, M. (2005). Estimating arbitrary subset sums with few probes. In Proceedings of 24th ACM Symposium on Principles of Database Systems (PODS) (pp. 317–325). Baltimore, MD, June 13–16, 2005.
AT&T Labs. Application traffic analyzer. http://www.research.att.com/viewProject.cfm?prjID=125.
Bradner, S. (1991). Benchmarking terminology for network interconnection devices. RFC 1242, July 1991.
Breslau, L., Chase, C., Duffield, N., Fenner, B., Mao, Y., & Sen, S. (2006). Vmscope: a virtual multicast vpn performance monitor. In INM ’06: Proceedings of the 2006 SIGCOMM Workshop on Internet Network Management (pp. 59–64). New York, NY, USA: ACM.
Burch, H., & Chase, C. (2005). Monitoring link delays with one measurement host. SIGMETRICS Performance Evaluation Review, 33(3):10–17.
CAIDA. The CAIDA anonymized 2009 internet traces dataset. http://www.caida.org/data/passive/passive_2009_dataset.xml.
CAIDA. cflowd: Traffic flow analysis tool. http://www.caida.org/tools/measurement/cflowd/.
Castro, R., Coates, M., Liang, G., Nowak, R., & Yu, B. (2004). Network tomography: recent developments. Statistical Science, 19, 499–517.
Chimento, P., & Ishac, J. (2008). Defining network capacity. RFC 5136, February 2008.
Ciavattone, L., Morton, A., & Ramachandran, G. (2003). Standardized active measurements on a tier 1 IP backbone. IEEE Communications Magazine, pp. 90–97, June 2003.
Cisco Systems. Cisco IOS Flexible NetFlow. http://www.cisco.com/web/go/fnf.
Cisco Systems. Cisco NetFlow Collector Engine. http://www.cisco.com/en/US/products/sw/netmgtsw/ps1964/.
Cisco Systems. Delivering the next generation data center. http://www.cisco.com/en/US/products/ps9402/.
Cisco Systems. IOS switching services configuration guide. http://www.cisco.com/en/US/docs/ios/12_1/switch/configuration/guide/xc%dipsp.html.
Cisco Systems. NetFlow. http://www.cisco.com/warp/public/732/netflow/index.html.
Cisco Systems. Optimizing application traffic with cisco service control technology. http://www.cisco.com/go/servicecontrol.
Cisco Systems. Performance Routing. http://www.cisco.com/web/go/pfr/.
Cisco Systems. Random Sampled NetFlow. http://www.cisco.com/en/US/docs/ios/12_0s/feature/guide/nfstatsa.html.
Claffy, K. C., Braun, H.-W., & Polyzos, G. C. (1995). Parameterizable methodology for internet traffic flow profiling. IEEE Journal on Selected Areas in Communications, 13(8), 1481–1494, October 1995.
Claise, B. (2004). Cisco Systems NetFlow Services Export Version 9. RFC 3954, October 2004.
Claise, B., Johnson, A., & Quittek, J. (2009). Packet sampling (psamp) protocol specifications. RFC 5476, March 2009.
Claise, B., & Wolter, R. (2007). Network management: accounting and performance strategies. Cisco.
Cohen, E., Duffield, N., Lund, C., & Thorup, M. (2008). Confident estimation for multistage measurement sampling and aggregation. In ACM SIGMETRICS. June 2–6, 2008, Maryland, USA: Annapolis.
Cohen, E., Duffield, N. G., Kaplan, H., Lund, C.,& Thorup, M. (2007). Algorithms and estimators for accurate summarization of internet traffic. In IMC ’07: Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (pp. 265–278). New York, NY, USA: ACM.
Cranor, C., Johnson, T., Spataschek, O., & Shkapenyuk, V., (2003). Gigascope: a stream database for network applications. In SIGMOD ’03: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data (pp. 647–651). New York, NY, USA: ACM.
Crovella, M., & Krishnamurthy, B. (2006). Internet measurement: infrastructure, traffic and applications. New York, NY: Wiley.
Dasu, T., & Johnson, T. (2003). Exploratory data mining and data cleaning. New York, NY, USA: Wiley.
Demichelis, C., & Chimento, P. (2002). Ip packet delay variation metric for ip performance metrics (ippm). RFC 3393, November 2002.
Dietz, T., Claise, B., Aitken, P., Dressler, F., & Carle, G. (2009). Information model for packet sampling export. RFC 5477, March 2009.
Duffield, N.G., Claise, B., Chiou, D., Greenberg, A., Grossglauser, M., & Rexford, J. (2009). A framework for packet selection and reporting. RFC 5474, March 2009.
Duffield, N.G., Gerber, A., & Grossglauser, M. (2002). Trajectory engine: A backend for trajectory sampling. In IEEE Network Operations and Management Symposium (NOMS) 2002. Florence, Italy, 15–19 April 2002.
Duffield, N.G., Lund, C., & Thorup, M. (2001). Charging from sampled network usage. In Proceedings of 1st ACM SIGCOMM Internet Measurement Workshop (IMW) (pp. 245–256). San Francisco, CA, November 1–2, 2001.
Duffield, N.G., Lund, C., & Thorup, M. (2005). Learn more, sample less: control of volume and variance in network measurements. IEEE Transactions on Information Theory, 51(5), 1756–1775.
Duffield, N.G., Lund, C., & Thorup, M. (2007). Priority sampling for estimation of arbitrary subset sums. Journal of ACM, 54(6), Article 32, December 2007. Announced at SIGMETRICS’04.
Duffield, N., & Grossglauser, M. (2001). Trajectory sampling for direct traffic observation. IEEE/ACM Transactions on Networking, 9(3), 280–292, June 2001.
Duffield, N., & Lund, C. (2003). Predicting resource usage and estimation accuracy in an IP flow measurement collection infrastructure. In Proceedings of Internet Measurement Conference. Miami, FL, October 27–29, 2003.
Estan, C., Keys, K., Moore, D., & Varghese, G. (2004). Building a better netflow. In Proceedings of the ACM SIGCOMM 04. New York, NY, 12–16 June 2004.
Estan, C., & Varghese, G. (2002). New directions in traffic measurement and accounting. In Proceedings of ACM SIGCOMM ’2002. Pittsburgh, PA, August 2002.
Feldmann, A., Rexford, J., & Cáceres, R. (1998). Efficient policies for carrying web traffic over flow-switched networks. IEEE/ACM Transactions on Networking, 6(6), 673–685, December 1998.
Goldberg, S., & Rexford, J. (2007). Security vulnerabilities and solutions for packet sampling. In IEEE Sarnoff Symposium. Princeton, NJ, May 2007.
Greer, R. (1999). Daytona and the fourth-generation language cymbal. In SIGMOD ’99: Proceedings of the 1999 ACM SIGMOD International Conference on Management of Data (pp. 525–526). New York, NY, USA: ACM.
Hao, F., Kodialam, M., & Lakshman, T.V. (2004). Accel-rate: a faster mechanism for memory efficient per-flow traffic estimation. In SIGMETRICS ’04/Performance ’04: Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems (pp. 155–166). New York, NY, USA: ACM.
Hedayat, K., Krzanowski, R., Morton, A., Yum, K., & Babiarz, J. (2008). A two-way active measurement protocol (twamp). RFC 5357, October 2008.
Horvitz, D. G., & Thompson, D. J. (1952). A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47(260), 663–685.
Huang, Y., Feamster, N., & Teixeira, R. (2008). Practical issues with using network tomography for fault diagnosis. SIGCOMM Computer Communication Review, 38(5), 53–58.
IETF. IP Flow Information Export (ipfix) charter. http://www.ietf.org/html.charters/ipfix-charter.html. Version of 16 December 2008.
Internet Assigned Numbers Authority. Port numbers. http://www.iana.org/assignments/port- numbers.
ITU-T Recommendation Y.1540. Network performance objectives for IP-based services, February 2006.
Jacobson, V., Leres, C., & McCanne, S. tcpdump.
Jacobson V. Traceroute. ftp://ftp.ee.lbl.gov/traceroute.tar.gz.
Jain, R., & Routhier, S. (1986). Packet trains – measurements and a new model for computer network traffic. IEEE Journal on Selected Areas in Communications, 4(6), 986–995, September 1986.
Juniper Networks. Junose 8.2.x ip services configuration guide: Configuring j-flow statistics. http://www.juniper.net/techpubs/software/erx/junose82/swconfig-ip-servi%ces/html/ip-jflow-stats-config.html.
Kent, S., & Atkinson, R. (1998). Security architecture for the Internet Protocol. RFC 2401, November 1998.
Keynote Systems. http://www.keynote.com.
Mathis, M., & Mahdavi, J. (1996). Diagnosing internet congestion with a transport layer performance tool. In Proceedings of INET 96. Montreal, Quebec, 24–28 June 1996.
McCloghrie, K., & Kastenholz, F. The interfaces group mib. RFC 2863, June 2000.
McCloghrie, K., & Rose, M. (1991). Management Information Base for Network Management of TCP/IP-based internets: MIB-II. RFC 1213, available from http://www.ietf.org/rfc, March 1991.
MeasurementLab. http://www.measurementlab.net/.
Mills, C., Hirsh, D.,& Ruth, D. (1991). Internet accounting: background. RFC 1272, November 1991.
Greg Minshall. tcpdpriv. http://ita.ee.lbl.gov/html/contrib/tcpdpriv.html.
Moore, D., Paxson, V., Savage, S., Shannon, C., Staniford, S., & Weaver, N. (2003). Inside the slammer worm. IEEE Security and Privacy, 1(4), 33–39.
Morton, A. (2008). Framework for metric composition, June 2009. draft-ietf-ippm-framework-compagg-08 (work in progress).
Morton, A., & Claise, B. (2009). Packet delay variation applicability statement. RFC 5481, March 2009.
Morton, A., & Stephan, E. (2008). Spatial composition of metrics, October 2009. draft-ietf-ippm-spatial-composition-10 (work in progress).
Narus, Inc. Narusinsight secure suite. http://www.narus.com/products/security.html.
Packetdesign. Traffic explorer. http://www.packetdesign.com/products/tex.htm.
Paxson, V., Almes, G., Mahdavi, J., & Mathis, M. (1998). Framework for ip performance metrics. RFC 2330, May 1998.
Phaal, P., Panchen, S., & McKee, N. (2001). Inmon corporation’s sflow: A method for monitoring traffic in switched and routed networks. RFC 3176, September 2001. http://www.ietf.org/rfc/rfc3176.txt.
Raisanen, V., Grotefeld, G., & Morton, A. (2002). Network performance measurement with periodic streams. RFC 3432, November 2002.
RIPE. http://www.ripe.net.
Roesch, M. (1999). Snort – Lightweight Intrusion Detection for Networks. In Proceedings of USENIX Lisa ’99, Seattle, WA, November 1999.
Sandvine. http://www.sandvine.com/.
Srinivasan, C., Viswanathan, A., & Nadeau, T. (2004). Multiprotocol label switching (MPLS) label switching router (LSR) management information base (MIB). RFC 3813, June 2004.
Stallings, W. (1999). SNMP, SNMP v2, SNMP v3, and RMON 1 and 2 (Third Edition). Reading, MA: Addison-Wesley.
Stewart, R., Ramalho, M., Xie, Q., Tuexen, M., & Conrad, P. (2004). Stream control transmission protocol (sctp) partial reliability extension. RFC3758, May 2004.
Thorup, M. (2006). Confidence intervals for priority sampling. In Proceedings of ACM SIGMETRICS/Performance 2006 (pp. 252–263) Saint-Malo, France, 26–30 June 2006.
van der Merwe J., Cáceres, R., Chu, Y.-H., & Sreenan, C. (2000). mmdump: a tool for monitoring internet multimedia traffic. SIGCOMM Computer Commununication Review, 30(5), 48–59.
Waldbusser, S. (2000). Remote network monitoring management information base. RFC 2819, available from http://www.ietf.org/rfc, May 2000.
Zseby, T., Molina, M., Duffield, N.G., Niccolini, S., & Raspall, F. (2009). Sampling and filtering techniques for ip packet selection. RFC 5475, March 2009.
Zseby, T., Zander, S., & Carle, G. (2001). Evaluation of building blocks for passive one-way-delay measurements. In Proceedings of Passive and Active Measurement Workshop (PAM 2001). Amsterdam, The Netherlands, 23–24 April 2001.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag London
About this chapter
Cite this chapter
Duffield, N., Morton, A. (2010). Measurements of Data Plane Reliability and Performance. In: Kalmanek, C., Misra, S., Yang, Y. (eds) Guide to Reliable Internet Services and Applications. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-1-84882-828-5_10
Download citation
DOI: https://doi.org/10.1007/978-1-84882-828-5_10
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-827-8
Online ISBN: 978-1-84882-828-5
eBook Packages: Computer ScienceComputer Science (R0)