Abstract
We propose a new high resolution – temporal and spatial – 10 Gbps Ethernet monitoring technique based on time-coherent congestion ‘heatmaps’, revealing (all) the queue occupancies at μs granularity. Notably, queues are sampled with a slightly modified version of the new commodity Ethernet hardware congestion management protocol, i.e., IEEE 802 Quantized Congestion Notification. Our technique is evaluated through high-accuracy Layer-2 simulations of a 10 Gbps datacenter Ethernet fabric. Early results reveal that our proposal enables the detection of ephemeral – yet consequential – events and transients essential for datacenter workload characterization: e.g., TCP Incast, Head-of-Line blocking and congestion trees, which may trigger within 10s of μs and were not directly detectable until now.
Chapter PDF
Similar content being viewed by others
References
Prisacari, B., et al.: Fast pattern-specific routing for fat tree networks. ACM TACO 10(4), 36:1–36:25 (2013)
Zhang, J., et al.: Modeling and understanding TCP incast in data center networks. In: IEEE INFOCOM, pp. 1377–1385 (2011)
Jurczyk, M., et al.: Phenomenon of higher order head-of-line blocking in multistage interconnection networks under nonuniform traffic patterns. IEICE Transactions on Information and Systems (Special Issue on Architectures, Algorithms and Networks for Massively Parallel Computing) 79(8), 1124–1129 (1996)
Pfister, G.F., et al.: Hot spot contention and combining in multistage interconnection networks. IEEE Transactions on Computers 100(10), 943–948 (1985)
Phaal, P., et al.: InMon corporation’s sFlow: A method for monitoring traffic in switched and routed networks. Technical report, RFC 3176 (2001)
Claise, B.: Cisco systems NetFlow services export version 9 (2004)
Case, J., et al.: A simple network management protocol (SNMP). In: Network Information Center, SRI International (1989)
IEEE: P802.1Qbb/D1.3 Virtual bridged local area networks - Amendment: Priority-based flow control. Technical report. IEEE (2010)
Mills, D., et al.: Network time protocol version 4: Protocol and algorithms specification (2010)
IEEE/ANSI: 1588 Standard for a precision clock synchronization protocol for networked measurement and control systems. Technical report, IEEE/ANSI (2008)
Kompella, R.R., et al.: Every microsecond counts: tracking fine-grain latencies with a lossy difference aggregator. In: ACM SIGCOMM CCR, vol. 39, pp. 255–266. ACM (2009)
Batraneanu, S., et al.: Operational model of the ATLAS TDAQ network. IEEE Transactions on Nuclear Science 55(2), 687–694 (2008)
Fisher, D., et al.: Using visualization to support network and application management in a data center. In: IEEE INM 2008, pp. 1–6 (2008)
Leiserson, C.E.: Fat-trees: universal networks for hardware-efficient supercomputing. IEEE Transactions on Computers 100(10), 892–901 (1985)
Petrini, F., et al.: Performance evaluation of the Quadrics interconnection network. Cluster Computing 6(2), 125–142 (2003)
Ohring, S.R., et al.: On generalized fat trees. In: Parallel Processing Symposium, pp. 37–44. IEEE (1995)
Dally, W., et al.: Principles and practices of interconnection networks. Morgan Kaufmann Publishers Inc., San Francisco (2003)
Minkenberg, C., et al.: Trace-driven co-simulation of high-performance computing systems using OMNeT++. In: SIMUTools 2009, p. 65 (2009)
Crisan, D., et al.: Short and Fat: TCP performance in CEE datacenter networks. In: HOTI 2011, pp. 43–50 (2011)
Gusat, M., et al.: R3C2: Reactive route and rate control for CEE. In: HOTI 2010, pp. 50–57 (2010)
Ferrari, P., et al.: Synchronization of the probes of a distributed instrument for real-time Ethernet networks. In: ISPCS 2007, pp. 33–40 (2007)
Correll, K.: et al.: Design considerations for software only implementations of the IEEE 1588 precision time protocol. In: Conference on IEEE 1588 Standard, vol. 1588, pp. 11–15 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Anghel, A., Birke, R., Gusat, M. (2014). Scalable High Resolution Traffic Heatmaps: Coherent Queue Visualization for Datacenters. In: Dainotti, A., Mahanti, A., Uhlig, S. (eds) Traffic Monitoring and Analysis. TMA 2014. Lecture Notes in Computer Science, vol 8406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54999-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-54999-1_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-54998-4
Online ISBN: 978-3-642-54999-1
eBook Packages: Computer ScienceComputer Science (R0)