Skip to main content
SpringerLink
Log in

Enabling High-Performance Internet-Wide Measurements on Windows

  • Conference paper
Passive and Active Measurement (PAM 2010)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 6032))

Included in the following conference series:

Abstract

This paper presents analysis of the Windows kernel network stack and designs a novel high-performance NDIS driver platform called IRLstack whose goal is to enable large-scale Internet measurements that require sending billions of packets and managing millions of outstanding connections on inexpensive commodity hardware available to any research lab. Our results show that with just 75% of one modern CPU core, IRLstack can saturate a gigabit link with SYN packets (i.e., 1.48M pps) and achieve 3.52 Gbps (i.e., 5.25 Mpps) with a quad-core CPU. IRLstack’s transmission performance exceeds that of Winsock by a factor of 92-174, batch-mode WinPcap by a factor of 4.7-6.7, and the latest optimized PF_RING/TNAPI Linux kernel by up to 30%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Benoit, D., Trudel, A.: World’s First Web Census. Intl. Journal of Web Information Systems 3(4), 378–389 (2007)

    Article  Google Scholar 

  2. Chang, H., Jamin, S., Willinger, W.: To Peer or not to Peer: Modeling the Evolution of the Internet’s AS-level Topology. In: Proc. IEEE INFOCOM (April 2006)

    Google Scholar 

  3. Dagon, D., Provos, N., Lee, C.P., Lee, W.: Corrupted DNS Resolution Paths: The Rise of a Malicious Resolution Authority. In: Proc. NDSS (February 2008)

    Google Scholar 

  4. Degioanni, L., Varenni, G.: Introducing Scalability in Network Measurement: Toward 10 Gbps with Commodity Hardware. In: Proc. ACM IMC, October 2004, pp. 233–238 (2004)

    Google Scholar 

  5. Deri, L., Fusco, F.: Exploiting Commodity Multicore Systems for Network Traffic Analysis (July 2009), http://ethereal.ntop.org/MulticorePacketCapture.pdf

  6. Heidemann, J., Pradkin, Y., Govindan, R., Papadopoulos, C., Bartlett, G., Bannister, J.: Census and Survey of the Visible Internet. In: Proc. ACM IMC, October 2008, pp. 169–182 (2008)

    Google Scholar 

  7. Lee, H.-T., Leonard, D., Wang, X., Loguinov, D.: IRLbot: Scaling to 6 Billion Pages and Beyond. In: Proc. WWW, April 2008, pp. 427–436 (2008)

    Google Scholar 

  8. Leonard, D., Loguinov, D.: Turbo King: Framework for Large-Scale Internet Delay Measurements. In: Proc. IEEE INFOCOM, April 2008, pp. 430–438 (2008)

    Google Scholar 

  9. WinPcap: The Windows Packet Capture Library, http://www.winpcap.org/

  10. Najork, M., Heydon, A.: High-Performance Web Crawling. Compaq Systems Research Center, Tech. Rep. 173 (September 2001), http://www.hpl.hp.com/techreports/Compaq-DEC/SRC-RR-173.pdf .

  11. Pryadkin, Y., Lindell, R., Bannister, J., Govindan, R.: An Empirical Evaluation of IP Address Space Occupancy. USC/ISI, Tech. Rep. ISI-TR-2004-598 (November 2004)

    Google Scholar 

  12. Schneider, F., Wallerich, J., Feldmann, A.: Packet Capture in 10-Gigabit Ethernet Environments Using Contemporary Commodity Hardware. In: Proc. PAM, April 2007, pp. 207–217 (2007)

    Google Scholar 

  13. Spring, N., Mahajan, R., Wetherall, D.: Measuring ISP Topologies with Rocketfuel. In: Proc. ACM SIGCOMM (August 2002)

    Google Scholar 

  14. Stutzbach, D., Rejaie, R.: Understanding Churn in Peer-to-Peer Networks. In: Proc. ACM IMC, October 2006, pp. 189–202 (2006)

    Google Scholar 

  15. Stutzbach, D., Rejaie, R., Duffield, N., Sen, S., Willinger, W.: On Unbiased Sampling for Unstructured Peer-to-Peer Networks. In: Proc. ACM IMC, April 2006, pp. 27–40 (2006)

    Google Scholar 

  16. The Official Google Blog, We knew the web was big (July 2008), http://googleblog.blogspot.com/2008/07/we-knew-web-was-big.html

  17. Wang, X., Yao, Z., Loguinov, D.: Residual-Based Estimation of Peer and Link Lifetimes in P2P Networks. IEEE/ACM Trans. Networking 17(3), 726–739 (2009)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Texas A&M University, College Station, TX 77843, USA

    Matt Smith & Dmitri Loguinov

Authors
  1. Matt Smith
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dmitri Loguinov
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Washington, 185 Stevens Way, Seattle, 98195, WA, USA

    Arvind Krishnamurthy

  2. Computer Engineering and Networks Laboratory (TIK), Swiss Federal Institute of Technology (ETH) Zurich, CH-8092, Zurich, Switzerland

    Bernhard Plattner

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Smith, M., Loguinov, D. (2010). Enabling High-Performance Internet-Wide Measurements on Windows. In: Krishnamurthy, A., Plattner, B. (eds) Passive and Active Measurement. PAM 2010. Lecture Notes in Computer Science, vol 6032. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12334-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12334-4_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12333-7

  • Online ISBN: 978-3-642-12334-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation