Abstract
Researchers need current and historical measurements of Internet paths. We built and deployed a complete system designed to fill these needs: a safe, shareable, multi-user active network measurement system probes network paths and reliably records measurements in a storage facility with multiple levels of caching, providing users with fast, flexible querying. Our system, deployed on PlanetLab for over 20 months, has accumulated 940 million measurements and made them publicly available in a separate, federated data repository. Our experience shows that building and running such a valuable research tool poses significant engineering and practical challenges.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Andersen, D.G., Feamster, N.: Challenges and Opportunities in Internet Data Mining. Technical Report CMU–PDL–06–102, CMU Parallel Data Laboratory (January 2006), http://www.datapository.net/
Danalis, A., Dovrolis, C.: ANEMOS: An Autonomous Network Monitoring System. In: Proc. PAM, San Diego, CA (April 2003)
Jain, M., Dovrolis, C.: End-to-End Available Bandwidth: Measurement Methodology, Dynamics, and Relation with TCP Throughput. IEEE/ACM Trans. Networking 11(4), 537–549 (2003)
Krishnamurthy, B., Madhyastha, H.V., Spatscheck, O.: ATMEN: A Triggered Network Measurement Infrastructure. In: Proc. WWW (May 2005)
Lee, S.-J., et al.: Measuring Bandwidth Between PlanetLab Nodes. In: Proc. PAM (March–April 2005)
Park, K., Pai, V.: CoMon: A Mostly-Scalable Monitoring System for PlanetLab. OSR 40(1), 65–74 (2006)
Paxson, V., Mahdavi, J., Adams, A., Mathis, M.: An Architecture for Large-Scale Internet Measurement. IEEE Comm. 36(8), 48–54 (1998)
Peterson, L., Anderson, T., Culler, D., Roscoe, T.: A Blueprint for Introducing Disruptive Technology into the Internet. In: Proc. HotNets-I (October 2002)
Ribeiro, V., Riedi, R., Baraniuk, R., Navratil, J., Cottrell, L.: pathChirp: Efficient Available Bandwidth Estimation for Network Paths. In: Proc. PAM (April 2003)
Ricci, R., et al.: The Flexlab Approach to Realistic Evaluation of Networked Systems. In: Proc. NSDI (April 2007)
Sherwood, R., Spring, N.: A Platform for Unobtrusive Measurements on PlanetLab. In: Proc. of WORLDS 2006, Seattle, WA (November 2006)
Sommers, J., Barford, P.: An Active Measurement System for Shared Environments. In: Proc. IMC (October 2007)
Spring, N., Wetherall, D., Anderson, T.: Scriptroute: A Public Internet Measurement Facility. In: Proc. USITS (March 2003)
Webb, K., et al.: Implementing the Emulab-PlanetLab Portal: Experience and Lessons Learned. In: Proc. WORLDS (December 2004)
White, B., et al.: An Integrated Experimental Environment for Distributed Systems and Networks. In: Proc. OSDI (December 2002)
Yalagandula, P., et al.: S3: A Scalable Sensing Service for Monitoring Large Networked Systems. In: Proc. Workshop on Internet Network Mgmt (September 2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Johnson, D., Gebhardt, D., Lepreau, J. (2008). Towards a High Quality Path-Oriented Network Measurement and Storage System . In: Claypool, M., Uhlig, S. (eds) Passive and Active Network Measurement. PAM 2008. Lecture Notes in Computer Science, vol 4979. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79232-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-79232-1_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-79231-4
Online ISBN: 978-3-540-79232-1
eBook Packages: Computer ScienceComputer Science (R0)