Abstract
Looking glasses (LG) servers enhance our visibility into Internet connectivity and performance by offering a set of distributed vantage points that allow both data plane and control plane measurements. However, the lack of input and output standardization and limitations in querying frequency have hindered the development of automated measurement tools that would allow systematic use of LGs. In this paper we introduce Periscope, a publicly-accessible overlay that unifies LGs into a single platform and automates the discovery and use of LG capabilities. The system architecture combines crowd-sourced and cloud-hosted querying mechanisms to automate and scale the available querying resources. Periscope can handle large bursts of requests, with an intelligent controller coordinating multiple concurrent user queries without violating the various LG querying rate limitations. As of December 2015 Periscope has automatically extracted 1,691 LG nodes in 297 Autonomous Systems. We show that Periscope significantly extends our view of Internet topology obtained through RIPE Atlas and CAIDA’s Ark, while the combination of traceroute and BGP measurements allows more sophisticated measurement studies.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
A user requests access through email describing the intended use and we issue a unique security token which he/she uses to sign measurement requests.
- 2.
Although most requests can be satisfied with simple HTTP requests, Selenium allows easier handling of HTTP sessions and cookies.
- 3.
We derived empirically conservative values for the timeout and number of slots for each LG.
References
CAIDA Archipelago (Ark). http://www.caida.org/projects/ark/
Kewlio Looking Glass. http://sourceforge.net/projects/klg/
Multi-Router Looking Glass. http://mrlg.op-sec.us/
Netacuity. http://www.digitalelement.com/solutions/
PeeringDB. http://www.peeringdb.com
RANCID Loooking Glass. http://www.shrubbery.net/rancid/
RIPE Atlas. https://atlas.ripe.net/
RIPE Atlas rate limits. https://atlas.ripe.net/docs/udm/#rate-limits
Selenium browser automation suite. http://www.seleniumhq.org/
Stripes Looking Glass. https://www.gw.com/sw/stripes/
Telephone Looking Glass. https://github.com/telephone/LookingGlass
Version6 Loooking Glass. https://github.com/Cougar/lg
Achlioptas, D., Clauset, A., Kempe, D., Moore, C.: On the bias of traceroute sampling: or, power-law degree distributions in regular graphs. In: STOC (2005)
Augustin, B., Krishnamurthy, B., Willinger, W.: IXPs: mapped?. In: IMC 2009 (2009)
Bruno, L., Graziano, M., Balzarotti, D., Francillon, A.: Through the looking-glass, and what eve found there. In: WOOT (2014)
Cohen, R., Raz, D.: The internet dark matter - on the missing links in the AS connectivity map. In: IEEE INFOCOM 2006, April 2006
Donnet, B., Bonaventure, O.: On BGP communities. SIGCOMM Comput. Commun. Rev. 38(2), 55–59 (2008)
Giotsas, V., Zhou, S., Luckie, M., Claffy, K.: Inferring multilateral peering. In: CoNEXT 2013 (2013)
He, Y., Siganos, G., Faloutsos, M., Krishnamurthy, S.: Lord of the links: a framework for discovering missing links in the internet topology. IEEE/ACM Trans. Network. 17(2), 391–404 (2009)
Huffaker, B., Fomenkov, M., Claffy, K.: DRoP: DNS-based router positioning. SIGCOMM Comput. Commun. Rev. 44(3), 5–13 (2014)
Huffaker, B., Dhamdhere, A., Fomenkov, M., Claffy, K.: Toward topology dualism: improving the accuracy of AS annotations for routers. In: Krishnamurthy, A., Plattner, B. (eds.) PAM 2010. LNCS, vol. 6032, pp. 101–110. Springer, Heidelberg (2010)
Khan, A., Kwon, T., Kim, H.c., Choi, Y.: AS-level topology collection through looking glass servers. In: IMC 2013 (2013)
Luckie, M., Huffaker, B., Claffy, K., Dhamdhere, A., Giotsas, V.: AS relationships, customer cones, and validation. In: ACM IMC 2013 (2013)
Madhyastha, H.V., Isdal, T., Piatek, M., Dixon, C., Anderson, T., Krishnamurthy, A., Venkataramani, A.: iPlane: an information plane for distributed services. In: USENIX NSDI 2006 (2016)
Mao, Z.M., Rexford, J., Wang, J., Katz, R.H.: Towards an accurate AS-level traceroute tool. In: ACM SIGCOMM 2003 (2003)
Sánchez, M.A., Otto, J.S., Bischof, Z.S., Choffnes, D.R., Bustamante, F.E., Krishnamurthy, B., Willinger, W.: Dasu: pushing experiments to the internet’s edge. In: USENIX NSDI 2013, April 2013
Shavitt, Y., Shir, E.: DIMES: let the internet measure itself. SIGCOMM Comput. Commun. Rev. 35(5), 71–74 (2005)
Shi, X., Xiang, Y., Wang, Z., Yin, X., Wu, J.: Detecting prefix hijackings in the internet with argus. In: IMC 2012 (2012)
Zhang, B., Liu, R., Massey, D., Zhang, L.: Collecting the internet AS-level topology. ACM SIGCOMM CCR 35(1), 53–61 (2005)
Acknowledgements
The work was funded by the DHS Science and Technology Directorate, Cyber Security Division (DHS S&T/CSD) BAA 11-02 and SPAWAR Systems Center Pacific via contract N66001-12-C-0130, and by Defence R&D Canada (DRDC) pursuant to an Agreement between the U.S. and Canadian governments for Cooperation in Science and Technology for Critical Infrastructure Protection and Border Security. The work represents the position of the authors and not necessarily that of DHS or DRDC.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Giotsas, V., Dhamdhere, A., Claffy, K.C. (2016). Periscope: Unifying Looking Glass Querying. In: Karagiannis, T., Dimitropoulos, X. (eds) Passive and Active Measurement. PAM 2016. Lecture Notes in Computer Science(), vol 9631. Springer, Cham. https://doi.org/10.1007/978-3-319-30505-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-30505-9_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-30504-2
Online ISBN: 978-3-319-30505-9
eBook Packages: Computer ScienceComputer Science (R0)