Abstract
Cryptomarkets are commercial websites on the web that operate via darknet, a portion of the Internet that limits the ability to trace users’ identity. Cryptomarkets have facilitated illicit product trading and transformed the methods used for illicit product transactions. The survellience and understanding of cryptomarkets is critical for law enforcement and public health. In this paper, we design and implement Python scrapers for scraping cryptomarkets. The design of the scraper system is described with details and the source code of the scrapers is shared with the public.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Martin, J.: Drugs on the Dark Net: How Cryptomarkets are Transforming the Global Trade in Illicit Drugs (2014)
Aldridge, J., Décary-Hétu, D.: Not an ‘Ebay for Drugs’: the Cryptomarket ‘Silk Road’ as aparadigm shifting criminal innovation. Available at SSRN 2436643 (2014)
Christin, N.: Traveling the silk road: a measurement analysis of a large anonymous online marketplace. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 213–224. ACM (2013)
EMCDDA: Europol: DarkNet markets ecosystem – lifetimes and reasons for closure of over 100 global darknet markets offering drugs, sorted by date (2018)
European Monitoring Centre for Drugs and Drug Addiction and Europol: Drugs and the DarkNet: perspectives for enforcement, research and policy (2017)
DarkNet Market Archives (2013–2015). https://www.gwern.net/DNM-archives. Accessed 12 Feb 2019
Lawrence, H., Hughes, A., Tonic, R., Zou, C.: D-miner: a framework for mining, searching, visualizing, and alerting on darknet events. In: 2017 IEEE Conference on Communications and Network Security (CNS), pp. 1–9. IEEE (2017)
Hayes, D., Cappa, F., Cardon, J.: A framework for more effective dark web marketplace investigations. Information 9(8), 186 (2018)
Tor Relay Configurator. https://tor-relay.co/. Accessed 15 Feb 2019
Tor Good Bad ISPs. https://trac.torproject.org/projects/tor/wiki/doc/GoodBadISPs. Accessed 15 Feb 2019
Tor Relay Guide. https://trac.torproject.org/projects/tor/wiki/TorRelayGuide. Accessed 15 Feb 2019
Tor Manual. https://www.torproject.org/docs/tor-manual.html.en. Accessed 15 Feb 2019
Tor Relay Search. https://metrics.torproject.org/rs.html. Accessed 15 Feb 2019
Check Tor Connection. https://check.torproject.org. Accessed 15 Feb 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, Y. et al. (2019). Python Scrapers for Scraping Cryptomarkets on Tor. In: Wang, G., Feng, J., Bhuiyan, M., Lu, R. (eds) Security, Privacy, and Anonymity in Computation, Communication, and Storage. SpaCCS 2019. Lecture Notes in Computer Science(), vol 11611. Springer, Cham. https://doi.org/10.1007/978-3-030-24907-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-24907-6_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-24906-9
Online ISBN: 978-3-030-24907-6
eBook Packages: Computer ScienceComputer Science (R0)