Skip to main content

Data Retrieval for Small Spatial Regions in OpenStreetMap

  • Chapter
  • First Online:
OpenStreetMap in GIScience

Part of the book series: Lecture Notes in Geoinformation and Cartography ((LNGC))

Abstract

Using OpenStreetMap data usually means, firstly, filtering for thematic extracts. This can be done with the OpenStreetMap mirror database Overpass API (application programming interface). To do this efficiently, the database takes advantage of the assumption that data is often selected from a relatively small spatial region instead of randomly across the planet. The paper aims to investigate what design choices are required to be able to answer almost any geographic query whilst serving common use cases fast enough such that the services based on this database are fast on affordable and standard sized hardware. The usage patterns from the main instance of Overpass API on overpass-api.de are evaluated. These comprise more than 40 million requests from the years 2012 to 2013 coming from about 60 % of the global IPv4 (IP protocol version 4) space. Therefore it can be said for sure that the assumption that queries are spatially dense holds on a large share of all queries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Mapnik. github.com/mapnik/mapnik. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Maria DB (2014) code.launchpad.net/maria. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Main database usage policy. wiki.osm.org/wiki/API_usage_policy#Heavy_Users. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Minute diffs. planet.osm.org/replication/minute. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Mooney P, Corcoran P (2012) Characteristics of heavily edited objects in openstreetmap. Future Internet 4(1):285–305

    Article  Google Scholar 

  • MySQL. mysql.com. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Neis P, Zipf A (2012) Analyzing the contributor activity of a volunteered geographic information project—the case of OpenStreetMap. ISPRS Int J Geo-Information 1(2):146–165

    Article  Google Scholar 

  • Neis P, Zielstra D, Zipf A (2011) The street network evolution of crowdsourced maps: OpenStreetMap in germany 2007–2011. Future Internet 4(1):1–21

    Article  Google Scholar 

  • Olbricht R (2014) Overpass API. github.com/drolbr/Overpass-API. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • OpenStreetMap portal. openstreetmap.org. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Overpass API public instance. overpass-api.de. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Overpass Turbo. overpass-turbo.eu. Retrieved 2014-09-25 12:00:00 UTC

    Google Scholar 

  • Overpass API Munin stats. overpass-api.de/munin/de/overpass-api.de/index.html#disk. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Planet.osm. planet.osm.org/planet. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • PostGIS. postgis.net/source. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • PostgreSQL. postgresql.org. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Quinion B, Hoffmann S et al (2014) Nominatim. github.com/twain47/Nominatim. Retrieved 2014-05-05 04:00:00 UTC

    Google Scholar 

  • Ramm F (2013) Wer ist der Boss bei OpenStreetMap? Presented at the FOSSGIS 2013. Rapperswil, Switzerland

    Google Scholar 

  • Ramm F, Topf J, Chilton S (2010) OpenStreetMap: using and enhancing the free map of the world. Uit, Cambridge

    Google Scholar 

  • Ruemmler C, Wilkes J (1994) An introduction to disk drive modeling. IEEE Comput 27(3):17–29

    Article  Google Scholar 

  • Redmond E, Wilson JR, Carter J (2012) Seven databases in seven weeks: a guide to modern databases and the NoSQL movement. Oreilly and Associate Series. Pragmatic Bookshelf, Massachusetts

    Google Scholar 

  • Schmidt M (2013) Frauen in OpenStreetMap. Presented at the FOSSGIS 2013. Rapperswil, Switzerland

    Google Scholar 

  • Standard on cross origin resource sharing. www.w3.org/TR/cors/. Retrieved 2014-05-05 04:00:00 UTC

  • Topf J (2013) Das OpenStreetMap-Datenmodell. Presented at the FOSSGIS 2013. Rapperswil, Switzerland

    Google Scholar 

  • Wilcox M (2014) The second extended filesystem. http://lxr.linux.no/#linux+v2.6.29/Documentation/filesystems/ext2.txt. Retrieved 2014-05-05 04:00:00 UTC

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Roland M. Olbricht .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Olbricht, R.M. (2015). Data Retrieval for Small Spatial Regions in OpenStreetMap. In: Jokar Arsanjani, J., Zipf, A., Mooney, P., Helbich, M. (eds) OpenStreetMap in GIScience. Lecture Notes in Geoinformation and Cartography. Springer, Cham. https://doi.org/10.1007/978-3-319-14280-7_6

Download citation

Publish with us

Policies and ethics