Skip to main content

Open Data Exposed

  • Chapter
  • First Online:
Open Data Exposed

Abstract

This book is about open data, i.e. data that does not have any barriers in the (re)use. Open data aims to optimize access, sharing and using data from a technical, legal, financial, and intellectual perspective. Data increasingly determines the way people live their lives today. Nowadays, we cannot imagine a life without real-time traffic information about our route to work, information of the daily news or information about the local weather. At the same time, citizens themselves now are constantly generating and sharing data and information via many different devices and social media systems. Especially for governments, collection, management, exchange, and use of data and information have always been key tasks, since data is both the primary input to and output of government activities. Also for businesses, non-profit organizations, researchers and various other actors, data and information are essential.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    IBM 2016; SINTEF 2013.

  2. 2.

    Jacobson 2013.

  3. 3.

    A Zettabyte equals 1 billion Terabytes. A Terabyte equals 1000 Gigabytes.

  4. 4.

    Karr 2012; see also DOMO 2017.

  5. 5.

    Janssen 2011.

  6. 6.

    Mulcahy 2017.

  7. 7.

    See Montargil and Santos 2017.

  8. 8.

    See Kelly 2012.

  9. 9.

    See also Castells and Himanen 2002.

  10. 10.

    See Chignard 2013: The term open data appeared for the first time in 1995, in a document from an American scientific agency (see National Research Council 1995).

  11. 11.

    See for the Findable, Accessible, Interoperable and Reusable (FAIR) principles of open science: Wilkinson et al. 2016.

  12. 12.

    ‘Open Definition 2.1’. http://opendefinition.org/. Accessed May 2018.

  13. 13.

    ‘Open Definition 2.1’. http://opendefinition.org/. Accessed May 2018. Please note that the attribution and sharealike requirements are possible limitations in the use, therefore not strictly adhering to the ‘without any barrier’ requirement of open data (see further Chap. 6 of this book).

  14. 14.

    As pointed out by the principles’ authors, “(t)here are many definitions of “open” and this is but one. The 2007 working group’s definition sits at the unique intersection of open government and open data and has United States sensibilities”—Dietrich et al. 2007.

  15. 15.

    Open data must be the default setting for governmental data releases, provided that said data is of a public nature, meaning that it must not be subject to valid privacy, security or other legitimate and legally sanctioned limitations. Moreover, while some resources are by now digital by default, some other artefacts are not: in the latter case, they should be made digitally available to the maximum extent possible.

  16. 16.

    I.e. collected at its very source, and as granular as possible; entities obtaining the original dataset, processing it, and publishing it in a modified (e.g. aggregated) form, should have the obligation to publish the original data set in its default format, thus contributing in preserving it for posterity.

  17. 17.

    Each piece of information has its own lifecycle, and the accuracy—and therefore the utility—of a dataset partly depends on the time lapsed from the dataset’s creation. Timeliness, therefore, means that government data should be released as early as possible, to preserve the data’s value.

  18. 18.

    Data must be accessible to the widest possible number of users for the widest possible array of purposes. Accessibility is deemed to be lacking if the data is not accessible through automated means, due to technological, policy, or other kinds of restrictions.

  19. 19.

    As following from the accessibility principle above, data must be machine-readable and processable, and thus in a widely used, normalized and sufficiently documented format.

  20. 20.

    I.e. available to anyone, for any purpose, without access control, ‘walled gardens’, or other gatekeeping activities that might lead to differences in accessing information.

  21. 21.

    No entity should have exclusive control over the data format employed. As several proprietary formats are widely used, and conversely some open formats have a narrow user base, the decision of releasing a dataset in both widely used proprietary formats and in less used but open formats is compliant with the principle in discussion, as long as the only format used is not a proprietary one.

  22. 22.

    I.e. not subject to limitations deriving from IP rights, thus either in the public domain or disciplined by an open license.

  23. 23.

    See Carrara et al. 2016.

  24. 24.

    See Kulk and Van Loenen 2012; Van Loenen et al. 2016.

  25. 25.

    See Welle Donker 2016.

  26. 26.

    Pollock 2011; Harrison et al. 2012; Zuiderwijk et al. 2014; Jetzek 2017; Styin et al. 2017.

  27. 27.

    Nardi and Day 1999.

  28. 28.

    See e.g. Heimstädt et al. 2014; Zuiderwijk et al. 2014; Styrin et al. 2017.

  29. 29.

    Pollock 2011.

  30. 30.

    See also Jetzek 2017: Stressing that the open data ecosystem should be circular in nature.

  31. 31.

    Pollock 2011.

  32. 32.

    Ubaldi (2013) argues that the open data ecosystem consists of three interacting ecosystems: the data provider ecosystem, the data user ecosystem and the infomediary ecosystem.

  33. 33.

    See, for example, Ubaldi 2013; Dawes et al. 2016; Harrison et al. 2012.

  34. 34.

    Zuiderwijk et al. 2014.

  35. 35.

    Share PSI 2.0 Best Practice: Establish an Open Data Ecosystem, 25 July 2016 [on line] available at: https://www.w3.org/2013/share-psi/bp/eode/. Accessed May 2018.

  36. 36.

    See also Dawes et al. 2016; Ubaldi 2013; Harrison et al. 2012.

  37. 37.

    Such ecosystem may exist at different levels of scale: within an organisation, a country, region or the worldwide open data ecosystem, in a specific domain (see Zuiderwijk 2015). Open data ecosystems may also involve multiple levels, namely a data producer and a data user level, with between the infomediaries level connecting the two (Ubaldi 2013; Jetzek 2017).

  38. 38.

    Cf. Harrison et al. 2012.

  39. 39.

    Harrison et al. 2012.

  40. 40.

    Boley and Chang 2007; Harrison et al. 2012.

  41. 41.

    Davies 2010; cf. the concepts of infrastructures and business systems in Chan et al. 2001.

  42. 42.

    Zuiderwijk 2015.

  43. 43.

    Zuiderwijk 2015.

  44. 44.

    Janssen et al. 2012.

  45. 45.

    Borgman 2000, p. 30.

  46. 46.

    Coleman and McLaughlin 1997.

  47. 47.

    Coleman and McLaughlin 1997.

  48. 48.

    Star and Ruhleder 1996, p. 113.

  49. 49.

    Zuiderwijk et al. 2014.

  50. 50.

    Zuiderwijk et al. 2014; Ubaldi 2013.

  51. 51.

    Ubaldi 2013; Harrison et al. 2012; World Bank 2015.

  52. 52.

    Harrison et al. 2012.

  53. 53.

    See also World Bank 2015; Williamson et al. 2003.

  54. 54.

    Davies 2010.

  55. 55.

    See also O’Reilly 2010: Arguing that greater government involvement could increase the vitality of an infrastructure. “But if the lesson is correctly learned, it should do so not by competing with the private sector to deliver [..] services, but by investing in infrastructure (and “rules of the road”) that will lead to a more robust private sector ecosystem.”

  56. 56.

    European Commission DG CONNECT A European strategy on the data value chain.

References

  • Boley H, Chang E (2007) Digital Ecosystems: Principles and Semantics. 2007 Inaugural IEEE International Conference on Digital Ecosystems and Technologies, Cairns, Australia, February

    Google Scholar 

  • Borgman CL (2000) From Gutenberg to the Global Information Infrastructure; Access to Information in the Networked World. The MIT Press, Cambridge, Massachusetts

    Google Scholar 

  • Carrara W, Oudkerk F, van Steenbergen E, Tinholt D (2016) Open Data Goldbook for Data Managers and Data Holders. https://www.europeandataportal.eu/sites/default/files/goldbook.pdf. Accessed May 2018

  • Castells M, Himanen P (2002) The Information Society and the Welfare State; The Finnish Model. Oxford University Press, Oxford

    Chapter  Google Scholar 

  • Chan TO, Feeney M-E, Rajabifard A, Williamson I (2001) The Dynamic Nature of Spatial Data Infrastructures: A Method of Descriptive Classification. GEOMATICA 55(1):65–72

    Google Scholar 

  • Chignard S (2013) A brief history of Open Data. Paris Innovation Review. http://parisinnovationreview.com/articles-en/a-brief-history-of-open-data. Accessed May 2018

  • Coleman DJ, McLaughlin J (1997) Defining global geospatial data infrastructure (GGDI): Components, Stakeholders and Interfaces. Global Spatial Data Infrastructure Conference, Chapel Hill, North Carolina

    Google Scholar 

  • Davies T (2010) Open Data: Infrastructures and ecosystems. University of Southampton

    Google Scholar 

  • Dawes SS, Vidiasova L, Parkhimovich O (2016) Planning and designing open government data programs: An ecosystem approach. Government Information Quarterly 33(1):15–27

    Article  Google Scholar 

  • Dietrich D, Gray J, McNamara T, Poikola A, Pollock R, Tait J, Zijlstra T (2007) The Open Data Handbook. http://opendatahandbook.org. Accessed May 2018

  • DOMO (2017) Data Never Sleeps 5.0. https://www.domo.com/learn/data-never-sleeps-5?aid=ogsm072517_1&sf100871281=1. Accessed May 2018

  • European Commission (DG CONNECT) (2013) A European strategy on the data value chain

    Google Scholar 

  • Harrison TM, Pardo TA, Cook M (2012) Creating open government ecosystems: A research and development agenda. Future Internet 4(4):900–928

    Article  Google Scholar 

  • Heimstädt M, Saunderson F, Heath T (2014) From Toddler to Teen: Growth of an Open Data Ecosystem. A Longitudinal Analysis of Open Data Developments in the UK. JeDEM - Journal of eDemocracy & Open Government 6(2):123–135

    Google Scholar 

  • IBM (2016) 10 Key Marketing Trends for 2017 and Ideas for Exceeding Customer Expectations

    Google Scholar 

  • Jacobson R (2013) 2.5 quintillion bytes of data created every day. How does CPG & Retail manage it? https://www.ibm.com/blogs/insights-on-business/consumer-products/2-5-quintillion-bytes-of-data-created-every-day-how-does-cpg-retail-manage-it/. Accessed May 2018

  • Janssen K (2011) The influence of the PSI directive on open government data: An overview of recent developments. Government Information Quarterly 28(4):446–456

    Article  Google Scholar 

  • Janssen M, Charalabidis Y, Zuiderwijk A (2012) Benefits, Adoption Barriers and Myths of Open Data and Open Government. Information Systems Management 29(4):258–268

    Article  Google Scholar 

  • Jetzek T (2017) Innovation in the Open Data Ecosystem: Exploring the Role of Real Options Thinking and Multi-sided Platforms for Sustainable Value Generation through Open Data. Chapter in Analytics, Innovation, and Excellence-Driven Enterprise Sustainability. Part of the series Palgrave Studies in Democracy, Innovation, and Entrepreneurship for Growth, pp. 137–168

    Chapter  Google Scholar 

  • Karr D (2012) Big Data Brings Marketing Big Numbers. https://martech.zone/ibm-big-data-marketing/. Accessed May 2018

  • Kelly J (2012) Taming Big Data [A Big Data Infographic]. http://wikibon.org/blog/taming-big-data/. Accessed May 2018

  • Kulk S, van Loenen B (2012) Brave New Open Data World? International Journal of Spatial Data Infrastructures Research 7:196–206

    Google Scholar 

  • Montargil F, Santos V (2017) Communication with Citizens in the First EU Citizen Observatories Experiences. Conference Proceedings European Conference on Digital Government, Lisbon

    Google Scholar 

  • Mulcahy M (2017) Big Data – Are You In Control? https://www.waterfordtechnologies.com/big-data-interesting-facts/. Accessed May 2018

  • Nardi B, Day V (1999) Information Ecologies: Using Technology with Heart - Chapter Four: Information Ecologies. First Monday

    Google Scholar 

  • National Research Council (1995) On the Full and Open Exchange of Scientific Data. The National Academies Press, Washington DC

    Google Scholar 

  • O’Reilly T (2010) Government as a Platform. In: Lathrop D, Ruma L (eds) Open Government: Collaboration, Transparency, and Participation in Practice. O’Reilly Media, Sebastopol, pp. 11–39

    Google Scholar 

  • Pollock R (2011) Building the (Open) Data Ecosystem. https://blog.okfn.org/2011/03/31/building-the-open-data-ecosystem. Accessed May 2018

  • Share PSI 2.0 Best Practice: Establish an Open Data Ecosystem. https://www.w3.org/2013/share-psi/bp/eode/. Accessed May 2018

  • SINTEF (2013) Big Data, for better or worse. 90% of world’s data generated over last two years. ScienceDaily, 22 May

    Google Scholar 

  • Star SL, Ruhleder K (1996) Steps Toward an Ecology of Infrastructure: Design and Access for Large Information Spaces. Information Systems Research 7(1):111–134

    Article  Google Scholar 

  • Styrin E, Luna-Reyes L, Harrison TM (2017) Open data ecosystems: An international comparison. Transforming Government: People, Process and Policy 11(1):132–156. https://doi.org/10.1108/TG-01-2017-0006

    Article  Google Scholar 

  • Ubaldi B (2013) Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives. OECD Working Papers on Public Governance 22. OECD Publishing

    Google Scholar 

  • Van Loenen B, Kulk S, Ploeger H (2016) Data Protection Legislation: A Very Hungry Caterpillar: The Case of Mapping Data in the European Union. Government Information Quarterly 33(2):338–345

    Article  Google Scholar 

  • Welle Donker FM (2016) From access to re-use: a user’s perspective on public sector information availability. PhD thesis, Delft University of Technology

    Google Scholar 

  • Wilkinson MD et al. (2016) The FAIR Guiding Principles for scientific data management and stewardship. Sci Data, 2016 Mar 15;3:160018. https://doi.org/10.1038/sdata.2016.18

    Article  Google Scholar 

  • Williamson I, Rajabifard A, Feeney M-EF (2003) Developing Spatial Data Infrastructures: From Concept to Reality. Taylor and Francis, London

    Google Scholar 

  • World Bank (2015) Open Data Readiness Assessment – Part B: Methodology

    Google Scholar 

  • Zuiderwijk A (2015) Open data infrastructures: The design of an infrastructure to enhance the coordination of open data use. Doctoral thesis

    Google Scholar 

  • Zuiderwijk A, Janssen M, Davis C (2014) Innovation with open data: Essential elements of open data ecosystems. Information Polity 19(1–2):17–33

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bastiaan van Loenen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 T.M.C. Asser press and the authors

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

van Loenen, B., Vancauwenberghe, G., Crompvoets, J., Dalla Corte, L. (2018). Open Data Exposed. In: van Loenen, B., Vancauwenberghe, G., Crompvoets, J. (eds) Open Data Exposed. Information Technology and Law Series, vol 30. T.M.C. Asser Press, The Hague. https://doi.org/10.1007/978-94-6265-261-3_1

Download citation

  • DOI: https://doi.org/10.1007/978-94-6265-261-3_1

  • Published:

  • Publisher Name: T.M.C. Asser Press, The Hague

  • Print ISBN: 978-94-6265-260-6

  • Online ISBN: 978-94-6265-261-3

  • eBook Packages: Law and CriminologyLaw and Criminology (R0)

Publish with us

Policies and ethics