Skip to main content

Life and Death of Data in Data Lakes: Preserving Data Usability and Responsible Governance

  • Conference paper
  • First Online:
Book cover Internet Science (INSCI 2019)

Abstract

Data crossing seeks the extraction of novel knowledge through correlations and dependencies among heterogeneous data, and is considered a key process in sustainable science to push back the current frontiers of knowledge, especially to address challenges such as the socio-economic impacts of climate change. To tackle such complex challenges, interdisciplinary approaches and data sharing methodologies are ubiquitous, with a strong focus on data openness and ensuring that the fair principles hold. Data lakes are data repositories, recently developed to store such big heterogeneous data that are then available for crossing and be exploited without a priori objectives regarding their usage (unlike data warehouses). Such data lakes can then be used to populate Open and Linked Open Data in a central location regardless of its source or format. In this context of no prior knowledge regarding its usage, it may be tempting to store and share all the available data. However, this comes with two main disadvantages: (1) overwhelming amount of data that could prevent end users from exploiting the data, (2) and environmental reasons (energy consumption of data storage). Moreover, data of poor quality may deserve the lake usability and be deleted. We thus claim in this position paper that a data life cycle must be designed so as to integrate data death for some of the data. The choice of the data to be stored regarding the ones to forget is then of crucial importance in data lakes. We propose here some first positions for this aspect of data governance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.dataone.org/data-life-cycle.

References

  1. Boly, A., Hébrail, G.: Forgetting data intelligently in data warehouses. In: 2007 IEEE International Conference on Research, Innovation and Vision for the Future in Computing and Communication Technologies, RIVF 2007, Hanoi, Vietnam, 5–9 March 2007, pp. 220–227. IEEE (2007). https://doi.org/10.1109/RIVF.2007.369160

  2. Fang, H.: Managing data lakes in big data era: what’s a data lake and why has it became popular in data management ecosystem. In: International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), pp. 820–824. IEEE (2015)

    Google Scholar 

  3. Gartner: Gartner Says Beware of the Data Lake Fallacy (2014). http://www.gartner.com/newsroom/id/2809117

  4. Gaucherel, C., Gouyon, P., Dessalles, J.L.: Information. The Hidden Side of Life. ISTE (2019)

    Google Scholar 

  5. IBM: Governing and Managing Big Data for Analytics and Decision Makers (2014). http://www.redbooks.ibm.com/abstracts/redp5120.html?Open

  6. Jones, N.: How to stop data centres from gobbling up the worlds electricity. Nature 561, 163–166 (2018). https://doi.org/10.1038/d41586-018-06610-y

    Article  Google Scholar 

  7. Khatri, V., Brown, C.V.: Designing data governance. Commun. ACM 53(1), 148–152 (2010). https://doi.org/10.1145/1629175.1629210

    Article  Google Scholar 

  8. Li, M., Vitnyi, P.M.: An Introduction to Kolmogorov Complexity and Its Applications, 3rd edn. Springer, New York (2008). https://doi.org/10.1007/978-0-387-49820-1

    Book  Google Scholar 

  9. Madera, C., Laurent, A.: The next information architecture evolution: the data lake wave. In: Chbeir, R., Agrawal, R., Biskri, I. (eds.) Proceedings of the 8th International Conference on Management of Digital EcoSystems, MEDES 2016, Biarritz, France, 1–4 November 2016. pp. 174–180. ACM (2016). https://doi.org/10.1145/3012071

  10. Martnez-Jurado, P.J., Moyano-Fuentes, J.: Lean management, supply chain management and sustainability: a literature review. J. Clean. Prod. 85, 134–150 (2014). https://doi.org/10.1016/j.jclepro.2013.09.042

    Article  Google Scholar 

  11. Mentzer, J., Witt, W.D., et al.: Defining supply chain (SC) management. J. Bus. Logist. 22(2) (2001). https://doi.org/10.1002/j.2158-1592.2001.tb00001.x

    Article  Google Scholar 

  12. Simchi-Levi, D., Kaminsky, P., Simchi-Levi, E.: Designing and Managing the Supply Chain: Concepts, Strategies and Case Studies. McGraw-Hill Publishing, New York (2003)

    MATH  Google Scholar 

  13. Zhu, Q., Sarkis, J.: Relationships between operational practices and performance among early adopters of green supply chain management practices in chinese manufacturing enterprises. J. Oper. Manag. 22, 256–289 (2004)

    Article  Google Scholar 

  14. Zhu, Q., Sarkis, J., Lai, K.: Green supply chain management implications for closing the loop. J. Transp. Res. Part E 44, 1–18 (2008)

    Article  Google Scholar 

Download references

Acknowledgments

Supported by PHC CEDRE 42415YJ, French Ministry of European and Foreign Affairs (MEAE), French Ministry of Higher Education, Research and Innovation (MESRI) and Lebanese Ministry of Education and Higher Education (MEHE).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anne Laurent .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Derakhshannia, M., Gervet, C., Hajj-Hassan, H., Laurent, A., Martin, A. (2019). Life and Death of Data in Data Lakes: Preserving Data Usability and Responsible Governance. In: El Yacoubi, S., Bagnoli, F., Pacini, G. (eds) Internet Science. INSCI 2019. Lecture Notes in Computer Science(), vol 11938. Springer, Cham. https://doi.org/10.1007/978-3-030-34770-3_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-34770-3_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-34769-7

  • Online ISBN: 978-3-030-34770-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics