Abstract
Data crossing seeks the extraction of novel knowledge through correlations and dependencies among heterogeneous data, and is considered a key process in sustainable science to push back the current frontiers of knowledge, especially to address challenges such as the socio-economic impacts of climate change. To tackle such complex challenges, interdisciplinary approaches and data sharing methodologies are ubiquitous, with a strong focus on data openness and ensuring that the fair principles hold. Data lakes are data repositories, recently developed to store such big heterogeneous data that are then available for crossing and be exploited without a priori objectives regarding their usage (unlike data warehouses). Such data lakes can then be used to populate Open and Linked Open Data in a central location regardless of its source or format. In this context of no prior knowledge regarding its usage, it may be tempting to store and share all the available data. However, this comes with two main disadvantages: (1) overwhelming amount of data that could prevent end users from exploiting the data, (2) and environmental reasons (energy consumption of data storage). Moreover, data of poor quality may deserve the lake usability and be deleted. We thus claim in this position paper that a data life cycle must be designed so as to integrate data death for some of the data. The choice of the data to be stored regarding the ones to forget is then of crucial importance in data lakes. We propose here some first positions for this aspect of data governance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Boly, A., Hébrail, G.: Forgetting data intelligently in data warehouses. In: 2007 IEEE International Conference on Research, Innovation and Vision for the Future in Computing and Communication Technologies, RIVF 2007, Hanoi, Vietnam, 5–9 March 2007, pp. 220–227. IEEE (2007). https://doi.org/10.1109/RIVF.2007.369160
Fang, H.: Managing data lakes in big data era: what’s a data lake and why has it became popular in data management ecosystem. In: International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), pp. 820–824. IEEE (2015)
Gartner: Gartner Says Beware of the Data Lake Fallacy (2014). http://www.gartner.com/newsroom/id/2809117
Gaucherel, C., Gouyon, P., Dessalles, J.L.: Information. The Hidden Side of Life. ISTE (2019)
IBM: Governing and Managing Big Data for Analytics and Decision Makers (2014). http://www.redbooks.ibm.com/abstracts/redp5120.html?Open
Jones, N.: How to stop data centres from gobbling up the worlds electricity. Nature 561, 163–166 (2018). https://doi.org/10.1038/d41586-018-06610-y
Khatri, V., Brown, C.V.: Designing data governance. Commun. ACM 53(1), 148–152 (2010). https://doi.org/10.1145/1629175.1629210
Li, M., Vitnyi, P.M.: An Introduction to Kolmogorov Complexity and Its Applications, 3rd edn. Springer, New York (2008). https://doi.org/10.1007/978-0-387-49820-1
Madera, C., Laurent, A.: The next information architecture evolution: the data lake wave. In: Chbeir, R., Agrawal, R., Biskri, I. (eds.) Proceedings of the 8th International Conference on Management of Digital EcoSystems, MEDES 2016, Biarritz, France, 1–4 November 2016. pp. 174–180. ACM (2016). https://doi.org/10.1145/3012071
Martnez-Jurado, P.J., Moyano-Fuentes, J.: Lean management, supply chain management and sustainability: a literature review. J. Clean. Prod. 85, 134–150 (2014). https://doi.org/10.1016/j.jclepro.2013.09.042
Mentzer, J., Witt, W.D., et al.: Defining supply chain (SC) management. J. Bus. Logist. 22(2) (2001). https://doi.org/10.1002/j.2158-1592.2001.tb00001.x
Simchi-Levi, D., Kaminsky, P., Simchi-Levi, E.: Designing and Managing the Supply Chain: Concepts, Strategies and Case Studies. McGraw-Hill Publishing, New York (2003)
Zhu, Q., Sarkis, J.: Relationships between operational practices and performance among early adopters of green supply chain management practices in chinese manufacturing enterprises. J. Oper. Manag. 22, 256–289 (2004)
Zhu, Q., Sarkis, J., Lai, K.: Green supply chain management implications for closing the loop. J. Transp. Res. Part E 44, 1–18 (2008)
Acknowledgments
Supported by PHC CEDRE 42415YJ, French Ministry of European and Foreign Affairs (MEAE), French Ministry of Higher Education, Research and Innovation (MESRI) and Lebanese Ministry of Education and Higher Education (MEHE).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Derakhshannia, M., Gervet, C., Hajj-Hassan, H., Laurent, A., Martin, A. (2019). Life and Death of Data in Data Lakes: Preserving Data Usability and Responsible Governance. In: El Yacoubi, S., Bagnoli, F., Pacini, G. (eds) Internet Science. INSCI 2019. Lecture Notes in Computer Science(), vol 11938. Springer, Cham. https://doi.org/10.1007/978-3-030-34770-3_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-34770-3_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-34769-7
Online ISBN: 978-3-030-34770-3
eBook Packages: Computer ScienceComputer Science (R0)