Advertisement

Life and Death of Data in Data Lakes: Preserving Data Usability and Responsible Governance

  • Marzieh Derakhshannia
  • Carmen Gervet
  • Hicham Hajj-Hassan
  • Anne LaurentEmail author
  • Arnaud Martin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11938)

Abstract

Data crossing seeks the extraction of novel knowledge through correlations and dependencies among heterogeneous data, and is considered a key process in sustainable science to push back the current frontiers of knowledge, especially to address challenges such as the socio-economic impacts of climate change. To tackle such complex challenges, interdisciplinary approaches and data sharing methodologies are ubiquitous, with a strong focus on data openness and ensuring that the fair principles hold. Data lakes are data repositories, recently developed to store such big heterogeneous data that are then available for crossing and be exploited without a priori objectives regarding their usage (unlike data warehouses). Such data lakes can then be used to populate Open and Linked Open Data in a central location regardless of its source or format. In this context of no prior knowledge regarding its usage, it may be tempting to store and share all the available data. However, this comes with two main disadvantages: (1) overwhelming amount of data that could prevent end users from exploiting the data, (2) and environmental reasons (energy consumption of data storage). Moreover, data of poor quality may deserve the lake usability and be deleted. We thus claim in this position paper that a data life cycle must be designed so as to integrate data death for some of the data. The choice of the data to be stored regarding the ones to forget is then of crucial importance in data lakes. We propose here some first positions for this aspect of data governance.

Keywords

Data lakes Web of data Data life cycle and data governance Sustainability 

Notes

Acknowledgments

Supported by PHC CEDRE 42415YJ, French Ministry of European and Foreign Affairs (MEAE), French Ministry of Higher Education, Research and Innovation (MESRI) and Lebanese Ministry of Education and Higher Education (MEHE).

References

  1. 1.
    Boly, A., Hébrail, G.: Forgetting data intelligently in data warehouses. In: 2007 IEEE International Conference on Research, Innovation and Vision for the Future in Computing and Communication Technologies, RIVF 2007, Hanoi, Vietnam, 5–9 March 2007, pp. 220–227. IEEE (2007).  https://doi.org/10.1109/RIVF.2007.369160
  2. 2.
    Fang, H.: Managing data lakes in big data era: what’s a data lake and why has it became popular in data management ecosystem. In: International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), pp. 820–824. IEEE (2015)Google Scholar
  3. 3.
    Gartner: Gartner Says Beware of the Data Lake Fallacy (2014). http://www.gartner.com/newsroom/id/2809117
  4. 4.
    Gaucherel, C., Gouyon, P., Dessalles, J.L.: Information. The Hidden Side of Life. ISTE (2019)Google Scholar
  5. 5.
    IBM: Governing and Managing Big Data for Analytics and Decision Makers (2014). http://www.redbooks.ibm.com/abstracts/redp5120.html?Open
  6. 6.
    Jones, N.: How to stop data centres from gobbling up the worlds electricity. Nature 561, 163–166 (2018).  https://doi.org/10.1038/d41586-018-06610-yCrossRefGoogle Scholar
  7. 7.
    Khatri, V., Brown, C.V.: Designing data governance. Commun. ACM 53(1), 148–152 (2010).  https://doi.org/10.1145/1629175.1629210CrossRefGoogle Scholar
  8. 8.
    Li, M., Vitnyi, P.M.: An Introduction to Kolmogorov Complexity and Its Applications, 3rd edn. Springer, New York (2008).  https://doi.org/10.1007/978-0-387-49820-1CrossRefGoogle Scholar
  9. 9.
    Madera, C., Laurent, A.: The next information architecture evolution: the data lake wave. In: Chbeir, R., Agrawal, R., Biskri, I. (eds.) Proceedings of the 8th International Conference on Management of Digital EcoSystems, MEDES 2016, Biarritz, France, 1–4 November 2016. pp. 174–180. ACM (2016).  https://doi.org/10.1145/3012071
  10. 10.
    Martnez-Jurado, P.J., Moyano-Fuentes, J.: Lean management, supply chain management and sustainability: a literature review. J. Clean. Prod. 85, 134–150 (2014).  https://doi.org/10.1016/j.jclepro.2013.09.042CrossRefGoogle Scholar
  11. 11.
    Mentzer, J., Witt, W.D., et al.: Defining supply chain (SC) management. J. Bus. Logist. 22(2) (2001).  https://doi.org/10.1002/j.2158-1592.2001.tb00001.xCrossRefGoogle Scholar
  12. 12.
    Simchi-Levi, D., Kaminsky, P., Simchi-Levi, E.: Designing and Managing the Supply Chain: Concepts, Strategies and Case Studies. McGraw-Hill Publishing, New York (2003)zbMATHGoogle Scholar
  13. 13.
    Zhu, Q., Sarkis, J.: Relationships between operational practices and performance among early adopters of green supply chain management practices in chinese manufacturing enterprises. J. Oper. Manag. 22, 256–289 (2004)CrossRefGoogle Scholar
  14. 14.
    Zhu, Q., Sarkis, J., Lai, K.: Green supply chain management implications for closing the loop. J. Transp. Res. Part E 44, 1–18 (2008)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.LIRMM, Univ Montpellier, CNRSMontpellierFrance
  2. 2.Espace Dev, Univ Montpellier, IRD, Univ. La Runion, Univ de Guyane, Univ des AntillesMontpellierFrance
  3. 3.CNRS-LBeirutLebanon
  4. 4.CEFE, Univ Montpellier, CNRSMontpellierFrance

Personalised recommendations