Abstract
Data analytics trends have been disruptive. It would be an understatement to say that within the data analytics practitioner community, there exists a lean school of thoughts for data processing and drawing insights that are meaningful for business. With the steep increase in data appetite, data management practices have folded to multi times; which in-turn has reinforced advanced analytics expertise and data management policies in the industry. The thought process behind crafting a data strategy is driven by use-cases and adjunct to technical capacity, learning momentum, and most importantly, the ability to cherry pick key discoveries that can be magnified into actionable insights to engage customers and drive business. The success mantra for a data analytics practice to excel is to maintain a “preamble” that envisions end goals aligned with the business use cases; both in the short run as well as the longer run. In our earlier chapters, we discussed the pillars of data analytics i.e. data engineering, data discovery, data science, and data visualization. Data engineering offers relatively a bigger playground encapsulating ingestion principles, processing techniques, and development.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Dean, Jeffrey; Ghemawat, Sanjay; MapReduce: Simplified Data Processing on Large Clusters, https://static.googleusercontent.com/media/research.google.com/en//archive/MapReduce-osdi04.pdf
- 2.
Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks [ https://www.microsoft.com/en-us/research/wp-content/uploads/2007/03/eurosys07.pdf ]
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2018 Saurabh Gupta, Venkata Giri
About this chapter
Cite this chapter
Gupta, S., Giri, V. (2018). Data Processing Strategies in Data Lakes. In: Practical Enterprise Data Lake Insights. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-3522-5_4
Download citation
DOI: https://doi.org/10.1007/978-1-4842-3522-5_4
Published:
Publisher Name: Apress, Berkeley, CA
Print ISBN: 978-1-4842-3521-8
Online ISBN: 978-1-4842-3522-5
eBook Packages: Professional and Applied ComputingProfessional and Applied Computing (R0)Apress Access Books