Definition
A database view is a virtual table defined by a query over the given data sources. Database systems recompute the contents of a view upon each reference to its name. A materialized view precomputes and stores the result of its definition query. Incremental view maintenance keeps the contents of materialized views up-to-date for changes in the source relations. Distributed incremental view maintenance is the procedure of updating materialized views when the data is distributed at multiple sites in a computer network.
Overview
Modern applications require real-time analytics over changing datasets. In a growing number of domains – Internet of Things (IoT), clickstream analysis, algorithmic trading, network monitoring, and fraud detection to name a few – applications monitor streaming data to promptly detect certain patterns, anomalies, or future trends. Such applications implement their logic using...
References
Chandramouli B, Goldstein J, Barnett M, DeLine R, Fisher D, Platt JC, Terwilliger JF, Wernsing J (2014) Trill: a high-performance incremental query processor for diverse analytics. PVLDB 8(4):401–412
Chirkova R, Yang J (2012) Materialized views. Found Trends® Databases 4(4):295–405
Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113
Green TJ, Karvounarakis G, Tannen V (2007) Provenance semirings. In: PODS, pp 31–40
Griffin T, Libkin L (1995) Incremental maintenance of views with duplicates. SIGMOD Rec 24(2):328–339
Koch C (2010) Incremental query evaluation in a ring of databases. In: PODS, pp 87–98
Koch C, Ahmad Y, Kennedy O, Nikolic M, Nötzli A, Lupei D, Shaikhha A (2014) DBToaster: higher-order delta processing for dynamic, frequently fresh views. VLDB J 23(2):253–278
Murray DG, McSherry F, Isaacs R, Isard M, Barham P, Abadi M (2013) Naiad: a timely dataflow system. In: SOSP, pp 439–455
Nikolic M, Dashti M, Koch C (2016) How to win a hot dog eating contest: distributed incremental view maintenance with batch updates. In: SIGMOD, pp 511–526
Qian X, Wiederhold G (1991) Incremental recomputation of active relational expressions. IEEE Trans Knowl and Data Eng 3(3):337–341
Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauly M, Franklin MJ, Shenker S, Stoica I (2012) Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In: NSDI, pp 15–28
Zaharia M, Das T, Li H, Hunter T, Shenker S, Stoica I (2013) Discretized streams: fault-tolerant streaming computation at scale. In: SOSP, pp 423–438
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this entry
Cite this entry
Nikolic, M. (2018). Distributed Incremental View Maintenance. In: Sakr, S., Zomaya, A. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_148-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-63962-8_148-1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63962-8
Online ISBN: 978-3-319-63962-8
eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering