Skip to main content

Distributed Incremental View Maintenance

  • Living reference work entry
  • First Online:
Encyclopedia of Big Data Technologies
  • 361 Accesses

Synonyms

Distributed Incremental Query Computation; Distributed View Update

Definition

A database view is a virtual table defined by a query over the given data sources. Database systems recompute the contents of a view upon each reference to its name. A materialized view precomputes and stores the result of its definition query. Incremental view maintenance keeps the contents of materialized views up-to-date for changes in the source relations. Distributed incremental view maintenance is the procedure of updating materialized views when the data is distributed at multiple sites in a computer network.

Overview

Modern applications require real-time analytics over changing datasets. In a growing number of domains – Internet of Things (IoT), clickstream analysis, algorithmic trading, network monitoring, and fraud detection to name a few – applications monitor streaming data to promptly detect certain patterns, anomalies, or future trends. Such applications implement their logic using...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  • Chandramouli B, Goldstein J, Barnett M, DeLine R, Fisher D, Platt JC, Terwilliger JF, Wernsing J (2014) Trill: a high-performance incremental query processor for diverse analytics. PVLDB 8(4):401–412

    Google Scholar 

  • Chirkova R, Yang J (2012) Materialized views. Found Trends® Databases 4(4):295–405

    Google Scholar 

  • Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113

    Google Scholar 

  • Green TJ, Karvounarakis G, Tannen V (2007) Provenance semirings. In: PODS, pp 31–40

    Google Scholar 

  • Griffin T, Libkin L (1995) Incremental maintenance of views with duplicates. SIGMOD Rec 24(2):328–339

    Google Scholar 

  • Koch C (2010) Incremental query evaluation in a ring of databases. In: PODS, pp 87–98

    Google Scholar 

  • Koch C, Ahmad Y, Kennedy O, Nikolic M, Nötzli A, Lupei D, Shaikhha A (2014) DBToaster: higher-order delta processing for dynamic, frequently fresh views. VLDB J 23(2):253–278

    Google Scholar 

  • Murray DG, McSherry F, Isaacs R, Isard M, Barham P, Abadi M (2013) Naiad: a timely dataflow system. In: SOSP, pp 439–455

    Google Scholar 

  • Nikolic M, Dashti M, Koch C (2016) How to win a hot dog eating contest: distributed incremental view maintenance with batch updates. In: SIGMOD, pp 511–526

    Google Scholar 

  • Qian X, Wiederhold G (1991) Incremental recomputation of active relational expressions. IEEE Trans Knowl and Data Eng 3(3):337–341

    Google Scholar 

  • Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauly M, Franklin MJ, Shenker S, Stoica I (2012) Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In: NSDI, pp 15–28

    Google Scholar 

  • Zaharia M, Das T, Li H, Hunter T, Shenker S, Stoica I (2013) Discretized streams: fault-tolerant streaming computation at scale. In: SOSP, pp 423–438

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Milos Nikolic .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Nikolic, M. (2018). Distributed Incremental View Maintenance. In: Sakr, S., Zomaya, A. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_148-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-63962-8_148-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-63962-8

  • Online ISBN: 978-3-319-63962-8

  • eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering

Publish with us

Policies and ethics