Encyclopedia of Database Systems

2018 Edition
| Editors: Ling Liu, M. Tamer Özsu

Load Shedding

  • Nesime Tatbul
Reference work entry
DOI: https://doi.org/10.1007/978-1-4614-8265-9_211

Definition

Data stream management systems may be subject to higher input rates than they can immediately process with their available system resources (e.g., CPU, memory). When input rates exceed the resource capacity, the system becomes overloaded and the query answers are delayed. Load shedding is a technique to remove excess load from the system in order to keep query processing up with the input arrival rates. As a result of load shedding, the system delivers approximate query answers with reduced latency.

Historical Background

Load shedding is a term that originally comes from electric power management, where it refers to the process of intentionally cutting off the electric current on certain lines when the demand for electricity exceeds the available supply, in order to save the electric grid from collapsing. The same term has also been used in computer networking to refer to a certain form of congestion control approach, where a network router drops packets when its buffers...

This is a preview of subscription content, log in to check access.

Recommended Reading

  1. 1.
    Amini L, Jain N, Sehgal A, Silber J, Verscheure O. Adaptive control of extreme-scale stream processing systems. In: Proceedings of the 23rd IEEE International Conference on Distributed Computing Systems; 2006.Google Scholar
  2. 2.
    Ayad A, Naughton JF. Static optimization of conjunctive queries with sliding windows over infinite streams. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 2004.Google Scholar
  3. 3.
    Babcock B, Datar M, Motwani R. Load shedding for aggregation queries over data streams. In: Proceedings of the 20th International Conference on Data Engineering; 2004.Google Scholar
  4. 4.
    Carney D, Çetintemel U, Cherniack M, Convey C, Lee S, Seidman G, Stonebraker M, Tatbul N, Zdonik S. Monitoring streams – a new class of data management applications. In: Proceedings of the 28th International Conference on Very Large Data Bases; 2002.Google Scholar
  5. 5.
    Chandrasekaran S, Franklin MJ. Remembrance of streams past: overload-sensitive management of archived streams. In: Proceedings of the 30th International Conference on Very Large Data Bases; 2004.Google Scholar
  6. 6.
    Chi Y, Yu PS, Wang H, Muntz RR Loadstar: a load shedding scheme for classifying data streams. In: Proceedings of the SIAM International Conference on Data Mining; 2005.Google Scholar
  7. 7.
    Das A, Gehrke J, Riedewald M. Approximate join processing over data streams. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 2003.Google Scholar
  8. 8.
    Gedik B, Wu K, Yu PS, Liu L. CPU load shedding for binary stream joins. Knowl Inf Syst. 2006;13(3):271–303.CrossRefGoogle Scholar
  9. 9.
    Jain A, Chang EY, Wang Y. Adaptive stream resource management using Kalman Filters. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 2004.Google Scholar
  10. 10.
    Kang J, Naughton JF, Viglas S. Evaluating window joins over unbounded streams. In: Proceedings of the 19th International Conference on Data Engineering; 2003.Google Scholar
  11. 11.
    Reiss F, Hellerstein JM. Data triage: an adaptive architecture for load shedding in TelegraphCQ. In: Proceedings of the 21st International Conference on Data Engineering; 2005.Google Scholar
  12. 12.
    Srivastava U, Widom J. Memory limited execution of windowed stream joins. In: Proceedings of the 30th International Conference on Very Large Data Bases; 2004.CrossRefGoogle Scholar
  13. 13.
    Tatbul N, Çetintemel U, Zdonik S. Staying FIT: efficient load shedding techniques for distributed stream processing. In: Proceedings of the 33rd International Conference on Very Large Data Bases; 2007.Google Scholar
  14. 14.
    Tatbul N, Çetintemel U, Zdonik S, Cherniack M, Stonebraker M. Load shedding in a data stream manager. In: Proceedings of the 29th International Conference on Very Large Data Bases; 2003.Google Scholar
  15. 15.
    Tatbul N, Zdonik S. Window-aware load shedding for aggregation queries over data streams. In: Proceedings of the 32nd International Conference on Very Large Data Bases; 2006.Google Scholar
  16. 16.
    Tu Y, Liu S, Prabhakar S, Yao B. Load shedding in stream databases: a control-based approach. In: Proceedings of the 32nd International Conference on Very Large Data Bases; 2006.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Intel Labs and MITCambridgeUSA

Section editors and affiliations

  • Uĝur Çetintemel
    • 1
  1. 1.Brown UniversityProvidenceUSA