Skip to main content

Change Detection on Streams

  • Reference work entry
  • First Online:
  • 11 Accesses

Synonyms

Change detection and explanation on streams

Definition

A data stream is a (potentially infinite) sequence of data items x1, x2,…. As opposed to traditional data analysis, it is not assumed that the data items are generated independently from the same probability distribution. Thus change detection is an important part of data stream mining. It consists of two tasks: determining when there is a change in the characteristics of the data stream (preferably as quickly as possible) and explaining what is the nature of the change.

The nature of the data stream model means that it may be infeasible to store all of the data or to make several passes over it. For this reason, change detection algorithms should satisfy the following desiderata: the memory requirements should be constant or increase logarithmically, and the algorithm should require only one pass over the data.

Historical Background

There has been a lot of work on detecting change in time series data afterall of the...

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   4,499.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   6,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Recommended Reading

  1. Agarwal D, Barman D, Gunopulos D, Korn F, Srivastava D, Young N. Efficient and effective explanation of change in hierarchical summaries. In: Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2007. p.~6–15.

    Google Scholar 

  2. Babcock B, Babu S, Datar M, Motwani R, Wisdom J. Models and issues in data stream systems. In: Proceedings of the 21st ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems; 2002. p. 1–16.

    Google Scholar 

  3. Bansal RK, Papantoni-Kazakos P. An algorithm for detecting a change in a stochastic process. IEEE Trans Inf Theor. 1986;32(2):227–35.

    Article  MathSciNet  MATH  Google Scholar 

  4. Basseville M, Nikiforov IV. Detection of abrupt changes: theory and application. Englewood Cliffs, NJ: Prentice-Hall; 1993.

    Google Scholar 

  5. Carlstein E, H-G M, Siegmund D, editors. Change-point problems. Hayward: Institute of Mathematical Statistics; 1994.

    MATH  Google Scholar 

  6. Chahrabarti S, Sarawagi S, Dom B. Mining surprising patterns using temporal description length. In: Proceedings of the 24th International Conference on Very Large Data Bases; 1998. p. 606–17.

    Google Scholar 

  7. Chawathe SS, Abiteboul S, Widom J. Representing and querying changes in semi-structured data. In: Proceedings of the 14th International Conference on Data Engineering; 1998. p. 4–13.

    Google Scholar 

  8. Chawathe SS, Garcia-Molina H. Meaningful change detection in structured data. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 1997. p. 26–37.

    Article  Google Scholar 

  9. Dasu T, Krishnan S, Venkatasubramanian S, Yi K. An information-theoretic approach to detecting changes in multi-dimensional data streams. In: Proceedings of the 38th Symposium on the Interface of Statistics, Computing Science, and Applications; 2006.

    Google Scholar 

  10. Ganti V, Gehrke J, Ramakrishnan R. Mining data streams under block evolution. SIGKDD Explorations. 2002;3(2):1–10.

    Article  Google Scholar 

  11. Glaz J, Balakrishnan N. Scan statistics and applications. Boston: Birkhäuser; 1999.

    Book  MATH  Google Scholar 

  12. Hulten G, Spencer L, Domingos P. Mining time-changing data streams. In: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2001. p. 97–106.

    Google Scholar 

  13. Kifer D, Ben-David S, Gehrke J. Detecting change in data streams. In: Proceedings of the 30th International Conference on Very Large Data Bases; 2004. p.~180–91.

    Chapter  Google Scholar 

  14. Kleinberg JM Bursty and hierarchical structure in streams. In: Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2002. p. 91–101.

    Google Scholar 

  15. Vovk V, Nouretdinov I, Gammerman A. Testing exchangeability on-line. In: Proceedings of the 20th International Conference on Machine Learning; 2003. p. 768–75.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Kifer .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Science+Business Media, LLC, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Kifer, D. (2018). Change Detection on Streams. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_49

Download citation

Publish with us

Policies and ethics