Skip to main content
SpringerLink
Log in

Data Streams and Data Stream Management Systems and Languages

  • Chapter
Data Management in Pervasive Systems

Part of the book series: Data-Centric Systems and Applications ((DCSA))

Abstract

The massive usage of data streams dates back to artificial satellite information processing systems and to their commercial application in the early 1970s, such as in telecommunications switching, land monitoring, meteorological surveillance, etc. Today they are extensively used in monitoring systems applications based on wired and wireless sensor networks, in social networks, and in the Internet of Things [20]. The main functional goals of data stream management systems (DSMSs) are as follows: (a) results must be pushed to the output promptly and eagerly while input tuples continue to arrive and (b) because of the unbounded and massive nature of data streams, all past tuples cannot be memorized for future use. Only synopses can be kept in memory and the rest must be discarded.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abadi, D.J., Carney, D., Cetintemel, U., Cherniack, M., Convey, C., Erwin, C., Galvez, E., Hatoun, M., Maskey, A., Rasin, A., et al.: Aurora: a data stream management system. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, p. 666. ACM, New York (2003)

    Google Scholar 

  2. Abadi, D.J., Ahmad, Y., Balazinska, M., Cetintemel, U., Cherniack, M., Hwang, J.H., Lindner, W., Maskey, A., Rasin, A., Ryvkina, E., et al.: The design of the borealis stream processing engine. In: CIDR, vol. 5, pp. 277–289 (2005)

    Google Scholar 

  3. Arasu, A., Babu, S., Widom, J.: The cql continuous query language: semantic foundations and query execution. J. Int. J. Very Large Data Bases 15(2), 121–142 (2006)

    Article  Google Scholar 

  4. Avnur, R., Hellerstein, J.M.: Eddies: continuously adaptive query processing. In: ACM SIGMoD Record, vol. 29, pp. 261–272. ACM, New York (2000)

    Google Scholar 

  5. Babcock, B., Datar, M., Motwani, R.: Load shedding for aggregation queries over data streams. In: Proceedings of 20th International Conference on Data Engineering, 2004, pp. 350–361. IEEE, Boston (2004)

    Google Scholar 

  6. Bai, Y., Thakkar, H., Wang, H., Luo, C., Zaniolo, C.: A data stream language and system designed for power and extensibility. In: Proceedings of the 15th ACM International Conference on Information and Knowledge Management, pp. 337–346. ACM, New York (2006)

    Google Scholar 

  7. Barbieri, D.F., Braga, D., Ceri, S., Valle, E.D., Grossniklaus, M.: Querying rdf streams with c-sparql. SIGMOD Rec. 39(1), 20–26 (2010). doi:10.1145/1860702.1860705. http://doi.acm.org/10.1145/1860702.1860705

  8. Bolchini, C., Orsi, G., Quintarelli, E., Schreiber, F.A., Tanca, L.: Progettazione dei dati con l’uso del contesto. Mondo Digitale (2008)

    Google Scholar 

  9. Bonnet, P., Gehrke, J., Seshadri, P.: Towards sensor database systems. In: Mobile Data Management, pp. 3–14. Springer, Heidelberg (2001)

    Google Scholar 

  10. Calbimonte, J.P., Corcho, O., Gray, A.J.G.: Enabling ontology-based access to streaming data sources. In: Proceedings of the 9th International Semantic Web Conference on The Semantic Web - Volume Part I, ISWC’10, pp. 96–111. Springer, Heidelberg (2010). http://dl.acm.org/citation.cfm?id=1940281.1940289

  11. Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M.J., Hellerstein, J.M., Hong, W., Krishnamurthy, S., Madden, S.R., Reiss, F., Shah, M.A.: Telegraphcq: continuous dataflow processing. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, pp. 668–668. ACM, New York (2003)

    Google Scholar 

  12. Chen, J., DeWitt, D.J., Tian, F., Wang, Y.: Niagaracq: a scalable continuous query system for internet databases. In: ACM SIGMOD Record, vol. 29, pp. 379–390. ACM, New York (2000)

    Google Scholar 

  13. Cherniack, M., Balakrishnan, H., Balazinska, M., Carney, D., Cetintemel, U., Xing, Y., Zdonik, S.B.: Scalable distributed stream processing. In: CIDR, vol. 3, pp. 257–268 (2003)

    Google Scholar 

  14. Cranor, C., Gao, Y., Johnson, T., Shkapenyuk, V., Spatscheck, O.: Gigascope: high performance network monitoring with an sql interface. In: Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data, pp. 623–623. ACM, New York (2002)

    Google Scholar 

  15. Cranor, C., Johnson, T., Spataschek, O., Shkapenyuk, V.: Gigascope: a stream database for network applications. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, pp. 647–651. ACM, New York (2003)

    Google Scholar 

  16. Cugola, G., Margara, A.: Processing flows of information: from data stream to complex event processing. ACM Comput. Surv. 44(3), 15 (2012)

    Article  Google Scholar 

  17. Dell’Aglio, D., Balduini, M., Della Valle, E.: Applying semantic interoperability principles to data stream management. In: Data Management in Pervasive Systems, Chapter 7 Springer, Berlin (2015)

    Google Scholar 

  18. Deutsch, A., Fernandez, M., Florescu, D., Levy, A., Suciu, D.: A query language for xml. Comput. Netw. 31(11), 1155–1169 (1999)

    Article  Google Scholar 

  19. Gilbert, A.C., Kotidis, Y., Muthukrishnan, S., Strauss, M.: Surfing wavelets on streams: one-pass summaries for approximate aggregate queries. In: VLDB, vol. 1, pp. 79–88 (2001)

    Google Scholar 

  20. Golab, L., Özsu, M.T.: Issues in data stream management. ACM Sigmod Rec. 32(2), 5–14 (2003)

    Article  Google Scholar 

  21. Guha, S., McGregor, A.: Approximate quantiles and the order of the stream. In: Proceedings of the Twenty-Fifth ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pp. 273–279. ACM, New York (2006)

    Google Scholar 

  22. Law, Y., Wang, H., Zaniolo, C.: Relational languages and data models for continuous queries on sequences and data streams. ACM Trans. Database Syst. 36(2), 8 (2011). doi:10.1145/1966385.1966386. http://doi.acm.org/10.1145/1966385.1966386

  23. Le-Phuoc, D., Dao-Tran, M., Parreira, J.X., Hauswirth, M.: A native and adaptive approach for unified processing of linked streams and linked data. In: Proceedings of the 10th International Conference on the Semantic Web - Volume Part I, ISWC’11, pp. 370–388. Springer, Berlin (2011). http://dl.acm.org/citation.cfm?id=2063016.2063041

  24. Liu, L., Pu, C.: A dynamic query scheduling framework for distributed and evolving information systems. In: Proceedings of the 17th International Conference on Distributed Computing Systems, 1997, pp. 474–481. IEEE, Baltimore (1997)

    Google Scholar 

  25. Liu, L., Pu, C., Tang, W.: Continual queries for internet scale event-driven information delivery. IEEE Trans. Knowl. Data Eng. 11(4), 610–628 (1999)

    Article  Google Scholar 

  26. Özsu, M.T., Valduriez, P.: Principles of Distributed Database Systems, 3rd edn. Springer, Berlin (2011)

    Google Scholar 

  27. Raman, V., Raman, B., Hellerstein, J.M.: Online dynamic reordering for interactive data processing. In: VLDB, vol. 99, pp. 709–720 (1999)

    Google Scholar 

  28. Rota, G.: Design and development of an asynchronous data access middleware for Pervasive Networks: the case of PerLa. Master’s thesis, Politecnico di Milano (2014)

    Google Scholar 

  29. Ryvkina, E., Maskey, A.S., Cherniack, M., Zdonik, S.: Revision processing in a stream processing engine: a high-level design. In: Proceedings of the 22nd International Conference on Data Engineering, 2006. ICDE’06, pp. 141–141. IEEE, Washington (2006)

    Google Scholar 

  30. Schreiber, F.A., Roveri, M.: Sensors and wireless sensor networks as data sources: models and languages. In: Data Management in Pervasive Systems, Chapter 4. Springer, Berlin (2015)

    Google Scholar 

  31. Schreiber, F.A., Camplani, R., Fortunato, M., Marelli, M., Rota, G.: Perla: a language and middleware architecture for data management and integration in pervasive information systems. IEEE Trans. Softw. Eng. 38(2), 478–496 (2012). doi:10.1109/TSE.2011.25

    Article  Google Scholar 

  32. Shah, M.A., Hellerstein, J.M., Chandrasekaran, S., Franklin, M.J.: Flux: an adaptive partitioning operator for continuous query systems. In: Proceedings of 19th International Conference on Data Engineering, 2003, pp. 25–36. IEEE, Los Alamitos (2003)

    Google Scholar 

  33. Shah, M.A., Hellerstein, J.M., Brewer, E.: Highly available, fault-tolerant, parallel dataflows. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, pp. 827–838. ACM, New York (2004)

    Google Scholar 

  34. Srivastava, U., Widom, J.: Memory-limited execution of windowed stream joins. In: Proceedings of the 30th International Conference on Very Large Data Bases, vol. 30, pp. 324–335. VLDB Endowment, Toronto (2004)

    Google Scholar 

  35. Stonebraker, M., Çetintemel, U., Zdonik, S.: The 8 requirements of real-time stream processing. ACM SIGMOD Rec. 34(4), 42–47 (2005)

    Article  Google Scholar 

  36. Sullivan, M., Heybey, A.: Tribeca: a system for managing large databases of network traffic. In: Proceedings of USENIX (1998)

    Google Scholar 

  37. Tatbul, N., Çetintemel, U., Zdonik, S., Cherniack, M., Stonebraker, M.: Load shedding in a data stream manager. In: Proceedings of the 29th International Conference on Very large Data Bases, vol. 29, pp. 309–320. VLDB Endowment, Berlin (2003)

    Google Scholar 

  38. Tucker, P.A., Maier, D., Sheard, T., Fegaras, L.: Exploiting punctuation semantics in continuous data streams. IEEE Trans. Knowl. Data Eng. 15(3), 555–568 (2003)

    Article  Google Scholar 

  39. Wang, H., Zaniolo, C.: Atlas: A native extension of SQL for data mining. In: D. Barbará, C. Kamath (eds.) Proceedings of the 3rd SIAM International Conference on Data Mining, San Francisco, 1–3 May 2003, pp. 130–141. SIAM, San Francisco (2003). doi:10.1137/1.9781611972733.12. http://dx.doi.org/10.1137/1.9781611972733.12

  40. Zaniolo, C.: Mining databases and data streams with query languages and rules. In: F. Bonchi, J. Boulicaut (eds.) Knowledge Discovery in Inductive Databases, 4th International Workshop, KDID 2005, Porto, 3 October 2005. Revised Selected and Invited Papers. Lecture Notes in Computer Science, vol. 3933, pp. 24–37. Springer, Berlin (2005). doi:10.1007/11733492_2. http://dx.doi.org/10.1007/11733492_2

Download references

Author information

Authors and Affiliations

  1. DEIB – Politecnico di Milano, Piazza L. da Vinci 32, 20133, Milan, Italy

    Emanuele Panigati & Fabio A. Schreiber

  2. UCLA Computer Science Department, 3532D Boelter Hall, Los Angeles, CA, 90095-1596, USA

    Carlo Zaniolo

Authors
  1. Emanuele Panigati
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fabio A. Schreiber
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carlo Zaniolo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fabio A. Schreiber .

Editor information

Editors and Affiliations

  1. Università di Salerno, Salerno, Italy

    Francesco Colace

  2. Università di Salerno, Salerno, Italy

    Massimo De Santo

  3. Università di Napoli, Napoli, Italy

    Vincenzo Moscato

  4. Università di Napoli, Napoli, Italy

    Antonio Picariello

  5. Politecnico di Milano, Milano, Italy

    Fabio A. Schreiber

  6. Politecnico di Milano, Milano, Italy

    Letizia Tanca

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Panigati, E., Schreiber, F.A., Zaniolo, C. (2015). Data Streams and Data Stream Management Systems and Languages. In: Colace, F., De Santo, M., Moscato, V., Picariello, A., Schreiber, F., Tanca, L. (eds) Data Management in Pervasive Systems. Data-Centric Systems and Applications. Springer, Cham. https://doi.org/10.1007/978-3-319-20062-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20062-0_5

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20061-3

  • Online ISBN: 978-3-319-20062-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation