Skip to main content
SpringerLink
Log in

Linked Stream Data Processing

  • Chapter
Reasoning Web. Semantic Technologies for Advanced Query Answering (Reasoning Web 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7487))

Included in the following conference series:

Abstract

Linked Stream Data has emerged as an effort to represent dynamic, time-dependent data streams following the principles of Linked Data. Given the increasing number of available stream data sources like sensors and social network services, Linked Stream Data allows an easy and seamless integration, not only among heterogenous stream data, but also between streams and Linked Data collections, enabling a new range of real-time applications.

This tutorial gives an overview about Linked Stream Data processing. It describes the basic requirements for the processing, highlighting the challenges that are faced, such as managing the temporal aspects and memory overflow. It presents the different architectures for Linked Stream Data processing engines, their advantages and disadvantages. The tutorial also reviews the state of the art Linked Stream Data processing systems, and provide a comparison among them regarding the design choices and overall performance. A short discussion of the current challenges in open problems is given at the end.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abadi, D.J., Ahmad, Y., Balazinska, M., Çetintemel, U., Cherniack, M., Hwang, J.H., Lindner, W., Maskey, A., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., Zdonik, S.B.: The design of the borealis stream processing engine. In: Second Biennial Conference on Innovative Data Systems Research, CIDR 2005, pp. 277–289 (2005)

    Google Scholar 

  2. Abadi, D.J., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S.: Aurora: a new model and architecture for data stream management. The VLDB Journal 12(2), 120–139 (2003)

    Article  Google Scholar 

  3. Agrawal, J., Diao, Y., Gyllstrom, D., Immerman, N.: Efficient pattern matching over event streams. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, SIGMOD 2008, pp. 147–160. ACM, New York (2008)

    Chapter  Google Scholar 

  4. Alani, H., Szomszor, M., Cattuto, C., Van den Broeck, W., Correndo, G., Barrat, A.: Live Social Semantics. In: Bernstein, A., Karger, D.R., Heath, T., Feigenbaum, L., Maynard, D., Motta, E., Thirunarayan, K. (eds.) ISWC 2009. LNCS, vol. 5823, pp. 698–714. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  5. Amsaleg, L., Franklin, M.J., Tomasic, A., Urhan, T.: Scrambling query plans to cope with unexpected delays. In: Proceedings of the Fourth International Conference on on Parallel and Distributed Information Systems, DIS 1996, pp. 208–219. IEEE Computer Society, Washington, DC (1996)

    Google Scholar 

  6. Anicic, D., Fodor, P., Rudolph, S., Stojanovic, N.: Ep-sparql: a unified language for event processing and stream reasoning. In: Proceedings of the 20th International Conference on World Wide Web, WWW 2011, pp. 635–644. ACM, New York (2011)

    Google Scholar 

  7. Anicic, D., Fodor, P., Rudolph, S., Stühmer, R., Stojanovic, N., Studer, R.: A Rule-Based Language for Complex Event Processing and Reasoning. In: Hitzler, P., Lukasiewicz, T. (eds.) RR 2010. LNCS, vol. 6333, pp. 42–57. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  8. Arasu, A., Babu, S., Widom, J.: The CQL continuous query language: semantic foundations and query execution. The VLDB Journal 15(2), 121–142 (2006)

    Article  Google Scholar 

  9. Arasu, A., Widom, J.: Resource sharing in continuous sliding-window aggregates. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 336–347. VLDB Endowment (2004)

    Google Scholar 

  10. Avnur, R., Hellerstein, J.M.: Eddies: continuously adaptive query processing. SIGMOD Rec. 29(2), 261–272 (2000)

    Article  Google Scholar 

  11. Babcock, B., Babu, S., Datar, M., Motwani, R., Thomas, D.: Operator scheduling in data stream systems. The VLDB Journal 13(4), 333–353 (2004)

    Article  Google Scholar 

  12. Babu, S.: Adaptive query processing in the looking glass. In: Second Biennial Conference on Innovative Data Systems Research, CIDR 2005, pp. 238–249 (2005)

    Google Scholar 

  13. Babu, S., Motwani, R., Munagala, K., Nishizawa, I., Widom, J.: Adaptive ordering of pipelined stream filters. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, SIGMOD 2004, pp. 407–418. ACM, New York (2004)

    Google Scholar 

  14. Babu, S., Munagala, K., Widom, J., Motwani, R.: Adaptive caching for continuous queries. In: Proceedings of the 21st International Conference on Data Engineering (ICDE 2005), pp. 118–129. IEEE Computer Society, Washington, DC (2005)

    Chapter  Google Scholar 

  15. Babu, S., Srivastava, U., Widom, J.: Exploiting k-constraints to reduce memory overhead in continuous queries over data streams. ACM Trans. Database Syst. 29(3), 545–580 (2004)

    Article  Google Scholar 

  16. Bar-Yossef, Z., Kumar, R., Sivakumar, D.: Reductions in streaming algorithms, with an application to counting triangles in graphs. In: Proceedings of the Thirteenth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2002, pp. 623–632. Society for Industrial and Applied Mathematics, Philadelphia (2002)

    Google Scholar 

  17. Barbieri, D.F., Braga, D., Ceri, S., Grossniklaus, M.: An execution environment for c-sparql queries. In: Proceedings of the 13th International Conference on Extending Database Technology, EDBT 2010, pp. 441–452. ACM, New York (2010)

    Google Scholar 

  18. Berthold, H., Schmidt, S., Lehner, W., Hamann, C.J.: Integrated resource management for data stream systems. In: Proceedings of the 2005 ACM Symposium on Applied Computing, SAC 2005, pp. 555–562. ACM, New York (2005)

    Google Scholar 

  19. Bertino, E., Catania, B., Wang, W.Q.: Xjoin index: Indexing xml data for efficient handling of branching path expressions. In: Proceedings of the 20th International Conference on Data Engineering, ICDE 2004. IEEE Computer Society Press, Washington, DC (2004)

    Google Scholar 

  20. Bifet, A., Holmes, G., Pfahringer, B., Gavaldà, R.: Mining frequent closed graphs on evolving data streams. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2011, pp. 591–599. ACM, New York (2011)

    Google Scholar 

  21. Bizarro, P., Babu, S., DeWitt, D., Widom, J.: Content-based routing: different plans for different data. In: Proceedings of the 31st International Conference on Very Large Data Bases, VLDB 2005, pp. 757–768. VLDB Endowment (2005)

    Google Scholar 

  22. Bizer, C., Heath, T., Berners-Lee, T.: Linked Data - The Story So Far. International Journal on Semantic Web and Information Systems 5(3), 1–22 (2009)

    Article  Google Scholar 

  23. Bolles, A., Grawunder, M., Jacobi, J.: Streaming SPARQL - Extending SPARQL to Process Data Streams. In: Bechhofer, S., Hauswirth, M., Hoffmann, J., Koubarakis, M. (eds.) ESWC 2008. LNCS, vol. 5021, pp. 448–462. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  24. Bonnet, P., Gehrke, J., Seshadri, P.: Towards Sensor Database Systems. In: Tan, K.-L., Franklin, M.J., Lui, J.C.-S. (eds.) MDM 2001. LNCS, vol. 1987, pp. 3–14. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  25. Bouillet, E., Feblowitz, M., Liu, Z., Ranganathan, A., Riabov, A., Ye, F.: A Semantics-Based Middleware for Utilizing Heterogeneous Sensor Networks. In: Aspnes, J., Scheideler, C., Arora, A., Madden, S. (eds.) DCOSS 2007. LNCS, vol. 4549, pp. 174–188. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  26. Bry, F., Eckert, M.: Rules for making sense of events: Design issues for high-level event query and reasoning languages. In: AI Meets Business Rules and Process Management, Proceedings of AAAI 2008 Spring Symposium, Stanford University/Palo Alto, California, USA, March 26. AAAI (2008)

    Google Scholar 

  27. Calbimonte, J.-P., Corcho, O., Gray, A.J.G.: Enabling Ontology-Based Access to Streaming Data Sources. In: Patel-Schneider, P.F., Pan, Y., Hitzler, P., Mika, P., Zhang, L., Pan, J.Z., Horrocks, I., Glimm, B. (eds.) ISWC 2010, Part I. LNCS, vol. 6496, pp. 96–111. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  28. Carnes, C., Park, J.B., Vernon, A.: Scalable trigger processing. In: Proceedings of the 15th International Conference on Data Engineering, p. 266. IEEE Computer Society, Washington, DC (1999)

    Google Scholar 

  29. Carney, D., Çetintemel, U., Rasin, A., Zdonik, S., Cherniack, M., Stonebraker, M.: Operator scheduling in a data stream manager. In: Proceedings of the 29th International Conference on Very Large Data Bases, VLDB 2003, vol. 29, pp. 838–849. VLDB Endowment (2003)

    Google Scholar 

  30. Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M.J., Hellerstein, J.M., Hong, W., Krishnamurthy, S., Madden, S., Raman, V., Reiss, F., Shah, M.A.: Telegraphcq: Continuous dataflow processing for an uncertain world. In: First Biennial Conference on Innovative Data Systems Research, CIDR 2003 (2003)

    Google Scholar 

  31. Chandrasekaran, S., Franklin, M.: Remembrance of streams past: overload-sensitive management of archived streams. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 348–359. VLDB Endowment (2004)

    Google Scholar 

  32. Chandrasekaran, S., Franklin, M.J.: Psoup: a system for streaming queries over streaming data. The VLDB Journal 12(2), 140–156 (2003)

    Article  Google Scholar 

  33. Chen, J., DeWitt, D.J., Naughton, J.F.: Design and evaluation of alternative selection placement strategies in optimizing continuous queries. In: Proceedings of the 18th International Conference on Data Engineering, ICDE 2002, Washington, DC, USA (2002)

    Google Scholar 

  34. Chen, J., DeWitt, D.J., Tian, F., Wang, Y.: NiagaraCQ: a scalable continuous query system for Internet databases. SIGMOD Rec. 29(2), 379–390 (2000)

    Article  Google Scholar 

  35. Cranor, C., Johnson, T., Spataschek, O., Shkapenyuk, V.: Gigascope: a stream database for network applications. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, SIGMOD 2003, pp. 647–651. ACM, New York (2003)

    Google Scholar 

  36. Das Sarma, A., Gollapudi, S., Panigrahy, R.: Estimating pagerank on graph streams. In: Proceedings of the Twenty-Seventh ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS 2008, pp. 69–78. ACM, New York (2008)

    Chapter  Google Scholar 

  37. Denny, M., Franklin, M.J.: Predicate result range caching for continuous queries. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, SIGMOD 2005, pp. 646–657. ACM, New York (2005)

    Google Scholar 

  38. Deshpande, A.: An initial study of overheads of eddies. SIGMOD Rec. 33(1), 44–49 (2004)

    Article  Google Scholar 

  39. Deshpande, A., Hellerstein, J.M.: Lifting the burden of history from adaptive query processing. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 948–959. VLDB Endowment (2004)

    Google Scholar 

  40. Deshpande, A., Ives, Z., Raman, V.: Adaptive query processing. Found. Trends Databases 1 (January 2007)

    Google Scholar 

  41. Dittrich, J.P., Seeger, B., Taylor, D.S., Widmayer, P.: Progressive merge join: a generic and non-blocking sort-based join algorithm. In: Proceedings of the 28th International Conference on Very Large Data Bases, VLDB 2002, pp. 299–310. VLDB Endowment (2002)

    Google Scholar 

  42. Dobra, A., Garofalakis, M.N., Gehrke, J., Rastogi, R.: Sketch-Based Multi-query Processing over Data Streams. In: Bertino, E., Christodoulakis, S., Plexousakis, D., Christophides, V., Koubarakis, M., Böhm, K. (eds.) EDBT 2004. LNCS, vol. 2992, pp. 551–568. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  43. Eckert, M., Bry, F., Brodt, S., Poppe, O., Hausmann, S.: A CEP Babelfish: Languages for Complex Event Processing and Querying Surveyed. In: Helmer, S., Poulovassilis, A., Xhafa, F. (eds.) Reasoning in Event-Based Distributed Systems. SCI, vol. 347, pp. 47–70. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  44. Eckert, M., Bry, F., Brodt, S., Poppe, O., Hausmann, S.: Two Semantics for CEP, no Double Talk: Complex Event Relational Algebra (CERA) and Its Application to XChangeEQ. In: Helmer, S., Poulovassilis, A., Xhafa, F. (eds.) Reasoning in Event-Based Distributed Systems. SCI, vol. 347, pp. 71–97. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  45. Folkert, N., Gupta, A., Witkowski, A., Subramanian, S., Bellamkonda, S., Shankar, S., Bozkaya, T., Sheng, L.: Optimizing refresh of a set of materialized views. In: Proceedings of the 31st International Conference on Very Large Data Bases, VLDB 2005, pp. 1043–1054. VLDB Endowment (2005)

    Google Scholar 

  46. Galpin, I., Brenninkmeijer, C.Y.A., Jabeen, F., Fernandes, A.A.A., Paton, N.W.: An architecture for query optimization in sensor networks. In: Proceedings of the 2008 IEEE 24th International Conference on Data Engineering, ICDE 2008, pp. 1439–1441. IEEE Computer Society, Washington, DC (2008)

    Google Scholar 

  47. Ganguly, S., Saha, B.: On Estimating Path Aggregates over Streaming Graphs. In: Asano, T. (ed.) ISAAC 2006. LNCS, vol. 4288, pp. 163–172. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  48. Ghanem, T.M., Elmagarmid, A.K., Larson, P.A., Aref, W.G.: Supporting views in data stream management systems. ACM Trans. Database Syst. 35(1), 1:1–1:47 (2008)

    Article  Google Scholar 

  49. Golab, L.: Sliding Window Query Processing over Data Streams. Ph.D. thesis, University of Waterloo, Waterloo, Ontario, Canada (2006), http://www.cs.uwaterloo.ca/research/tr/2006/CS-2006-27.pdf

  50. Golab, L., Garg, S., Özsu, M.T.: On Indexing Sliding Windows over Online Data Streams. In: Bertino, E., Christodoulakis, S., Plexousakis, D., Christophides, V., Koubarakis, M., Böhm, K. (eds.) EDBT 2004. LNCS, vol. 2992, pp. 712–729. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  51. Golab, L., Johnson, T., Spatscheck, O.: Prefilter: predicate pushdown at streaming speeds. In: Proceedings of the 2nd International Workshop on Scalable Stream Processing System, SSPS 2008, pp. 29–37. ACM, New York (2008)

    Google Scholar 

  52. Golab, L., Özsu, M.T.: Processing sliding window multi-joins in continuous queries over data streams. In: Proceedings of the 29th International Conference on Very Large Data Bases, VLDB 2003, vol. 29, pp. 500–511. VLDB Endowment (2003)

    Google Scholar 

  53. Golab, L., Özsu, M.T.: Update-pattern-aware modeling and processing of continuous queries. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, SIGMOD 2005, pp. 658–669. ACM, New York (2005)

    Google Scholar 

  54. Golab, L., Özsu, M.T.: Data stream management. Synthesis Lectures on Data Management, 1–73 (2010)

    Google Scholar 

  55. Golab, L., Prahladka, P., Ozsu, M.T.: Indexing time-evolving data with variable lifetimes. In: Proceedings of the 18th International Conference on Scientific and Statistical Database Management, SSDBM 2006, pp. 265–274. IEEE Computer Society, Washington, DC (2006)

    Google Scholar 

  56. Gounaris, A., Paton, N.W., Fernandes, A.A.A., Sakellariou, R.: Adaptive Query Processing: A Survey. In: Eaglestone, B., North, S.C., Poulovassilis, A. (eds.) BNCOD 2002. LNCS, vol. 2405, pp. 11–25. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  57. Gray, J., Chaudhuri, S., Bosworth, A., Layman, A., Reichart, D., Venkatrao, M., Pellow, F., Pirahesh, H.: Data cube: A relational aggregation operator generalizing group-by, cross-tab, and sub-totals. Data Min. Knowl. Discov. 1(1), 29–53 (1997)

    Article  Google Scholar 

  58. Gutierrez, C., Hurtado, C.A., Vaisman, A.: Introducing Time into RDF. IEEE Transactions on Knowledge and Data Engineering 19, 207–218 (2007)

    Article  Google Scholar 

  59. Haas, P.J., Hellerstein, J.M.: Ripple joins for online aggregation. SIGMOD Rec. 28, 287–298 (1999)

    Article  Google Scholar 

  60. Hammad, M., Aref, W.G., Franklin, M.J., Mokbel, M.F., Elmagarmid, A.K.: Efficient execution of sliding-window queries over data streams (2003)

    Google Scholar 

  61. Hammad, M.A., Aref, W.G., Elmagarmid, A.K.: Stream window join: tracking moving objects in sensor-network databases. In: Proceedings of the 15th International Conference on Scientific and Statistical Database Management, SSDBM 2003, pp. 75–84. IEEE Computer Society, Washington, DC (2003)

    Chapter  Google Scholar 

  62. Hammad, M.A., Aref, W.G., Elmagarmid, A.K.: Optimizing in-order execution of continuous queries over streamed sensor data. In: Proceedings of the 17th International Conference on Scientific and Statistical Database Management, SSDBM 2005, pp. 143–146. Lawrence Berkeley Laboratory, Berkeley (2005)

    Google Scholar 

  63. Harth, A., Umbrich, J., Hogan, A., Decker, S.: YARS2: A Federated Repository for Querying Graph Structured Data from the Web. In: Aberer, K., Choi, K.-S., Noy, N., Allemang, D., Lee, K.-I., Nixon, L.J.B., Golbeck, J., Mika, P., Maynard, D., Mizoguchi, R., Schreiber, G., Cudré-Mauroux, P. (eds.) ASWC 2007 and ISWC 2007. LNCS, vol. 4825, pp. 211–224. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  64. Hellerstein, J.M., Haas, P.J., Wang, H.J.: Online aggregation. SIGMOD Rec. 26(2), 171–182 (1997)

    Article  Google Scholar 

  65. Hoeksema, J., Kotoulas, S.: High-performance distributed stream reasoning using s4. In: Ordring Workshop at ISWC (2011), http://iswc2011.semanticweb.org/fileadmin/iswc/Papers/Workshops/OrdRing/paper_8.pdf

  66. Hong, W., Stonebraker, M.: Optimization of parallel query execution plans in xprs. Distrib. Parallel Databases 1(1), 9–32 (1993)

    Article  Google Scholar 

  67. Jiang, Q., Chakravarthy, S.: Queueing analysis of relational operators for continuous data streams. In: Proceedings of the Twelfth International Conference on Information and Knowledge Management, CIKM 2003, pp. 271–278. ACM, New York (2003)

    Chapter  Google Scholar 

  68. Jiang, Q., Chakravarthy, S., Williams, H., MacKinnon, L.: Scheduling Strategies for Processing Continuous Queries over Streams, pp. 16–30. Springer, Heidelberg (2004)

    Google Scholar 

  69. Johnson, T., Muthukrishnan, M.S., Shkapenyuk, V., Spatscheck, O.: Query-aware partitioning for monitoring massive network data streams. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, SIGMOD 2008, pp. 1135–1146. ACM, New York (2008)

    Chapter  Google Scholar 

  70. Kabra, N., DeWitt, D.J.: Efficient mid-query re-optimization of sub-optimal query execution plans. SIGMOD Rec. 27(2), 106–117 (1998)

    Article  Google Scholar 

  71. Kang, J., Naughton, J.F., Viglas, S.: Evaluating window joins over unbounded streams. In: Proceedings of the 19th International Conference on Data Engineering, ICDE 2003, pp. 341–352 (2003)

    Google Scholar 

  72. Kossmann, D.: The state of the art in distributed query processing. ACM Comput. Surv. 32(4), 422–469 (2000)

    Article  Google Scholar 

  73. Krämer, J., Seeger, B.: A temporal foundation for continuous queries over data streams. In: Proceedings of the Eleventh International Conference on Management of Data, COMAD 2005, pp. 70–82 (2005)

    Google Scholar 

  74. Krämer, J., Seeger, B.: Semantics and implementation of continuous sliding window queries over data streams. ACM Trans. Database Syst. 34(1), 4:1–4:49 (2009)

    Article  Google Scholar 

  75. Krishnamurthy, S., Franklin, M.J., Hellerstein, J.M., Jacobson, G.: The case for precision sharing. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 972–984. VLDB Endowment (2004)

    Google Scholar 

  76. Krishnamurthy, S., Wu, C., Franklin, M.: On-the-fly sharing for streamed aggregation. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, SIGMOD 2006, pp. 623–634. ACM, New York (2006)

    Chapter  Google Scholar 

  77. Law, Y.N., Wang, H., Zaniolo, C.: Query languages and data models for database sequences and data streams. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 492–503. VLDB Endowment (2004)

    Google Scholar 

  78. Lee, K.C.K., Leong, H.V., Si, A.: Quay: A data stream processing system using chunking. In: Proceedings of the International Database Engineering and Applications Symposium, IDEAS 2004, pp. 17–26. IEEE Computer Society, Washington, DC (2004)

    Chapter  Google Scholar 

  79. Li, J., Maier, D., Tufte, K., Papadimos, V., Tucker, P.A.: Semantics and evaluation techniques for window aggregates in data streams. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, SIGMOD 2005, pp. 311–322. ACM, New York (2005)

    Google Scholar 

  80. Li, J., Tufte, K., Shkapenyuk, V., Papadimos, V., Johnson, T., Maier, D.: Out-of-order processing: a new architecture for high-performance stream systems. Proc. VLDB Endow. 1(1), 274–288 (2008)

    Article  Google Scholar 

  81. Lim, H.S., Lee, J.G., Lee, M.J., Whang, K.Y., Song, I.Y.: Continuous query processing in data streams using duality of data and queries. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, SIGMOD 2006, New York, NY, USA, pp. 313–324 (2006)

    Google Scholar 

  82. Lin, X., Yuan, Y., Wang, W., Lu, H.: Stabbing the sky: Efficient skyline computation over sliding windows. In: Proceedings of the 21st International Conference on Data Engineering, ICDE 2005, pp. 502–513. IEEE Computer Society, Washington, DC (2005)

    Google Scholar 

  83. Liu, L., Pu, C., Tang, W.: Continual queries for internet scale event-driven information delivery. IEEE Trans. on Knowl. and Data Eng. 11(4), 610–628 (1999)

    Article  Google Scholar 

  84. Lopes, N., Polleres, A., Straccia, U., Zimmermann, A.: AnQL: SPARQLing Up Annotated RDFS. In: Patel-Schneider, P.F., Pan, Y., Hitzler, P., Mika, P., Zhang, L., Pan, J.Z., Horrocks, I., Glimm, B. (eds.) ISWC 2010, Part I. LNCS, vol. 6496, pp. 518–533. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  85. Luo, G., Naughton, J., Ellmann, C.: A non-blocking parallel spatial join algorithm. In: Proceedings of the 18th International Conference on Data Engineering, ICDE 2002, pp. 697–705 (2002)

    Google Scholar 

  86. Madden, S., Franklin, M.J.: Fjording the stream: An architecture for queries over streaming sensor data. In: Proceedings of the 18th International Conference on Data Engineering, ICDE 2002, pp. 555–566 (2002)

    Google Scholar 

  87. Madden, S., Shah, M., Hellerstein, J.M., Raman, V.: Continuously adaptive continuous queries over streams. In: 2002 ACM SIGMOD International Conference on Management of Data, pp. 49–60 (2002)

    Google Scholar 

  88. Mei, Y., Madden, S.: Zstream: a cost-based query processor for adaptively detecting composite events. In: Proceedings of the 35th SIGMOD International Conference on Management of Data, SIGMOD 2009, pp. 193–206. ACM, New York (2009)

    Google Scholar 

  89. Mokbel, M.F., Lu, M., Aref, W.G.: Hash-merge join: A non-blocking join algorithm for producing fast and early join results. In: Proceedings of the 20th International Conference on Data Engineering, ICDE 2004. IEEE Computer Society, Washington, DC (2004)

    Google Scholar 

  90. Mouratidis, K., Bakiras, S., Papadias, D.: Continuous monitoring of top-k queries over sliding windows. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, SIGMOD 2006, pp. 635–646. ACM, New York (2006)

    Chapter  Google Scholar 

  91. Neumann, T., Weikum, G.: The RDF-3X engine for scalable management of RDF data. The VLDB Journal 19(1), 91–113 (2010)

    Article  Google Scholar 

  92. Ou, Z., Yu, G., Yu, Y., Wu, S., Yang, X., Deng, Q.: Tick Scheduling: A Deadline Based Optimal Task Scheduling Approach for Real-Time Data Stream Systems. In: Fan, W., Wu, Z., Yang, J. (eds.) WAIM 2005. LNCS, vol. 3739, pp. 725–730. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  93. Pérez, J., Arenas, M., Gutierrez, C.: Semantics and complexity of sparql. ACM Trans. Database Syst. 34, 16:1–16:45 (2009)

    Article  Google Scholar 

  94. Le-Phuoc, D., Dao-Tran, M., Xavier Parreira, J., Hauswirth, M.: A Native and Adaptive Approach for Unified Processing of Linked Streams and Linked Data. In: Aroyo, L., Welty, C., Alani, H., Taylor, J., Bernstein, A., Kagal, L., Noy, N., Blomqvist, E. (eds.) ISWC 2011, Part I. LNCS, vol. 7031, pp. 370–388. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  95. Raman, V., Deshpande, A., Hellerstein, J.M.: Using state modules for adaptive query processing. In: Proceedings of the 19th International Conference on Data Engineering, ICDE 2003, pp. 353–364 (2003)

    Google Scholar 

  96. Schmidt, M., Hornung, T., Lausen, G., Pinkel, C.: Sp2bench: A sparql performance benchmark. In: Proceedings of the 25th International Conference on Data Engineering, ICDE 2009, pp. 222–233 (2009)

    Google Scholar 

  97. Schmidt, S., Berthold, H., Lehner, W.: Qstream: deterministic querying of data streams. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 1365–1368. VLDB Endowment (2004)

    Google Scholar 

  98. Schmidt, S., Legler, T., Schär, S., Lehner, W.: Robust real-time query processing with qstream. In: Proceedings of the 31st International Conference on Very Large Data Bases, VLDB 2005, pp. 1299–1301. VLDB Endowment (2005)

    Google Scholar 

  99. Sequeda, J.F., Corcho, O.: Linked stream data: A position paper. In: SSN 2009 (2009)

    Google Scholar 

  100. Seshadri, P., Livny, M., Ramakrishnan, R.: Seq: A model for sequence databases. In: Proceedings of the Eleventh International Conference on Data Engineering, ICDE 1995, Washington, DC, USA, pp. 232–239 (1995)

    Google Scholar 

  101. Sharaf, M.A., Chrysanthis, P.K., Labrinidis, A., Pruhs, K.: Algorithms and metrics for processing multiple heterogeneous continuous queries. ACM Trans. Database System 33(1), 5:1–5:44 (2008)

    Article  Google Scholar 

  102. Sharaf, M.A., Labrinidis, A., Chrysanthis, P.K., Pruhs, K.: Freshness-aware scheduling of continuous queries in the dynamic web. In: WebDB, pp. 73–78 (2005)

    Google Scholar 

  103. Sheth, A.P., Henson, C.A., Sahoo, S.S.: Semantic Sensor Web. IEEE Internet Computing 12(4), 78–83 (2008)

    Article  Google Scholar 

  104. Shivakumar, N., García-Molina, H.: Wave-indices: indexing evolving databases. In: Proceedings of the 1997 ACM SIGMOD International Conference on Management of Data, SIGMOD 1997, pp. 381–392. ACM, New York (1997)

    Chapter  Google Scholar 

  105. Smith, J.M., Chang, P.Y.T.: Optimizing the performance of a relational algebra database interface. Commun. ACM 18(10), 568–579 (1975)

    Article  MATH  Google Scholar 

  106. Srivastava, U., Widom, J.: Flexible time management in data stream systems. In: Proceedings of the Twenty-Third ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS 2004, pp. 263–274. ACM, New York (2004)

    Chapter  Google Scholar 

  107. Stuckenschmidt, H., Vdovjak, R., Houben, G.J., Broekstra, J.: Index structures and algorithms for querying distributed rdf repositories. In: WWW, pp. 631–639 (2004)

    Google Scholar 

  108. Sullivan, M., Heybey, A.: Tribeca: a system for managing large databases of network traffic. In: Proceedings of the Annual Conference on USENIX Annual Technical Conference, ATEC 1998, USENIX Association, Berkeley (1998)

    Google Scholar 

  109. Szomszor, M., Cattuto, C., Van den Broeck, W., Barrat, A., Alani, H.: Semantics, Sensors, and the Social Web: The Live Social Semantics Experiments. In: Aroyo, L., Antoniou, G., Hyvönen, E., ten Teije, A., Stuckenschmidt, H., Cabral, L., Tudorache, T. (eds.) ESWC 2010. LNCS, vol. 6089, pp. 196–210. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  110. Tao, Y., Papadias, D.: Maintaining sliding window skylines on data streams. IEEE Trans. on Knowl. and Data Eng. 18(3), 377–391 (2006)

    Article  Google Scholar 

  111. Tao, Y., Yiu, M.L., Papadias, D., Hadjieleftheriou, M., Mamoulis, N.: Rpj: producing fast join results on streams through rate-based optimization. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, SIGMOD 2005, pp. 371–382. ACM, New York (2005)

    Google Scholar 

  112. Tian, F., DeWitt, D.J.: Tuple routing strategies for distributed eddies. In: Proceedings of the 29th International Conference on Very Large Data Bases, VLDB 2003, vol. 29, pp. 333–344. VLDB Endowment (2003)

    Google Scholar 

  113. Tok, W.H., Bressan, S.: Efficient and Adaptive Processing of Multiple Continuous Queries. In: Jensen, C.S., Jeffery, K., Pokorný, J., Šaltenis, S., Bertino, E., Böhm, K., Jarke, M. (eds.) EDBT 2002. LNCS, vol. 2287, pp. 215–232. Springer, Heidelberg (2002), http://dl.acm.org/citation.cfm?id=645340.650211

    Chapter  Google Scholar 

  114. Tucker, P.A., Maier, D., Sheard, T., Fegaras, L.: Exploiting punctuation semantics in continuous data streams. IEEE Transactions on Knowledge and Data Engineering 15, 555–568 (2003)

    Article  Google Scholar 

  115. Umbrich, J., Karnstedt, M., Land, S.: Towards understanding the changing web: Mining the dynamics of linked-data sources and entities. In: KDML, Workshop (2010)

    Google Scholar 

  116. Urhan, T., Franklin, M.J.: Xjoin: A reactively-scheduled pipelined join operator. IEEE Data Eng. Bull. 23(2), 27–33 (2000)

    Google Scholar 

  117. Urhan, T., Franklin, M.J.: Dynamic pipeline scheduling for improving interactive query performance. In: Proceedings of the 27th International Conference on Very Large Data Bases, VLDB 2001, pp. 501–510. Morgan Kaufmann Publishers Inc., San Francisco (2001)

    Google Scholar 

  118. Urhan, T., Franklin, M.J., Amsaleg, L.: Cost-based query scrambling for initial delays. In: Proceedings of the 1998 ACM SIGMOD International Conference on Management of Data, SIGMOD 1998, pp. 130–141. ACM, New York (1998)

    Chapter  Google Scholar 

  119. Viglas, S.D., Naughton, J.F.: Rate-based query optimization for streaming information sources. In: Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data, SIGMOD 2002, pp. 37–48. ACM, New York (2002)

    Google Scholar 

  120. Viglas, S.D., Naughton, J.F., Burger, J.: Maximizing the output rate of multi-way join queries over streaming information sources. In: Proceedings of the 29th International Conference on Very Large Data Bases, VLDB 2003, vol. 29, pp. 285–296. VLDB Endowment (2003)

    Google Scholar 

  121. Vossough, E., Getta, J.R.: Processing of Continuous Queries over Unlimited Data Streams. In: Hameurlain, A., Cicchetti, R., Traunmüller, R. (eds.) DEXA 2002. LNCS, vol. 2453, pp. 799–809. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  122. Wang, H., Zaniolo, C., Luo, C.R.: Atlas: a small but complete sql extension for data mining and data streams. In: Proceedings of the 29th International Conference on Very Large Data Bases, VLDB 2003, vol. 29, pp. 1113–1116. VLDB Endowment (2003)

    Google Scholar 

  123. Wang, S., Rundensteiner, E., Ganguly, S., Bhatnagar, S.: State-slice: new paradigm of multi-query optimization of window-based stream queries. In: Proceedings of the 32nd International Conference on Very Large Data Bases, VLDB 2006, pp. 619–630. VLDB Endowment (2006)

    Google Scholar 

  124. Wang, W., Li, J., Zhang, D., Guo, L.: Processing Sliding Window Join Aggregate in Continuous Queries over Data Streams. In: Benczúr, A.A., Demetrovics, J., Gottlob, G. (eds.) ADBIS 2004. LNCS, vol. 3255, pp. 348–363. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  125. Weiss, C., Karras, P., Bernstein, A.: Hexastore: sextuple indexing for semantic web data management. Proc. VLDB Endow. 1(1), 1008–1019 (2008)

    Article  Google Scholar 

  126. Whitehouse, K., Zhao, F., Liu, J.: Semantic Streams: A Framework for Composable Semantic Interpretation of Sensor Data. In: Römer, K., Karl, H., Mattern, F. (eds.) EWSN 2006. LNCS, vol. 3868, pp. 5–20. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  127. Wilschut, A.N., Apers, P.M.G.: Dataflow query execution in a parallel main-memory environment. In: Proceedings of the First International Conference on Parallel and Distributed Information Systems, PDIS 1991, pp. 68–77. IEEE Computer Society Press, Los Alamitos (1991)

    Chapter  Google Scholar 

  128. Wilschut, A.N., Apers, P.M.G.: Dataflow query execution in a parallel main-memory environment. Distrib. Parallel Databases 1(1), 103–128 (1993)

    Article  Google Scholar 

  129. Wu, E., Diao, Y., Rizvi, S.: High-performance complex event processing over streams. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, SIGMOD 2006, pp. 407–418. ACM, New York (2006)

    Chapter  Google Scholar 

  130. Wu, K.L., Chen, S.K., Yu, P.S.: Interval query indexing for efficient stream processing. In: Proceedings of the Thirteenth ACM International Conference on Information and Knowledge Management, CIKM 2004, pp. 88–97. ACM, New York (2004)

    Chapter  Google Scholar 

  131. Zhang, D., Li, J., Zhang, Z., Wang, W., Guo, L.: Dynamic Adjustment of Sliding Windows over Data Streams. In: Li, Q., Wang, G., Feng, L. (eds.) WAIM 2004. LNCS, vol. 3129, pp. 24–33. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  132. Zhang, R., Koudas, N., Ooi, B.C., Srivastava, D.: Multiple aggregations over data streams. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, SIGMOD 2005, pp. 299–310. ACM, New York (2005)

    Google Scholar 

  133. Zhao, P., Aggarwal, C.C., Wang, M.: gsketch: on query estimation in graph streams. Proc. VLDB Endow. 5(3), 193–204 (2011)

    Article  Google Scholar 

  134. Zhu, Y., Rundensteiner, E.A., Heineman, G.T.: Dynamic plan migration for continuous queries over data streams. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, SIGMOD 2004, pp. 431–442. ACM, New York (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Digital Enterprise Research Institute, National University of Ireland, Galway, Ireland

    Danh Le-Phuoc, Josiane Xavier Parreira & Manfred Hauswirth

Authors
  1. Danh Le-Phuoc
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Josiane Xavier Parreira
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Manfred Hauswirth
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Information Systems, Knowledge-Based Systems Group, Vienna University of Technology, Favoritenstraße 9–11/1843, A-1040, Vienna, Austria

    Thomas Eiter  & Thomas Krennwallner  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Le-Phuoc, D., Xavier Parreira, J., Hauswirth, M. (2012). Linked Stream Data Processing. In: Eiter, T., Krennwallner, T. (eds) Reasoning Web. Semantic Technologies for Advanced Query Answering. Reasoning Web 2012. Lecture Notes in Computer Science, vol 7487. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33158-9_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33158-9_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33157-2

  • Online ISBN: 978-3-642-33158-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation