Skip to main content
SpringerLink
Log in
Book cover

Encyclopedia of Database Systems pp 3772–3776Cite as

Stream Processing on Modern Hardware

  • Reference work entry
  • First Online:

  • 31 Accesses

Definition

Stream processing is a computational paradigm for on-the-fly analysis of live data at scale. Given the ever-increasing number of online data sources, rate of streaming data, and growing demand for timely analysis, stream processing has gained an important place in today’s data-driven solution architectures. A key feature of the stream processing paradigm is its amenability to parallel execution, which in turn makes stream processing an attractive domain for taking advantage of modern hardware.

To cope with the increased power consumption associated with frequency scaling, hardware manufacturers have moved toward processors and coprocessors that contain multiple cores. Such designs can provide increased computational capacity without having to work at high frequencies and thus do not suffer from high power consumption. Yet, taking advantage of such hardware requires additional effort on the software side.

In the context of stream processing systems, three major kinds of...

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   4,499.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   6,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Recommended Reading

  1. Carney D, Çetintemel U, Cherniack M, Convey C, Lee S, Seidman G, Stonebraker M, Tatbul N, Zdonik BS. Monitoring streams – a new class of data management applications. In: Proceedings of the Very Large Data Bases Conference; 2002. p. 215–26.

    Google Scholar 

  2. Cugola G, Margara A. Low latency complex event processing on parallel hardware. J Parallel Distrib Comput(JPDC). 2012;72(2):205–18.

    Article  Google Scholar 

  3. Gedik B, Schneider S, Hirzel M, Wu K-L. Elastic scaling for data stream processing. IEEE Trans Parallel Distrib Syst (TPDS). 2014;25(6):1447–63.

    Article  Google Scholar 

  4. Gordon MI, Thies W, Amarasinghe S. Exploiting coarse-grained task, data, and pipeline parallelism in stream programs. In: Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems; 2006. p. 151–62.

    Google Scholar 

  5. Hormati A, Kudlur M, Mahlke SA, Bacon DF, Rabbah MR. Optimus: efficient realization of streaming applications on FPGAs. In: Proceedings of the International Conference on Compilers, Architecture, and Synthesis for Embedded Systems; 2008. p. 41–50.

    Google Scholar 

  6. Karger D, Sherman A, Berkheimer A, Bogstad B, Dhanidina R. Web caching with consistent hashing. Comput Netw. 1999;31(11):1203–13.

    Article  Google Scholar 

  7. Karnagel T, Habich D, Schlegel B, Lehner W, The HELLS-join: a heterogeneous stream join for extremely large windows. In: Proceedings of the 9th Workshop on Data Management on New Hardware; 2013.

    Google Scholar 

  8. Lee EA, Messerschmitt GD. Synchronous data flow. Proc IEEE. 1987;75(9):1235–45.

    Article  Google Scholar 

  9. Müller R, Teubner J, Alonso G. Data processing on FPGAs. Proc VLDB Endow. 2009;2(1):910–21.

    Article  Google Scholar 

  10. Müller R, Teubner J, Alonso G, Streams on wires – a query compiler for FPGAs. Proc VLDB Endow. 2009;21(1):229–40.

    Article  Google Scholar 

  11. Sadoghi M, Javed R, Tarafdar N, Singh H, Palaniappan R, Jacobsen H-A. Multi-query stream processing on FPGAs. In: Proceedings of the 28th International Conference on Data Engineering; 2012. p. 1229–32.

    Google Scholar 

  12. Schneider S, Andrade H, Gedik B, Wu K-L, Nikolopoulos D. Evaluation of streaming aggregation on parallel hardware architectures. In: Proceedings of the 4th ACM International Conference on Distributed Event-based Systems; 2010. p. 248–57.

    Google Scholar 

  13. Tang Y, Gedik B. Auto-pipelining for data stream processing. IEEE Trans Parallel Distrib Syst (TPDS). 2013; 24(12):2344–54.

    Article  Google Scholar 

  14. Udupa A, Govindarajan R, Thazhuthaveetil JM. Software pipelined execution of stream programs on GPUs. In: Proceedings of the IEEE/ACM International Symposium on Code Generation and Optimization; 2009. p. 200–9.

    Google Scholar 

  15. Zhang Y, Mueller F. GStream: a general-purpose data streaming framework on GPU clusters. In: Proceedings of the 2011 International Conference on Parallel Processing; 2011. p. 245–54.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Bilkent University, Ankara, Turkey

    Buğra Gedik

  2. IBM T.J. Watson Research Center, Hawthorne, NY, USA

    Buğra Gedik

Authors
  1. Buğra Gedik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Buğra Gedik .

Editor information

Editors and Affiliations

  1. Georgia Institute of Technology College of Computing, Atlanta, GA, USA

    Ling Liu

  2. University of Waterloo School of Computer Science, Waterloo, ON, Canada

    M. Tamer Özsu

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Science+Business Media, LLC, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Gedik, B. (2018). Stream Processing on Modern Hardware. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_80758

Download citation

Publish with us

Policies and ethics

Search

Navigation