Skip to main content

High Performance Computing and High Performance Data Analytics—What is the Missing Link?

  • Conference paper
  • First Online:
Sustained Simulation Performance 2016

Abstract

Within this book chapter, technologies for data mining, data processing and data interpreting are introduced, evaluated and compared. Especially, traditional High Performance Computing, and the newly emerging fields High Performance Data Analytics and Cognitive Computing are put into context in order to understand their strengths and weaknesses. However, the technologies have not been evaluated solely, but also the missing links between them have been identified and described.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Top500: http://www.top500.org

  2. 2.

    Apache Spark: http://spark.apache.org

  3. 3.

    Apache Hadoop: http://hadoop.apache.org

  4. 4.

    Apache Storm: http://storm.apache.org

  5. 5.

    Apache Flink: http://flink.apache.org

  6. 6.

    DiscoProject: http://www.discoproject.org

  7. 7.

    DataTorrent RTS: https://www.datatorrent.com

  8. 8.

    BashReduce: https://github.com/erikfrey/bashreduce

  9. 9.

    Google Inc.: http://www.google.com

  10. 10.

    Centre of excellence for Global Systems Science: http://www.coegss.eu

  11. 11.

    Wikipedia Definition of Cognitive Computing: https://en.wikipedia.org/wiki/Cognitive_computing

  12. 12.

    http://www.predictiveanalyticstoday.com/ibm-watson-analytics-beta-open-business/

  13. 13.

    http://uima.apache.org/

  14. 14.

    https://www.oasis-open.org/committees/download.php/28492/uima-spec-wd-05.pdf

References

  1. Wolf, S., Paolotti, D., Tizzoni, M., Edwards, M., Fuerst, S., Geiges, A., Ireland, A., Schuetze, F., Steudle, G.: D4.1 - First report on pilot requirements. http://coegss.eu/wp-content/uploads/2016/03/CoeGSS_D4_1.pdf

  2. Boole, G.: Investigation of the Laws of Thought on Which are Founded the Mathematical Theories of Logic and Probabilities (1853)

    Google Scholar 

  3. Ferrucci, D.A., Brown, E.W., Chu-Carroll, J., Fan, J., Gondek, D., Kalyanpur, A., Lally, A., Murdock, J.W., Nyberg, E., Prager, J.M., Schlaefer, N., Welty, C.A.: Building Watson: an overview of the DeepQA project. AI Mag. 31(3), 59–79 (2010)

    Google Scholar 

  4. Silver, D., Hassabis, D.: AlphaGo: mastering the ancient game of Go with Machine Learning, Blogpost. https://research.googleblog.com/2016/01/alphago-mastering-ancient-game-of-go.html (2016)

  5. Niu, F., Zhang, C., Re, C., Shavlik, J.W.: DeepDive: web-scale knowledge-base construction using statistical learning and inference. 884. In: VLDS: CEUR-WS.org. (CEUR Workshop Proceedings), pp. 25–28 (2012)

    Google Scholar 

  6. Zhang, C.: DeepDive: a data management system for automatic knowledge base construction, Ph.D. Dissertation, University of Wisconsin-Madison (2015)

    Google Scholar 

  7. Hart, D., Goertzel, B.: OpenCog: a software framework for integrative artificial general intelligence. In: Wang, P., Goertzel, B., Franklin, S. (eds.) ’AGI’, pp. 468–472. IOS Press (2008)

    Google Scholar 

  8. Goertzel, B.: OpenCog Prime: a cognitive synerfy based architecture for artificial general intelligence

    Google Scholar 

  9. Hurwitz, J.S., Kaufman, M., Bowles, A.: Cognitive Computing and Big Data Analytics. Wiley, Indianapolis (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bastian Koller .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Koller, B., Gienger, M., Resch, M.M. (2016). High Performance Computing and High Performance Data Analytics—What is the Missing Link?. In: Resch, M., Bez, W., Focht, E., Patel, N., Kobayashi, H. (eds) Sustained Simulation Performance 2016. Springer, Cham. https://doi.org/10.1007/978-3-319-46735-1_2

Download citation

Publish with us

Policies and ethics