Evolution of Clustering and Parallel Computing

  • Andriy Luntovskyy
  • Josef Spillner


The parallel execution of code within applications is a standard feature for higher performance, responsiveness, or both. Parallel code, the building block for parallel computing, is achieved by multiple processes, multiple threads, co-routines and similar programming techniques. Typically, parallel code is assisted by hardware such as multiple processors per node or multiple processor cores per processor (virtual processors), and otherwise by the operating system’s process scheduler (pseudoparallelism).


Clusters Grids Performance parameters High-Performance Computing ( → HPCSpeedup models Amdahl model Barsis-Gustafson model Karp-Flatt metric Berkeley Open Infrastructure for Network Computing ( → BOINC


  1. 1.
    Joel C. Adams, Jacob Caswell, Suzanne J. Matthews, Charles Peck, Elizabeth Shoop and David Toth. Budget Beowulfs: A Showcase of Inexpensive Clusters for Teaching PDC. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (SIGCSE), p. 344–345, Kansas City, Missouri, USA, March 2015.Google Scholar
  2. 2.
    F. Bonomi, R. Milito, J. Zhu, and S. Addepalli. Fog Computing and Its Role in the Internet of Things. CISCO whitepaper, 2007.Google Scholar
  3. 3.
    Francisco Brasileiro, Alexandre Duarte, Diego Carvalho, Roberto Barbera, and Diego Scardaci. An Approach for the Co-existence of Service and Opportunistic Grids: The EELA-2 Case. In Latin-American Grid Workshop, Campo Grande, Mato Grosso do Sul, Brazil, October/November 2008.Google Scholar
  4. 4.
    Mario Cannataro. Clusters and Grids for Distributed and Parallel Knowledge Discovery. In High Performance Computing and Networking: 8th International Conference (HPCN) Europe, volume 1823 of Lecture Notes in Computer Science, p. 708–716, Amsterdam, The Netherlands, May 2000.Google Scholar
  5. 5.
    Walfredo Cirne, Francisco Brasileiro, Nazareno Andrade, Lauro Costa, Alisson Andrade, Reynaldo Novaes, and Miranda Mowbray. Labs of the World, Unite!!! Journal of Grid Computing, 4(3):225–246, 2006.CrossRefMATHGoogle Scholar
  6. 6.
    Jeff Dean. Designs, Lessons and Advice from Building Large Distributed Systems. In 3rd ACM SIGOPS International Workshop on Large Scale Distributed Systems and Middleware (LADIS), Big Sky, Montana, USA, October 2009.Google Scholar
  7. 7.
    Javier Fabra, Sergio Hernández, Joaquín Ezpeleta, and Pedro Álvarez. Solving the Interoperability Problem by Means of a Bus: An Experience on the Integration of Grid, Cluster and Cloud Infrastructures. Journal of Grid Computing, 12(1):41–65, March 2014.Google Scholar
  8. 8.
    Björn Gmeiner, Harald Köstler, Markus Stürmer, and Ulrich Rüde. Parallel multigrid on hierarchical hybrid grids: a performance study on current high performance computing clusters. Concurrency and Computation: Practice and Experience, 26(1):217–240, January 2014.Google Scholar
  9. 9.
    John L. Gustafson. Reevaluating Amdahl’s Law. Communications of the ACM, 31(5):532–533, 1988.CrossRefGoogle Scholar
  10. 10.
    Violeta Holmes and Ibad Kureshi. Developing High Performance Computing Resources for Teaching Cluster and Grid Computing Courses. In International Conference On Computational Science, ICCS – Computational Science at the Gates of Nature, volume 51 of Procedia Computer Science, p. 1714–1723, Reykjavik, Iceland, June 2015.Google Scholar
  11. 11.
    A. H. Karp and H. P. Flatt. Measuring Parallel Processor Performance. Communications of the ACM, 33(5):539–543, 1990.CrossRefGoogle Scholar
  12. 12.
    Andrew Leaver-Fay, Michael Tyka, Steven M. Lewis, Oliver F. Lange, James Thompson, Ron Jacak, Kristian Kaufman, P. Douglas Renfrew, Colin A. Smith, Will Sheffler, Ian W. Davis, Seth Cooper, Adrien Treuille, Daniel J. Mandell, Florian Richter, Yih-En Andrew Ban, Sarel J. Fleishman, Jacob E. Corn, David E. Kim, Sergey Lyskov, Monica Berrondo, Stuart Mentzer, Zoran Popović, James J. Havranek, John Karanicolas, Rhiju Das, Jens Meiler, Tanja Kortemme, Jeffrey J. Gray, Brian Kuhlman, David Baker, and Philip Bradley. ROSETTA3: an object-oriented software suite for the simulation and design of macromolecules. Methods in enzymology, 487:545–574, 2011.Google Scholar
  13. 13.
    Linkfeed. Vom Sand zum Prozessor. online, in German:, 2015.
  14. 14.
    Seyedeh Leili Mirtaheri, Ehsan Mousavi Khaneghah, Lucio Grandinetti, and Mohsen Sharifi. A mathematical model for empowerment of Beowulf clusters for exascale computing. In International Conference on High Performance Computing & Simulation (HPCS), p. 682–687, Helsinki, Finland, July 2013.Google Scholar
  15. 15.
    Wolfgang Nagel and Ulf Markwardt. High Performance Computing (HPC) at ZIH: HPC Systems, Technische Universität Dresden. online:˙tu˙dresden/zentrale˙einrichtungen/zih/hpc/hochleistungsrechner, 2015.
  16. 16.
    Christian Ulrik Søttrup Nicolas Maire. BOINC II. Niels Bohr Institute (Copenhagen, Denmark)/Swiss Tropical and Public Health Institute (Basel, Switzerland), 2014. 42p.Google Scholar
  17. 17.
    Jong Hyuk Park, Laurence T. Yang, and Jinjun Chen. Research trends in cloud, cluster and grid computing. Cluster Computing, 16(3):335–337, 2013.Google Scholar
  18. 18.
    A. I. Petrenko. The application of grid technologies in science and education. NTUU “KPI” Kyiv, 2008. 143 p.; in Ukrainian.Google Scholar
  19. 19.
    A. I. Petrenko, B. V. Bulakh, and V. S. Khondar. Semantic grid technologies for science and education. NTUU “KPI” Kyiv, 2010. 178 p.; in Ukrainian.Google Scholar
  20. 20.
    A. I. Petrenko, S. Ya. Svistunov, and G. D. Kiselev. Grid Technologies Practical Course. NTUU “KPI” Kyiv, 2011. 448 p.; in Ukrainian.Google Scholar
  21. 21.
    Wolfgang Rehm and Arnd Meyer. TU Chemnitz HPC Cluster: CLiC/CHiC. online:, 2015.
  22. 22.
    Alexander Schill and Thomas Springer. Verteilte Systeme – Grundlagen und Basistechnologien. Springer-Verlag, second edition, 2012. 433 p.; in German.Google Scholar
  23. 23.
    Volkmar Sieh. Performance metrics. online:, 2012.
  24. 24.
    Larry Smarr and Charles E. Catlett. Metacomputing. Communications of the ACM, 35(6):44–52, June 1992.Google Scholar
  25. 25.
    Erich Strohmaier, Jack Dongarra, Horst Simon, and Martin Meuer. The 45th TOP500 List. online:, June 2015.
  26. 26.
    Andrew S. Tanenbaum and David J. Wetherall. Computernetzwerke. Pearson Studium, fifth edition, 2012. 1040 p.; in German.Google Scholar
  27. 27.
    R. van Kranenburg. The Internet of Things: A critique of ambient technology and the all-seeing network of RFID. Pijnacker: Telstar Media, 2008. 62 p.Google Scholar
  28. 28.
    Ádám Visegrádi, József Kovács, and Peter Kacsuk. Efficient extension of gLite VOs with BOINC based desktop grids, 2014.Google Scholar

Copyright information

© Springer Fachmedien Wiesbaden GmbH 2017

Authors and Affiliations

  1. 1.Berufsakademie SachsenDresdenGermany
  2. 2.Service Prototyping LabZürcher Hochschule für Angewandte WissenschaftenWinterthurSwitzerland

Personalised recommendations