Advertisement

High-Performance Grids and Clusters

  • Pethuru Raj
  • Anupama Raman
  • Dhivya Nagaraj
  • Siddhartha Duggirala
Chapter
Part of the Computer Communications and Networks book series (CCN)

Abstract

Data is generated exponentially. And data is used to identify and understand people, things, physical principles, etc. But with this much comes the problem of how to crunch the data to get our insights. With the traditional monolithic environment, crunching this huge volume will take hours and days, billing us some million dollars. But with the principle of dividing the job into smaller tasks and distributing the jobs between different computers which are interconnected, this insight could be reached within minutes to hours, costing us just a fraction of the amount. The scope of clusters and grids is vastly different. The clusters are generally employed with the locally interconnected systems, whereas grids are employed at a much wider and distributed scale. In this chapter we will learn more about these two interconnected paradigms and study some use cases.

Keywords

Graphic Processing Unit Grid Computing Message Passing Interface Grid Environment Grid Service 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Udoh E (ed) (2011) Cloud, grid and high performance computing: emerging applications. IGI Global, HersheyGoogle Scholar
  2. 2.
    Open MPI: open source high performance computing. Retrieved August 14, 2014, from http://www.open-mpi.org
  3. 3.
    Sunderam VS (1990) PVM: a framework for parallel distributed computing [Journal]. Concurrency Exp 2(4):315–339Google Scholar
  4. 4.
    Apache Hadoop Introduction (2013) Retrieved October 5, 2014, from http://www.hadoop.apache.org
  5. 5.
    Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters [Conference]. In: Symposium on operating systems design and implementationGoogle Scholar
  6. 6.
    Facebook Engineering Blog. Retrieved September 5, 2014, from https://code.facebook.com/posts/
  7. 7.
    Borthakur D, Gray J (2011) Apache hadoop goes real-time at facebook [Conference], SIGMOD. ACM, AthensGoogle Scholar
  8. 8.
    Kindratenko VV et al (2009) GPU clusters for high-performance computing [Conference]. In: IEEE cluster computing and workshops. IEEE, New OrleansGoogle Scholar
  9. 9.
    RCUDA Documentation. Retrieved September 5, 2014, from http://www.rcuda.net/
  10. 10.
    Magoulès F, Pan J, Tan KA, Kumar A (2009) Introduction to grid computing. CRC Press, Boca RatonzbMATHGoogle Scholar
  11. 11.
    Foster I, Kesselman C. The grid 2: blueprint for a new computing infrastructure [Book]. [s.l.]. ElsevierGoogle Scholar
  12. 12.
    Baker M, Buyya R, Laforenza D (2002) Grids and grid technologies for wide‐area distributed computing. Softw Pract Exper 32(15):1437–1466zbMATHCrossRefGoogle Scholar
  13. 13.
    Pallmann D (2009) Grid computing on the Azure cloud computing platform, part 1. Retrieved September 5, 2014, from http://www.infoq.com/articles/Grid-Azure-David-Pallmann
  14. 14.
    Foster I, Kesselman C, Steven T (2001) The anatomy of the grid: enabling scalable virtual organizations [Conference]. In: First IEEE/ACM international symposium on cluster computing and the grid. [s.l.] IEEEGoogle Scholar
  15. 15.
    Anderson DP (2004) BOINC: A System for public resource computing and storage [Conference]. In: 5th IEEE/ACM international workshop on grid computing, Pittsburgh, USA [s.n.]Google Scholar
  16. 16.
  17. 17.
    Preve N (2011) Computational and data grids: principles, applications and design [Book]. [s.l.]. IGI GlobalGoogle Scholar
  18. 18.
    Out Scale (2014) In-memory data grid technology [Online]. Scaleout software: in memory data grids for the enterpriseGoogle Scholar
  19. 19.
    Grid Gain Hadoop Accelarator. (2014). Retrieved September 5, 2014. http://gridgain.com/

Further Reading

  1. Pearce SE, Venters W (2012) How particle physicists constructed the world’s largest grid: a case study in participatory cultures. The Routledge Handbook of Participatory CulturesGoogle Scholar
  2. Wilkinson B (2011) Grid computing: techniques and applications. CRC Press, Boca RatonGoogle Scholar
  3. Kirk DB, Wen-mei WH (2012) Programming massively parallel processors: a hands-on approach. NewnesGoogle Scholar
  4. Kahanwal D, Singh DT (2013) The distributed computing paradigms: P2P, grid, cluster, cloud, and jungle. arXiv preprint arXiv:1311.3070Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Pethuru Raj
    • 1
  • Anupama Raman
    • 1
  • Dhivya Nagaraj
    • 1
  • Siddhartha Duggirala
    • 2
  1. 1.IBM IndiaBangaloreIndia
  2. 2.Indian Institute of TechnologyIndoreIndia

Personalised recommendations