Skip to main content

High-Performance Grids and Clusters

  • Chapter
  • 3194 Accesses

Part of the book series: Computer Communications and Networks ((CCN))

Abstract

Data is generated exponentially. And data is used to identify and understand people, things, physical principles, etc. But with this much comes the problem of how to crunch the data to get our insights. With the traditional monolithic environment, crunching this huge volume will take hours and days, billing us some million dollars. But with the principle of dividing the job into smaller tasks and distributing the jobs between different computers which are interconnected, this insight could be reached within minutes to hours, costing us just a fraction of the amount. The scope of clusters and grids is vastly different. The clusters are generally employed with the locally interconnected systems, whereas grids are employed at a much wider and distributed scale. In this chapter we will learn more about these two interconnected paradigms and study some use cases.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Udoh E (ed) (2011) Cloud, grid and high performance computing: emerging applications. IGI Global, Hershey

    Google Scholar 

  2. Open MPI: open source high performance computing. Retrieved August 14, 2014, from http://www.open-mpi.org

  3. Sunderam VS (1990) PVM: a framework for parallel distributed computing [Journal]. Concurrency Exp 2(4):315–339

    Google Scholar 

  4. Apache Hadoop Introduction (2013) Retrieved October 5, 2014, from http://www.hadoop.apache.org

  5. Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters [Conference]. In: Symposium on operating systems design and implementation

    Google Scholar 

  6. Facebook Engineering Blog. Retrieved September 5, 2014, from https://code.facebook.com/posts/

  7. Borthakur D, Gray J (2011) Apache hadoop goes real-time at facebook [Conference], SIGMOD. ACM, Athens

    Google Scholar 

  8. Kindratenko VV et al (2009) GPU clusters for high-performance computing [Conference]. In: IEEE cluster computing and workshops. IEEE, New Orleans

    Google Scholar 

  9. RCUDA Documentation. Retrieved September 5, 2014, from http://www.rcuda.net/

  10. Magoulès F, Pan J, Tan KA, Kumar A (2009) Introduction to grid computing. CRC Press, Boca Raton

    MATH  Google Scholar 

  11. Foster I, Kesselman C. The grid 2: blueprint for a new computing infrastructure [Book]. [s.l.]. Elsevier

    Google Scholar 

  12. Baker M, Buyya R, Laforenza D (2002) Grids and grid technologies for wide‐area distributed computing. Softw Pract Exper 32(15):1437–1466

    Article  MATH  Google Scholar 

  13. Pallmann D (2009) Grid computing on the Azure cloud computing platform, part 1. Retrieved September 5, 2014, from http://www.infoq.com/articles/Grid-Azure-David-Pallmann

  14. Foster I, Kesselman C, Steven T (2001) The anatomy of the grid: enabling scalable virtual organizations [Conference]. In: First IEEE/ACM international symposium on cluster computing and the grid. [s.l.] IEEE

    Google Scholar 

  15. Anderson DP (2004) BOINC: A System for public resource computing and storage [Conference]. In: 5th IEEE/ACM international workshop on grid computing, Pittsburgh, USA [s.n.]

    Google Scholar 

  16. Globus (2014) Open grid services architecture Globus Toolkit Documentation. Retrieved September 5, 2014, from http://toolkit.globus.org/toolkit/docs/6.0/

  17. Preve N (2011) Computational and data grids: principles, applications and design [Book]. [s.l.]. IGI Global

    Google Scholar 

  18. Out Scale (2014) In-memory data grid technology [Online]. Scaleout software: in memory data grids for the enterprise

    Google Scholar 

  19. Grid Gain Hadoop Accelarator. (2014). Retrieved September 5, 2014. http://gridgain.com/

Further Reading

  • Pearce SE, Venters W (2012) How particle physicists constructed the world’s largest grid: a case study in participatory cultures. The Routledge Handbook of Participatory Cultures

    Google Scholar 

  • Wilkinson B (2011) Grid computing: techniques and applications. CRC Press, Boca Raton

    Google Scholar 

  • Kirk DB, Wen-mei WH (2012) Programming massively parallel processors: a hands-on approach. Newnes

    Google Scholar 

  • Kahanwal D, Singh DT (2013) The distributed computing paradigms: P2P, grid, cluster, cloud, and jungle. arXiv preprint arXiv:1311.3070

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Raj, P., Raman, A., Nagaraj, D., Duggirala, S. (2015). High-Performance Grids and Clusters. In: High-Performance Big-Data Analytics. Computer Communications and Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-20744-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20744-5_10

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20743-8

  • Online ISBN: 978-3-319-20744-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics