Skip to main content
SpringerLink
Log in

Resource Management for Hybrid Grid and Cloud Computing

  • Chapter
  • First Online:
Cloud Computing

Part of the book series: Computer Communications and Networks ((CCN))

Abstract

From its start of using supercomputers, scientific computing constantly evolved to the next levels such as cluster computing, meta-computing, or computational Grids. Today, Cloud Computing is emerging as the paradigm for the next generation of large-scale scientific computing, eliminating the need for hosting expensive computing hardware. Scientists still have their Grid environments in place and can benefit from extending them using leased Cloud resources whenever needed. This paradigm shift opens new problems that need to be analyzed, such as integration of this new resource class into existing environments, applications on the resources, and security. The virtualization overheads for deployment and starting of a virtual machine image are new factors, which will need to be considered when choosing scheduling mechanisms. In this chapter, we investigate the usability of compute Clouds to extend a Grid workflow middleware and show on a real implementation that this can speed up executions of scientific workflows.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Using the Linpack benchmark results for the different Cloud instance types, as shown in Table 11.6.

  2. 2.

    Some Cloud providers [19] require the configuration of virtual private networks (VLAN) to authenticate with the Cloud that requires the automatic creation of SSH tunnels using port forwarding; we plan to explore this in future work.

References

  1. Iosup A, Dumitrescu C, Epema D, Li H, Wolters L (2006) How are real grids used? The analysis of four grid traces and its implications. In international conference on grid computing, IEEE Computer Society, pp 262–269

    Google Scholar 

  2. Costa GD, Dikaiakos MD, Orlando S (2007) Analyzing the workload of the south-east federation of the egee grid infrastructure, CoreGRID Technical Report, Tech. Rep. TR-0063, 2007

    Google Scholar 

  3. Yu J, Buyya R (2005) A taxonomy of scientific workflow systems for grid computing. ACM SIGMOD Rec 34(3):44–49

    Article  Google Scholar 

  4. Deelman E, Singh G, Livny M, Berriman JB, Good J (2008) The cost of doing science on the cloud: the montage example. In proceedings of the ACM/IEEE conference on high performance computing, SC 2008. IEEE/ACM, Austin, Texas, USA, p 50

    Google Scholar 

  5. Assuncao ACM, Buyya R (2009) Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters. In: Kranzlmüller D, Bode A, Hegering H.-G, Casanova H, Gerndt M (eds) 11th IEEE international conference on high performance computing and communications (HPCC 2009), ACM

    Google Scholar 

  6. Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, Zagorodnov D (2008) Eucalyptus: a technical report on an elastic utility computing architecture linking your programs to useful systems. UCSB Computer Science Technical Report, Tech. Rep. 2008–10, 2008

    Google Scholar 

  7. Chisnal D (2007) The definitive guide to the Xen hypervisor. Prentice-Hall, New Jersey

    Google Scholar 

  8. Fahringer T, Prodan R, Duan R, Nerieri F, Podlipnig S, Qin J, Siddiqui M, Truong HL, Villazón A, Wieczorek M (2005, November 13–14) Askalon: a grid application development and computing environment. In proceedings of the 6th IEEE/ACM international conference on grid computing (GRID 2005). IEEE, Seattle, Washington DC, pp 122–131

    Google Scholar 

  9. Fahringer T, Qin J, Hainzer S (2005) Specification of grid workflow applications with agwl: an abstract grid workflow language. In CCGRID. IEEE Computer Society, pp 676–685

    Google Scholar 

  10. Czajkowski K, Fitzgerald S, Foster I, Kesselman C (2001) Grid information services for distributed resource sharing. In 10th international symposium on high performance distributed computing. IEEE Computer Society Press

    Google Scholar 

  11. Ostermann S, Plankensteiner K, Prodan R, Fahringer T, Iosup A (2008) “Workflow monitoring and analysis tool for ASKALON”, in Grid and Services Evolution. Barcelona, Spain, pp 73–86

    Google Scholar 

  12. Amazon (2009) Elastic compute cloud (EC2). http://aws.amazon.com/ec2/. Accessed January 2009

    Google Scholar 

  13. GoGrid (2009) Cloud hosting: Instant windows and linux cloud servers. http://www.gogrid.com/. Accessed January 2009

    Google Scholar 

  14. “Elastichosts: Cloud hosting and cloud computing that’s flexible and easy to use. http://www.elastichosts.com/

  15. Mosso (2009) The cloud, cloud computing, cloud hosting, cloud services @ mosso. http://www.mosso.com/. Accessed January 2009

    Google Scholar 

  16. Amazon Inc. (2009) Amazon ec2 api. http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=87. Accessed April 2009

    Google Scholar 

  17. Keahey K, Freeman T, Lauret J, Olson D (2007) Virtual workspaces for scientific applications. In Scientific discovery through advanced computing. Boston, MA

    Google Scholar 

  18. Buyya R, Yeo CS, Venugopal S (2008, 25–27 Sept) Market-oriented cloud computing: Vision, hype, and reality for delivering it services as computing utilities. In 10th IEEE international conference on high performance computing and communications (HPCC 2008). IEEE, Dalian, China, pp 5–13

    Google Scholar 

  19. Agathon Group (2009) https://www.agathongroup.com/. Accessed January 2009

  20. FlexiScale (2009) Utility computing on demand. http://flexiscale.com/. Accessed January 2009

    Google Scholar 

  21. tera (2009) Applogic - grid operating system for web applications. http://www.3tera.com/AppLogic/. Accessed January 2009

    Google Scholar 

  22. Novotny J, Tuecke S, Welch V (2001) An online credential repository for the Grid: MyProxy. In proceedings of the tenth international symposium on high performance distributed computing (HPDC-10), IEEE Computer Society Press

    Google Scholar 

  23. von Laszewski G, Foster I, Gawor J (2000) CoG kits: a bridge between commodity distributed computing and high-performance grids. In Java Grande Conference. ACM Press, pp 97–106

    Google Scholar 

  24. Blaha P, Schwarz K, Luitz J (2001) WIEN2k, a full potential linearized augmented plane wave package for calculating crystal properties. TU Wien ISBN 3-9501031-1-2, 2001

    Google Scholar 

  25. Volkert J (2006, July 6–9) Austrian grid: Overview on the project with focus on parallel applications. In 5th international symposium on parallel and distributed computing (ISPDC 2006). IEEE Computer Society, Timisoara, Romania, p 14

    Google Scholar 

  26. Dongarra JJ, Luszczek P, Petitet A (2003) The LINPACK benchmark: past, present and future. Concurr Comput Prac Exp 15(9):803–820

    Article  Google Scholar 

  27. Gropp W, Lusk E, Ashton D, Buntinas D, Butler R, Chan A, Ross R, Thakur R, Toonen B (2005) Mpich2 user’s guide, version 1.0.3, Mathematics and computer science division, Argonne national laboratory. Technical Report. http://www-unix.mcs.anl.gov/mpi/mpich/

    Google Scholar 

  28. Rehr JJ, Gardner JP, Prange M, Svec L, Vila F (2009) Scientific computing in the cloud. Computing Research Repository vol. abs/0901.0029, 2009

    Google Scholar 

  29. Yigitbasi N, Iosup A, Ostermann S, Epema D (2009) C-meter: A framework for performance analysis of computing clouds. In International Workshop on Cloud Computing (Cloud 2009)

    Google Scholar 

  30. Calheiros RN, Ranjan R, Rose CAFD, Buyya R (2009) Cloudsim: a novel framework for modeling and simulation of cloud computing infrastructures and services. Computing Research Repository, vol. abs/0903.2525, 2009

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computer Science, University of Innsbruck, Technikerstra§e 21a, 6020, Innsbruck, Austria

    Simon Ostermann

Authors
  1. Simon Ostermann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Radu Prodan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Thomas Fahringer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Simon Ostermann .

Editor information

Editors and Affiliations

  1. , School of Computing, University Derby, Kedleston Road, Derby, DE22 1GB, United Kingdom

    Nick Antonopoulos

  2. Dept. Computing, University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom

    Lee Gillam

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer London

About this chapter

Cite this chapter

Ostermann, S., Prodan, R., Fahringer, T. (2010). Resource Management for Hybrid Grid and Cloud Computing. In: Antonopoulos, N., Gillam, L. (eds) Cloud Computing. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-1-84996-241-4_11

Download citation

  • DOI: https://doi.org/10.1007/978-1-84996-241-4_11

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84996-240-7

  • Online ISBN: 978-1-84996-241-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation