Skip to main content
SpringerLink
Log in

Tools and Technologies for Building Clouds

  • Chapter
  • First Online:
Cloud Computing

Part of the book series: Computer Communications and Networks ((CCN))

Abstract

With cloud computing growing in popularity, tools and technologies are emerging to build, access, manage, and maintain the clouds. These tools need to manage the huge number of operations within a cloud transparently and without service interruptions. Cloud computing promises lower costs, faster implementation, and more flexibility using mixtures of technologies, and the associated tools are critical for achieving this.

In this chapter, we survey several state-of-the-art techniques for building clouds, starting with virtualization technology. We briefly introduce virtual machines (VMs) and their main features. Then, we introduce the main tools to manage VMs (hypervisors and virtual infrastructure managers) as well as the major technologies used to manage VMs in a public cloud. We then present MapReduce, a powerful model that makes it easier to write programs that take advantage of the power of cloud computing. We conclude by examining four web services tools and technologies that are built for cloud computing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. APPRIO Homepage (2009) http://www.appirio.com/

  2. Force.com Homepage (2009) http://www.salesforce.com/platform/

  3. Amazon Web Services (2009) http://aws.amazon.com/

  4. Barroso LA, Urs Hölzle U (2009) The datacenter as a computer: an introduction to the design of warehouse-scale machines. Morgan & Claypool, USA

    Google Scholar 

  5. ADO.NET Data Service (formally Astroia) (2009) http://msdn.microsoft.com/en-us/data/bb931106.aspx

  6. Google AppEngine (2009) http://code.google.com/appengine/

  7. Amazon Elastic Cloud Computing (2009) http://aws.amazon.com/ec2/

  8. Enomaly Elastic Computing (2009) http://www.enomaly.com/

  9. Open Nubela Homepage (2009) http://www.opennebula.org/

  10. Rightscale Homepage (2009) http://www.rightscale.com/

  11. Elastra Manage ComplexITy Homepage (2009) http://www.elastra.com/

  12. Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113

    Article  Google Scholar 

  13. Patterson DA (2008) Technical perspective: the data center is the computer. Commun ACM 51(1):105

    Google Scholar 

  14. Vmware (2009) http://www.vmware.com/virtualization/history.html

  15. Goldberg RP (1974) Survey of virtual machine research. IEEE Comput Mag 7(6):34–45

    Google Scholar 

  16. Waldspurger CA (December 2002) Memory resource management in VMware ESX server. In: Proceedings of the 5th symposium on operating systems design and implementation (OSDI ’02), Boston, MA

    Google Scholar 

  17. Fraser K, Hand S, Neugebauer R, Pratt I, Warfield A, Williamson M (2004) Safe hardware access with the Xen virtual machine monitor. In: OASIS ASPLOS 2004 workshop

    Google Scholar 

  18. Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Pratt L, Warfield A (2005) Live migration of virtual machines. In: Proceedings of the 2nd symposium on networked systems design and implementation (NSDI ’05), Boston, MA

    Google Scholar 

  19. Garfinkel T, Pfaff B, Chow J, Rosenblum M, Boneh D (2003) Terra: a virtual machine-based platform for trusted computing. In: Proceedings of the 19th ACM symposium on operating systems principles (SOSP ’03), Bolton Landing (Lake George), New York

    Google Scholar 

  20. Bressoud TC, Schneider FB (1995) Hypervisor based fault tolerance. In: Proceedings of the fifteenth ACM symposium on operating systems principles, ACM Press, pp 1–11

    Google Scholar 

  21. Petrini F, Kerbyson DJ, Pakin S (2003) The case of the missing supercomputer performance: achieving optimal performance on the 8,192 processors of ASCI Q. In: Proceedings of SC ’03, Washington, DC, USA

    Google Scholar 

  22. Koch K (2002) How does ASCI actually complete multi-month 1000-processor milestone simulations? In: Proceedings of the conference on high speed computing

    Google Scholar 

  23. Foster I, Zhao Y, Raicu I, Lu S (2008) Cloud computing and grid computing 360-degree compared. In: the Proceedings of the grid computing environments workshop

    Google Scholar 

  24. Nanda S, Chiueh T (2005) A survey on virtualization technologies, RPE Report, February. www.ecsl.cs.sunysb.edu/tr/TR179.pdf

  25. Virtual Machine (Wikipedia) (2009) http://en.wikipedia.org/wiki/Virtual_machine

  26. IBM white paper (2009) Seeding the Clouds: Key Infrastructure Elements for Cloud Computing. ftp://ftp.software.ibm.com/common/ssi/sa/wh/n/oiw03022usen/OIW03022USEN.PDF

  27. VMware – Virtual Infrastructure Software (2009) http://www.vmware.com.

  28. Xen Homepage (2009) http://www.xen.org/.

  29. Kernel-based Virtual Machine (2009) http://kvm.qumranet.com.

  30. Microsoft Hyper-V (2009) http://www.microsoft.com/hyper-v-server/en/us/default.aspx

  31. Pratt I, Warfield A, Barham P, Neugebauer R (2003) Xen and the art of virtualization. In Proceedings of the 19th ACM symposium on operating systems principles (SOSP ’03), Bolton Landing (Lake George), New York

    Google Scholar 

  32. Whitaker A, Shaw M, Gribble SD (2002) Scale and performance in the Denali isolation kernel. In: Proceedings of the 5th symposium on operating systems design and implementation (OSDI’02), Boston, MA

    Google Scholar 

  33. MSDN Architecture Center, Mapping Applications to the Cloud (2009) http://msdn.microsoft.com/en-us/library/dd430340.aspx

  34. Comparison of platform virtual machines (Wikipedia) (2009) http://en.wikipedia.org/wiki/Comparison_of_platform_virtual_machines

  35. Eucalyptus system Homepage (2009) http://www.eucalyptus.com/

  36. Nimbus Homepage (2009) http://workspace.globus.org/

  37. Elastic Hosts Homepage (2009) http://www.elastichosts.com/

  38. McNett M, Gupta D, Vahdat A, Voelker GM (2007) Usher: an extensible framework for managing clusters of virtual machines. 21st Large installation system administration conference

    Google Scholar 

  39. Shi XH, Tan H, Wu S, Jin H (2008) VNIX: managing virtual machines on clusters, pp 155–162. Japan-China joint workshop on frontier of computer science and technology

    Google Scholar 

  40. OGF Open Cloud Computing Interface Working Group (2009) http://www.occi-wg.org/doku.php

  41. VMan Initiative (2009) http://www.dmtf.org/initiatives/vman_initiative/

  42. libvirt: The virtualization API (2009) http://libvirt.org/

  43. RightScale – Testimonials (2009) http://www.rightscale.com/customers/

  44. Kaavo Homepage (2009) http://www.kaavo.com/home

  45. Kaavo – Testimonials (2009) http://www.kaavo.com/testimonials

  46. CohesiveFT Homepage (2009) http://www.cohesiveft.com/

  47. Ghemawat S, Gobioff H, Leung ST (2003) The google file system. In: the proceedings of the 19th ACM symposium on operating systems principles, Lake George, New York

    Google Scholar 

  48. Hadoop (2009) http://lucene.apache.org/

  49. Yahoo! (2009) Yahoo! Developer Network. http://developer.yahoo.com/blogs/hadoop/2008/02/yahoo-worlds-largest-production-hadoop.html. Accessed September 2009

  50. Hadoop Credits Page (2009) http://hadoop.apache.org/core/credits.html. Accessed September 2009

  51. CloudStore (Formely Kosmos File System) (2009) http://kosmosfs.sourceforge.net/

  52. NET Remoting, http://en.wikipedia.org/wiki/.NET_Remoting

  53. Java RMI, http://en.wikipedia.org/wiki/Java_RMI

  54. J2EE, http://en.wikipedia.org/wiki/J2EE

  55. Service Oriented Architecture (Wikipedia) (2009) http://en.wikipedia.org/wiki/Service-oriented_architecture

  56. Service-architecture – Service-oriented architecture (SOA) definition (2009) http://www.service-architecture.com/web-services/articles/service-oriented_architecture_soa_definition.html

  57. WSRF (2009) http://www.oasis-open.org/committees/wsrf/

  58. WS-Security (2009) http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=wss

  59. WS-Policy (2009) http://www.w3.org/Submission/WS-Policy/

  60. Goth G (2004) Critics say web services need a REST. IEEE Distribut Syst Online 5(12): 1–1

    Article  Google Scholar 

  61. Vinoski S (2008) RESTful web services development checklist. IEEE Internet Comput 12(6):94–96

    Article  Google Scholar 

  62. Vinoski S ((2007) REST eye for the SOA guy. IEEE Internet Comput 11(1):82–84

    Article  Google Scholar 

  63. Mashup (web application hybrid), http://en.wikipedia.org/wiki/Mashup_(web_application_hybrid)

  64. Webmashup.com blog, http://www.webmashup.com/blog/category/learn/ (accessed 1 October 2009)

  65. Google Mashup Editor (2009) http://en.wikipedia.org/wiki/Google_Mashup_Editor

  66. Mozilla Ubiquity (2009) http://ubiquity.mozilla.com/

Download references

Acknowledgments

This work is supported by National 973 Key Basic Research Program under grant No.2007CB310900, NSFC under grants No.60673174 and No.60973037, Program for New Century Excellent Talents in University under Grant NCET-07-0334, Information Technology Foundation of MoE and Intel under grant MoE-INTEL-09-03, and National High-Tech R&D Plan of China under grant No.2006AA01A115.

Author information

Authors and Affiliations

  1. Services Computing Technology and System Lab, Cluster and Grid Computing Lab, Huazhong University of Science and Technology, 430074, Wuhan, China

    Hai Jin

Authors
  1. Hai Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shadi Ibrahim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tim Bell
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Li Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Haijun Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Song Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Xuanhua Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hai Jin .

Editor information

Editors and Affiliations

  1. , School of Computing, University Derby, Kedleston Road, Derby, DE22 1GB, United Kingdom

    Nick Antonopoulos

  2. Dept. Computing, University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom

    Lee Gillam

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer London

About this chapter

Cite this chapter

Jin, H. et al. (2010). Tools and Technologies for Building Clouds. In: Antonopoulos, N., Gillam, L. (eds) Cloud Computing. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-1-84996-241-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-84996-241-4_1

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84996-240-7

  • Online ISBN: 978-1-84996-241-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation