Skip to main content

Developing a Cost-Effective Virtual Cluster on the Cloud

  • Conference paper
Economics of Grids, Clouds, Systems, and Services (GECON 2011)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 7150))

Included in the following conference series:

Abstract

The Cloud provides highly democratic access to computer services on a pay-per-use basis. A fact that has encouraged many researchers to adopt the Cloud for the processing of large computational tasks and data storage. This has been used in the past for single research endeavours or as mechanism for coping with excessive load on conventional computational resources (clusters). In this paper we investigate, through the use of simulation, the applicability of running an entire computer cluster on the Cloud. We investigate a number of policy decisions which can be made over such a virtual cluster to reduce the running cost and the effect these policies have on the users of the cluster.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amazon Web Services: CloudWatch, http://aws.amazon.com/cloudwatch/

  2. Amazon Web Services: Elastic Compute Cloud, http://aws.amazon.com/ec2/

  3. Amazon Web Services: Simple Storage Service, http://aws.amazon.com/s3/

  4. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)

    Article  Google Scholar 

  5. de Assuncao, M.D., di Costanzo, A., Buyya, R.: Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters. In: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing, HPDC 2009, pp. 141–150. ACM, New York (2009)

    Chapter  Google Scholar 

  6. Van den Bossche, R., Vanmechelen, K., Broeckhove, J.: Cost-optimal scheduling in hybrid iaas clouds for deadline constrained workloads. In: 2010 IEEE 3rd International Conference on Cloud Computing (CLOUD), pp. 228–235 (July 2010)

    Google Scholar 

  7. Cheng, P.S.: Trace-driven system modeling. IBM Systems Journal 8(4), 280–289 (1969)

    Article  Google Scholar 

  8. Deelman, E., Singh, G., Livny, M., Berriman, B., Good, J.: The cost of doing science on the cloud: the montage example. In: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC 2008, pp. 50:1–50:12. IEEE Press, Piscataway (2008)

    Google Scholar 

  9. Li, B., O’Loughlin, J., Gillam, L.: Fair benchmarking for cloud computing systems. Poster presentation, Cloud Workshop, UK All Hands Meeting (2011)

    Google Scholar 

  10. Litzkow, M., Livney, M., Mutka, M.W.: Condor-a hunter of idle workstations. In: 8th International Conference on Distributed Computing Systems, pp. 104–111 (1998)

    Google Scholar 

  11. Marshall, P., Keahey, K., Freeman, T.: Elastic site: Using clouds to elastically extend site resources. In: 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid), pp. 43–52 (May 2010)

    Google Scholar 

  12. Mattess, M., Vecchiola, C., Buyya, R.: Managing peak loads by leasing cloud infrastructure services from a spot market. In: Proceedings of the 2010 IEEE 12th International Conference on High Performance Computing and Communications, HPCC 2010, pp. 180–188. IEEE Computer Society, Washington, DC, USA (2010)

    Chapter  Google Scholar 

  13. McGough, A.S., Robinson, P., Gerrard, C., Haldane, P., Hamlander, S., Sharples, D., Swan, D., Wheater, S.: Intelligent power management over large clusters. In: International Conference on Green Computing and Communications (GreenCom 2010) (2010)

    Google Scholar 

  14. McGough, A.S., Gerrard, C., Noble, J., Robinson, P., Wheater, S.: Analysis of power-saving techniques over a large multi-use cluster. In: International Conference on Cloud and Green Computing (CGC 2011) (2011)

    Google Scholar 

  15. Oracle: (Sun) Grid Engine, http://www.oracle.com/technetwork/oem/grid-engine-166852.html

  16. Palankar, M.R., Iamnitchi, A., Ripeanu, M., Garfinkel, S.: Amazon s3 for science grids: a viable solution? In: Proceedings of the 2008 International Workshop on Data-Aware Distributed Computing, DADC 2008, pp. 55–64. ACM, New York (2008)

    Chapter  Google Scholar 

  17. Veridian Systems: Portable Batch Systems, http://www.openpbs.org

  18. Youseff, L., Butrico, M., Da Silva, D.: Toward a unified ontology of cloud computing. In: Grid Computing Environments Workshop (GCE 2008), pp. 1–10 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

McGough, A.S. (2012). Developing a Cost-Effective Virtual Cluster on the Cloud. In: Vanmechelen, K., Altmann, J., Rana, O.F. (eds) Economics of Grids, Clouds, Systems, and Services. GECON 2011. Lecture Notes in Computer Science, vol 7150. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28675-9_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28675-9_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28674-2

  • Online ISBN: 978-3-642-28675-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics