Skip to main content

EPOBF: Energy Efficient Allocation of Virtual Machines in High Performance Computing Cloud

  • Chapter
  • First Online:
Transactions on Large-Scale Data- and Knowledge-Centered Systems XVI

Part of the book series: Lecture Notes in Computer Science ((TLDKS,volume 8960))

Abstract

Cloud computing has become more popular in provision of computing resources under virtual machine (VM) abstraction for high performance computing (HPC) users. A HPC cloud is such a cloud computing environment. One of the challenges of energy-efficient resource allocation of VMs in HPC clouds is the trade-off between minimizing total energy consumption of physical machines (PMs) and satisfying Quality of Service (e.g. performance). On the one hand, cloud providers want to maximize their profit by reducing the power cost (e.g. using the smallest number of running PMs). On the other hand, cloud customers (users) want highest performance for their applications. In this paper, we study energy-efficient allocation of VMs that focuses on scenarios where users request short-term resources at fixed start-times and non-interrupted durations. We then propose a new allocation heuristic (namely Energy-aware and Performance-per-watt oriented Best-fit (EPOBF)) that uses performance-per-watt as a metric to choose which most energy-efficient PM for mapping each VM (e.g. the maximum of MIPS/Watt). Using information from Feitelsons Parallel Workload Archive to model HPC jobs, we compare the proposed EPOBF to state-of-the-art heuristics on heterogeneous PMs (each PM has multicore CPUs). Simulations show that the proposed EPOBF can significantly reduce total energy consumption when compared with state-of-the-art allocation heuristics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. AWS - High Performance Computing - HPC Cloud Computing. http://aws.amazon.com/hpc/ (retrieved on August 31, 2014)

  2. Parallel Workloads Archive. http://www.cs.huji.ac.il/labs/parallel/workload/ (retrieved on January 31, 2014)

  3. SDSC-BLUE-2000-4.1-cln.swf.gz log-trace. http://www.cs.huji.ac.il/labs/parallel/workload/l_sdsc_blue/SDSC-BLUE-2000-4.1-cln.swf.gz (retrieved on Januray 31, 2014)

  4. Albers, S.: Energy-efficient algorithms. Commun. ACM 53(5), 86–96 (2010)

    Article  MathSciNet  Google Scholar 

  5. Beloglazov, A., Abawajy, J., Buyya, R.: Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Generation Comp. Syst. 28(5), 755–768 (2012)

    Article  Google Scholar 

  6. Beloglazov, A., Buyya, R.: Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurrency and Computation: Practice and Experience 24(13), 1397–1420 (2012)

    Article  Google Scholar 

  7. Beloglazov, A., Buyya, R., Lee, Y.C., Zomaya, A.: A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems. Advances in Computers 82, 1–51 (2011)

    Article  Google Scholar 

  8. Buyya, R., Yeo, C., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging it platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Generation Comp. Syst. 25(6), 599–616 (2009)

    Article  Google Scholar 

  9. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: Cloudsim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw., Pract. Exper. 41(1), 23–50 (2011)

    Article  Google Scholar 

  10. Fan, X., Weber, W.D., Barroso, L.: Power provisioning for a warehouse-sized computer. In: ISCA, pp. 13–23 (2007)

    Google Scholar 

  11. Garg, S.K., Yeo, C.S., Anandasivam, A., Buyya, R.: Energy-Efficient Scheduling of HPC Applications in Cloud Computing Environments. CoRR abs/0909.1146 (2009)

    Google Scholar 

  12. Goiri, I., Julia, F., Nou, R., Berral, J.L., Guitart, J., Torres, J.: Energy-Aware Scheduling in Virtualized Datacenters. In: 2010 IEEE International Conference on Cluster Computing, pp. 58–67. IEEE (September 2010). http://doi.ieeecomputersociety.org/10.1109/CLUSTER.2010.15. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5600320

  13. Jing, S.Y., Ali, S., She, K., Zhong, Y.: State-of-the-art research study for green cloud computing. The Journal of Supercomputing 65(1), 445–468 (2013). http://www.springerlink.com/index/10.1007/s11227-011-0722-1. http://link.springer.com/10.1007/s11227-011-0722-1

  14. von Laszewski, G., Wang, L., Younge, A.J., He, X.: Power-aware scheduling of virtual machines in dvfs-enabled clusters. In: CLUSTER, pp. 1–10 (2009)

    Google Scholar 

  15. Le, K., Bianchini, R., Zhang, J., Jaluria, Y., Meng, J., Nguyen, T.D.: Reducing electricity cost through virtual machine placement in high performance computing clouds. In: SC, p. 22 (2011)

    Google Scholar 

  16. Liu, Y., Zhu, H.: A survey of the research on power management techniques for high-performance systems. Software: Practice and Experience 40(11), 943–964 (2010). http://onlinelibrary.wiley.com/doi/10.1002/spe.952/abstract. http://onlinelibrary.wiley.com/doi/10.1002/spe.952/pdf. http://cms.brookes.ac.uk/staff/HongZhu/Publications/Power_Mgt-final.pdf

  17. Mämmelä, O., Majanen, M., Basmadjian, R., de Meer, H., Giesler, A., Homberg, W.: Energy-aware Job Scheduler for High-performance Computing (2012)

    Google Scholar 

  18. Mauch, V., Kunze, M., Hillenbrand, M.: High performance cloud computing. Future Generation Comp. Syst. 29(6), 1408–1416 (2013)

    Article  Google Scholar 

  19. Panigrahy, R., Talwar, K., Uyeda, L., Wieder, U.: Heuristics for Vector Bin Packing. Tech. rep., Microsoft Research (2011)

    Google Scholar 

  20. Pham, T.V., Jamjoom, H., Jordan, K.E., Shae, Z.Y.: A service composition framework for market-oriented high performance computing cloud. In: HPDC, pp. 284–287 (2010)

    Google Scholar 

  21. Sharma, S.: Making a case for a green500 list, pp. 12–8 (2006)

    Google Scholar 

  22. Sotomayor, B.: Provisioning Computational Resources Using Virtual Machines and Leases. Ph.D. thesis, University of Chicago (2010)

    Google Scholar 

  23. Sotomayor, B., Keahey, K., Foster, I.T.: Combining batch execution and leasing using virtual machines. In: HPDC, pp. 87–96 (2008)

    Google Scholar 

  24. Takouna, I., Dawoud, W., Meinel, C.: Energy Efficient Scheduling of HPC-jobs on Virtualize Clusters using Host and VM Dynamic Configuration. Operating Systems Review 46(2), 19–27 (2012)

    Article  Google Scholar 

  25. Viswanathan, H., Lee, E.K., Rodero, I., Pompili, D., Parashar, M., Gamell, M.: Energy-Aware Application-Centric VM Allocation for HPC Workloads. In: IPDPS Workshops, pp. 890–897 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nguyen Quang-Hung .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Quang-Hung, N., Thoai, N., Son, N.T. (2014). EPOBF: Energy Efficient Allocation of Virtual Machines in High Performance Computing Cloud. In: Hameurlain, A., Küng, J., Wagner, R., Dang, T., Thoai, N. (eds) Transactions on Large-Scale Data- and Knowledge-Centered Systems XVI. Lecture Notes in Computer Science(), vol 8960. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45947-8_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-45947-8_6

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-45946-1

  • Online ISBN: 978-3-662-45947-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics