Skip to main content

An Efficient Scheduling of HPC Applications on Geographically Distributed Cloud Data Centers

  • Conference paper
  • First Online:
Computer Networks and Distributed Systems (CNDS 2013)

Abstract

Cloud computing provides a flexible infrastructure for IT industries to run their High Performance Computing (HPC) applications. Cloud providers deliver such computing infrastructures through a set of data centers called a cloud federation. The data centers of a cloud federation are usually distributed over the world. The profit of cloud providers strongly depends on the cost of energy consumption. As the data centers are located in various corners of the world, the cost of energy consumption and the amount of CO2 emission in different data centers varies significantly. Therefore, a proper allocation of HPC applications in such systems can result in a decrease of CO2 emission and a substantial increase of the providers’ profit. Reduction of CO2 emission also mitigates the destructive environmental impacts. In this paper, the problem of scheduling HPC applications on a geographically distributed cloud federation is scrutinized. To address the problem, we propose a two-level scheduler which is able to reach a good compromise between CO2 emission and the profit of cloud provider. The scheduler should also satisfy all HPC applications’ deadline and memory constraints. Simulation results based on a real intensive workload indicate that the proposed scheduler reduces the CO2 emission by 17 % while at the same time it improves the provider’s profit by 9 % on average.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6), 599–616 (2009)

    Article  Google Scholar 

  2. Voorsluys, W., Broberg, J., Buyya, R.: Introduction to cloud computing. In: Buyya, R., Broberg, J., Goscinski, A. (eds.) Cloud Computing: Principles and Paradigms, pp. 1–41. Wiley Press, New York (2011). ISBN-13: 978-0470887998

    Google Scholar 

  3. Belady, C.: In the data center, power and cooling costs more than the IT equipment it supports, http://www.electronics-cooling.com/articles/2007/feb/a3/

  4. Buyya, R., Beloglazov, A., Abawajy, J.: Energy-efficient management of data center resources for cloud computing: a vision, architectural elements, and open challenges. In: Proceedings of the 2010 International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA 2010), Las Vegas, USA, 12–15 July 2010

    Google Scholar 

  5. Gartner, Gartner estimates ICT industry accounts for 2 percent of global CO2 emissions, April 2007. http://www.gartner.com/it/page.jsp?id=503867

  6. Atashpaz-Gargari, C., Lucas, E.: Imperialist Competitive Algorithm: An algorithm for optimization inspired by imperialistic competition. IEEE Congress on Evolutionary Computation (2007)

    Google Scholar 

  7. Orgerie, A., Lefèvre, L., Gelas, J.: Save watts in your grid: green strategies for energy-aware framework in large scale distributed systems. In: Proceedings of the 2008 14th IEEE International Conference on Parallel and Distributed Systems, Melbourne, Australia (2008)

    Google Scholar 

  8. Patel, C., Sharma, R., Bash, C., Graupner, S.: Energy aware grid: global workload placement based on energy efficiency. Technical Report HPL-2002-329, HP Labs, Palo Alto, November 2002

    Google Scholar 

  9. Rajabi, A., Faragardi, H.R., Yazdani, N.: Communication-aware and energy-efficient resource provisioning for real-time cloud services. In: The 17th CSI International Symposium on Computer Architecture & Digital Systems (CADS 2013), Tehran (2013)

    Google Scholar 

  10. Garg, S., Yeo, C., Anandasivam, A., Buyya, R.: Environment-conscious scheduling of HPC applications on distributed cloud-oriented data centers. J. Parallel Distrib. Comput. 71(6), 732–749 (2011)

    Article  MATH  Google Scholar 

  11. Kessaci, Y., Melab, N., Talbi, E.: A Pareto-based metaheuristic for scheduling HPC applications on a geographically distributed cloud federation. Cluster Computing, 1–21 (2012)

    Google Scholar 

  12. Moore, J., Chase, J., Ranganathan, P., Sharma, R.: Making scheduling ‘‘cool’’: temperature-aware workload placement in data centers. In: Proceedings of the 2005 Annual Conference on USENIX Annual Technical Conference, Anaheim, CA (2005)

    Google Scholar 

  13. Tang, Q., Gupta, S.K.S., Stanzione, D., Cayton, P.: Thermal-aware task scheduling to minimize energy usage of blade server based datacenters. In: Proceedings of the 2nd IEEE International Symposium on Dependable, Autonomic and Secure Computing, DASC 2006. IEEE Computer Society, Los Alamitos (2006)

    Google Scholar 

  14. Feitelson, D.: Parallel workloads archive. http://www.cs.huji.ac.il/labs/parallel/workload

  15. Irwin, D., Grit, L., Chase, J.: Balancing risk and reward in a market-based task service. In: Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing, Honolulu, USA (2004)

    Google Scholar 

  16. Faragardi, H.R., Rajabi, A., Shojaee, R., Nolte, T.: Towards energy-aware resource scheduling to maximize reliability in cloud computing systems. In: 15th IEEE International Conference on High Performance Computing and Communications (HPCC 2013), China (2013)

    Google Scholar 

  17. Ebrahimirad, V., Rajabi, A., Goudarzi, M.: Energy-aware scheduling algorithm for precedence-constrained parallel tasks of network-intensive applications in a distributed homogeneous environment. In: 3rd International Conference on Computer and Knowledge Engineering (ICCKE 2013), Mashhad (2013)

    Google Scholar 

  18. Faragardi, H.R., Shojaee, R., Tabani, H., Rajabi, A.: An analytical model to evaluate reliability of cloud computing systems in the presence of QoS requirements. In: 12th IEEE/ACIS International Conference on Computer and Information Science, Japan (2013)

    Google Scholar 

  19. US Department of Energy, Voluntary reporting of greenhouse gases: Appendix F. Electricity emission factors (2007). http://www.eia.doe.gov/oiaf/1605/pdf/Appendix20F_r071023.pdf

  20. US Department of Energy, US Energy Information Administration (EIA) report (2007). http://www.eia.doe.gov/cneaf/electricity/epm/table5_6_a.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aboozar Rajabi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Rajabi, A., Faragardi, H.R., Nolte, T. (2014). An Efficient Scheduling of HPC Applications on Geographically Distributed Cloud Data Centers. In: Jahangir, A., Movaghar, A., Asadi, H. (eds) Computer Networks and Distributed Systems. CNDS 2013. Communications in Computer and Information Science, vol 428. Springer, Cham. https://doi.org/10.1007/978-3-319-10903-9_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-10903-9_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-10902-2

  • Online ISBN: 978-3-319-10903-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics