Skip to main content
SpringerLink
Log in

A Multi-stage Dynamic Game-Theoretic Approach for Multi-Workflow Scheduling on Heterogeneous Virtual Machines from Multiple Infrastructure-as-a-Service Clouds

  • Conference paper
  • First Online:
Services Computing – SCC 2018 (SCC 2018)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 10969))

Included in the following conference series:

Abstract

Distributed computing systems such as clouds continue to evolve to support various types of scientific applications, especially scientific workflows, with dependable, consistent, pervasive, and inexpensive access to geographically-distributed computational capabilities. Scheduling multiple workflows on distributed computing systems like Infrastructure-as-a-Service (IaaS) clouds is well recognized as a fundamental NP-complete problem that is critical to meeting various types of Quality-of-Service (QoS) requirements. In this paper, we propose a multi-objective optimization workflow scheduling approach based on dynamic game-theoretic model aiming at reducing workflow make-spans, reducing total cost, and maximizing system fairness in terms of workload distribution among heterogeneous cloud virtual machines (VMs). We conduct extensive case studies as well based on various well-known scientific workflow templates and real-world third-party commercial IaaS clouds. Experimental results clearly suggest that our proposed approach outperform traditional ones by achieving lower workflow make-spans, lower cost, and better system fairness.

This work is supported in part by the International Joint Project funded jointly by the Royal Society of the UK and the National Natural Science Foundation of China under grant 61611130209, National Science Foundations of China under grants Nos. 61472051/61702060, the Science Foundation of Chongqing under No. cstc2017jcyjA1276, China Postdoctoral Science Foundation No. 2015M570770, Chongqing Postdoctoral Science special Foundation No. Xm2015078, and Universities Sci-tech Achievements Transformation Project of Chongqing No. KJZH17104, Chongqing grand R&D projects Nos. cstc2017zdcy-zdyf0120 and cstc2017rgzn-zdyf0118.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rodriguez, M.A., Buyya, R.: A taxonomy and survey on scheduling algorithms for scientific workflows in IaaS cloud computing environments. Concurr. Comput. Pract. Exp. 29(8), e4041 (2017)

    Article  Google Scholar 

  2. Ye, X., Liang, J., Liu, S., Li, J.: A survey on scheduling workflows in cloud environment. In: Proceedings of the 2015 International Conference on Network and Information Systems for Computers. ICNISC 2015, pp. 344–348 (2015)

    Google Scholar 

  3. Buyya, R.: Market-oriented cloud computing: vision, hype, and reality of delivering computing as the 5th utility. In: 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. CCGRID 2009, vol. 25, no. 6, p. 1 (2009)

    Google Scholar 

  4. Chirkin, A.M., Belloum, A.S.Z., Kovalchuk, S.V., Makkes, M.X.: Execution time estimation for workflow scheduling. In: 2014 9th Workshop on Workflows in Support of Large-Scale Science, pp. 1–10 (2014)

    Google Scholar 

  5. Shi, L., Zhang, Z., Robertazzi, T.: Energy-aware scheduling of embarrassingly parallel jobs and resource allocation in cloud. IEEE Trans. Parallel Distrib. Syst. 28(6), 1607–1620 (2017)

    Article  Google Scholar 

  6. Chirkin, A.M., et al.: Execution time estimation for workflow scheduling. Futur. Gener. Comput. Syst. Int. J. eScience 75, 376–387 (2017)

    Article  Google Scholar 

  7. Wu, Q., Ishikawa, F., Zhu, Q., Xia, Y., Wen, J.: Deadline-constrained cost optimization approaches for workflow scheduling in clouds. IEEE Trans. Parallel Distrib. Syst. 28(12), 3401–3412 (2017)

    Article  Google Scholar 

  8. Yao, G., Ding, Y., Hao, K.: Using imbalance characteristic for fault-tolerant workflow scheduling in cloud systems. IEEE Trans. Parallel Distrib. Syst. 28(12), 3671–3683 (2017)

    Article  Google Scholar 

  9. Chen, H., Zhu, X., Qiu, D., Liu, L., Du, Z.: Scheduling for workflows with security-sensitive intermediate data by selective tasks duplication in clouds. IEEE Trans. Parallel Distrib. Syst. 28(9), 2674–2688 (2017)

    Article  Google Scholar 

  10. Liu, J., Pacitti, E., Valduriez, P., de Oliveira, D., Mattoso, M.: Multi-objective scheduling of scientific workflows in multisite clouds. Futur. Gener. Comput. Syst. 63, 76–95 (2016)

    Article  Google Scholar 

  11. Shukla, S.: An evolutionary study of multi-objective workflow scheduling in cloud computing. Int. J. Comput. Appl. 133(14), 14–18 (2016)

    Google Scholar 

  12. Durillo, J.J., Nae, V., Prodan, R.: Multi-objective workflow scheduling: an analysis of the energy efficiency and makespan tradeoff. In: Proceedings - 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing. CCGrid 2013, pp. 203–210 (2013)

    Google Scholar 

  13. Yassa, S., Chelouah, R., Kadima, H., Granado, B.: Multi-objective approach for energy-aware workflow scheduling in cloud computing environments. Sci. World J. 2013, 13 (2013)

    Article  Google Scholar 

  14. Khajemohammadi, H., Fanian, A., Gulliver, T.A.: Fast workflow scheduling for grid computing based on a multi-objective Genetic Algorithm. In: Proceedings of the IEEE Pacific RIM Conference on Communications, Computers, and Signal Processing, pp. 96–101 (2013)

    Google Scholar 

  15. Zhu, Z., Zhang, G., Li, M., Liu, X.: Evolutionary multi-objective workflow scheduling in cloud. IEEE Trans. Parallel Distrib. Syst. 27(5), 1344–1357 (2016)

    Article  Google Scholar 

  16. Chen, W.-N., Zhang, J.: An ant colony optimization approach to a grid workflow scheduling problem with various QoS requirements. IEEE Trans. Syst. Man, Cybern. Part C: Applications Rev. 39(1), 29–43 (2009)

    Article  Google Scholar 

  17. Padmaveni, K., Aravindhar, D.J.: Hybrid memetic and particle swarm optimization for multi objective scientific workflows in cloud. In: 2016 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM), pp. 66–72 (2016)

    Google Scholar 

  18. Zheng, X., Wang, L.: A Pareto based fruit fly optimization algorithm for task scheduling and resource allocation in cloud computing environment. In: 2016 IEEE Congress on Evolutionary Computation (CEC), pp. 3393–3400 (2016)

    Google Scholar 

  19. Hou, Y., Wu, N., Zhou, M., Li, Z.: Pareto-optimization for scheduling of crude oil operations in refinery via genetic algorithm. IEEE Trans. Syst. Man, Cybern. Syst. 47(3), 517–530 (2017)

    Article  Google Scholar 

  20. Ebadifard, F., Babamir, S.M.: Optimizing multi objective based workflow scheduling in cloud computing using black hole algorithm. In: 2017 3rd International Conference on Web Research. ICWR 2017, pp. 102–108, April 2017

    Google Scholar 

  21. Fard, H.M., Prodan, R., Fahringer, T.: A truthful dynamic workflow scheduling mechanism for commercial multicloud environments. IEEE Trans. Parallel Distrib. Syst. 24(6), 1203–1212 (2013)

    Article  Google Scholar 

  22. Duan, R., Prodan, R., Li, X.: Multi-objective game theoretic schedulingof bag-of-tasks workflows on hybrid clouds. IEEE Trans. Cloud Comput. 2(1), 29–42 (2014)

    Article  Google Scholar 

  23. Sujana, J.A.J., Revathi, T., Karthiga, G., Raj, R.V.: Game multi objective scheduling algorithm for scientific workflows in cloud computing. In: IEEE International Conference on Circuit, Power and Computing Technologies. ICCPCT 2015, pp. 1–6 (2015)

    Google Scholar 

  24. Pettit, P., Sugden, R.: The backward induction paradox. J. Philos. 86(4), 169–182 (1989)

    Article  MathSciNet  Google Scholar 

  25. Topcuoglu, H., Hariri, S., Wu, M.: Performance-effective and low-complexity task scheduling for heterogeneous computing. Parallel Distrib. Syst. 13(3), 260–274 (2002)

    Article  Google Scholar 

  26. Zhang, L., Zhou, J.: Task scheduling and resource allocation algorithm in cloud computing system based on non-cooperative game. In: 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), pp. 254–259 (2017)

    Google Scholar 

  27. Balouek-Thomert, D., Bhattacharya, A.K., Caron, E., Gadireddy, K., Lefevre, L.: Parallel differential evolution approach for cloud workflow placements under simultaneous optimization of multiple objectives. In: 2016 IEEE Congress on Evolutionary Computation (CEC), pp. 822–829 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computer Science, Chongqing University, Chongqing, 400030, China

    Yuandou Wang, Jiajia Jiang, Yunni Xia, Quanwang Wu, Xin Luo & Qingsheng Zhu

Authors
  1. Yuandou Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiajia Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunni Xia
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Quanwang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xin Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qingsheng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Yunni Xia , Quanwang Wu or Xin Luo .

Editor information

Editors and Affiliations

  1. University of São Paulo, São Paulo, Brazil

    João Eduardo Ferreira

  2. City, University of London, London, United Kingdom

    George Spanoudakis

  3. Wuhan University, Wuhan, China

    Yutao Ma

  4. Kingdee International Software Group Co., Shenzhen, China

    Liang-Jie Zhang

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, Y., Jiang, J., Xia, Y., Wu, Q., Luo, X., Zhu, Q. (2018). A Multi-stage Dynamic Game-Theoretic Approach for Multi-Workflow Scheduling on Heterogeneous Virtual Machines from Multiple Infrastructure-as-a-Service Clouds. In: Ferreira, J., Spanoudakis, G., Ma, Y., Zhang, LJ. (eds) Services Computing – SCC 2018. SCC 2018. Lecture Notes in Computer Science(), vol 10969. Springer, Cham. https://doi.org/10.1007/978-3-319-94376-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-94376-3_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-94375-6

  • Online ISBN: 978-3-319-94376-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation