Skip to main content

Dynamic Resources Configuration for Coevolutionary Scheduling of Scientific Workflows in Cloud Environment

  • Conference paper
  • First Online:
International Joint Conference SOCO’17-CISIS’17-ICEUTE’17 León, Spain, September 6–8, 2017, Proceeding (SOCO 2017, ICEUTE 2017, CISIS 2017)

Abstract

Modern composite scientific applications, also called scientific workflows, require large processing capacities. Cloud environments provide high performance and flexible infrastructure, which can be easily employed for workflows execution. Since cloud resources are paid in the most cases, there is a need to utilize these resources with maximal efficiency. In this paper we propose dynamic resources coevolutionary genetic algorithm, which extends previously developed coevolutionary genetic algorithm for dynamic cloud environment by changing computational capacities of execution nodes on runtime. This method along with using two types of chromosomes – mapping of tasks on resources and resources configuration – allows to greatly extend the search space of the algorithm. Experimental results demonstrate that developed algorithm is able to generate solutions better than other scheduling algorithms for a variety of scientific workflows.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., Vahi, K.: Characterizing and profiling scientific workflows. Futur. Gener. Comput. Syst. 29(3), 682–692 (2013)

    Article  Google Scholar 

  2. Yu, J., Buyya, R.: A taxonomy of workflow management systems for grid computing. J. Grid Comput. 3(3–4), 171–200 (2005)

    Article  Google Scholar 

  3. Pugliese, R., Tiezzi, F.: A calculus for orchestration of web services. J. Appl. Logic 10(1), 2–31 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  4. Abrishami, S., Naghibzadeh, M., Epema, D.H.J.: Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Futur. Gener. Comput. Syst. 29(1), 158–169 (2013)

    Article  Google Scholar 

  5. Visheratin, A.A., Melnik, M., Nasonov, D.: Workflow scheduling algorithms for hard-deadline constrained cloud environments. Procedia Comput. Sci. 80, 2098–2106 (2016)

    Article  Google Scholar 

  6. Zhang, F., Cao, J., Li, K., Khan, S.U., Hwang, K.: Multi-objective scheduling of many tasks in cloud platforms. Futur. Gener. Comput. Syst. 37, 309–320 (2014)

    Article  Google Scholar 

  7. Arabnejad, H.: List Based Task Scheduling Algorithms on Heterogeneous Systems-An overview. Paginas.Fe.Up.Pt, p. 10 (2012)

    Google Scholar 

  8. Blythe, J., Jain, S., Deelman, E., Gil, Y., Vahi, K., Mandal, A., Kennedy, K.: Task scheduling strategies for workflow-based applications in grids. In: 2005 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005, vol. 2, pp. 759–767 (2005)

    Google Scholar 

  9. Jakob, W., Strack, S., Quinte, A., Bengel, G., Stucky, K.-U., Süß, W.: Fast rescheduling of multiple workflows to constrained heterogeneous resources using multi-criteria memetic computing. Algorithms 6(2), 245–277 (2013)

    Article  Google Scholar 

  10. Nasonov, D., Melnik, M., Shindyapina, N., Butakov, N.: Metaheuristic coevolution workflow scheduling in cloud environment. In: IJCCI, vol. 1, pp. 252–260 (2015)

    Google Scholar 

  11. Liu, L., Zhang, M., Buyya, R., Fan, Q.: Deadline-constrained coevolutionary genetic algorithm for scientific workflow scheduling in cloud computing. Concurr. Comput., 1–12 (2016)

    Google Scholar 

  12. Zhou, N., Qi, D., Wang, X., Zheng, Z., Lin, W.: A list scheduling algorithm for heterogeneous systems based on a critical node cost table and pessimistic cost table. Concurr. Comput. Pract. Exp. 29(5) (2017). e3944

    Google Scholar 

  13. Abdulhamid, S.M., Abd Latiff, M.S., Abdul-Salaam, G., Hussain Madni, S.H.: Secure scientific applications scheduling technique for cloud computing environment using global league championship algorithm. PLoS ONE 11(7), e0158102 (2016)

    Article  Google Scholar 

  14. Chen, H., Zhu, X., Qiu, D., Guo, H., Yang, L.T., Lu, P.: EONS: minimizing energy consumption for executing real-time workflows in virtualized cloud data centers. In: Proceedings International Conference Parallel Process Work, pp. 385–392 (2016)

    Google Scholar 

  15. Nasonov, D., Melnik, M., Radice, A.: Coevolutionary workflow scheduling in a dynamic cloud environment. In: International Conference on EUropean Transnational Education, pp. 189–200 (2016)

    Google Scholar 

  16. Bharathi, S., Chervenak, A., Deelman, E., Mehta, G., Su, M.H., Vahi, K.: Characterization of scientific workflows. In: 2008 3rd Workshop on Workflows in Support of Large-Scale Science, WORKS 2008 (2008)

    Google Scholar 

Download references

Acknowledgements

This research financially supported by Ministry of Education and Science of the Russian Federation, Agreement #14.587.21.0024 (18.11.2015). Unique Identification RFMEFI58715X0024.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander A. Visheratin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Visheratin, A.A., Melnik, M., Nasonov, D. (2018). Dynamic Resources Configuration for Coevolutionary Scheduling of Scientific Workflows in Cloud Environment. In: Pérez García, H., Alfonso-Cendón, J., Sánchez González, L., Quintián, H., Corchado, E. (eds) International Joint Conference SOCO’17-CISIS’17-ICEUTE’17 León, Spain, September 6–8, 2017, Proceeding. SOCO ICEUTE CISIS 2017 2017 2017. Advances in Intelligent Systems and Computing, vol 649. Springer, Cham. https://doi.org/10.1007/978-3-319-67180-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67180-2_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67179-6

  • Online ISBN: 978-3-319-67180-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics