Abstract
Scientific workflows are being used today in a number of areas. As they grow in complexity and importance, cloud computing emerges as an important execution environment. In this scenario, scheduling the workflow tasks and data on the cloud ensuring proper use of the computational resources is one of the key issues in the management of workflow execution. Although many workflow schedulers have been proposed in the literature, few of them deal with heterogeneous computing resources and data file assignment. The Hybrid Evolutionary Algorithm to Task Scheduling and Data File Assignment Problem (HEA-TaSDAP) addresses these two problems simultaneously, but the scheduling is time consuming, especially if we consider large scale workflows. In this work, we propose optimizations on HEA-TaSDAP by taking advantage of the massive parallelism provided by GPUs, leveraging the scheduling of larger instances in a reasonable amount of time. Our parallel solution provided about 98.83% of reductions in the scheduling time, keeping the quality of the solutions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abrishami, S., Naghibzadeh, M., Epema, D.H.: Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Future Gener. Comput. Syst. 29(1), 158–169 (2013)
Bharathi, S., Chervenak, A., Deelman, E., Mehta, G., Su, M.H., Vahi, K.: Characterization of scientific workflows. In: 2008 Third Workshop on Workflows in Support of Large-Scale Science, WORKS 2008, pp. 1–10, November 2008
Coelho, I., Munhoz, P., Ochi, L., Souza, M., Bentes, C., Farias, R.: An integrated CPU-GPU heuristic inspired on variable neighbourhood search for the single vehicle routing problem with deliveries and selective pickups. Int. J. Prod. Res. 54(4), 945–962 (2016)
de Oliveira, D., Baião, F.A., Mattoso, M.: Towards a taxonomy for cloud computing from an e-science perspective. In: Antonopoulos, N., Gillam, L. (eds.) Cloud Computing. CCN, pp. 47–62. Springer, London (2010). https://doi.org/10.1007/978-1-84996-241-4_3
De Oliveira, D., Ocaña, K.A., Ogasawara, E., Dias, J., GonçAlves, J., Baião, F., Mattoso, M.: Performance evaluation of parallel strategies in public clouds: a study with phylogenomic workflows. Future Gener. Comput. Syst. 29(7), 1816–1825 (2013)
Deelman, E., et al.: Pegasus: mapping scientific workflows onto the grid. In: Dikaiakos, M.D. (ed.) AxGrids 2004. LNCS, vol. 3165, pp. 11–20. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-28642-4_2
Luong, T.V., Melab, N., Talbi, E.G.: Neighborhood structures for GPU-based local search algorithms. Parallel Process. Lett. 20(04), 307–324 (2010)
Özçetin, E., Öztürk, G.: A hybrid genetic algorithm for the quadratic assignment problem on graphics processing units. Anadolu Univ. J. Sci. Technol.-A Appl. Sci. Eng. 17(1), 167–180 (2016)
Pandey, S., Wu, L., Guru, S.M., Buyya, R.: A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 24th International Conference on Advanced Information Networking and Applications (AINA), pp. 400–407. IEEE (2010)
Rios, E., Coelho, I.M., Ochi, L.S., Boeres, C., Farias, R.: A benchmark on multi improvement neighborhood search strategies in CPU/GPU systems. In: 2016 International Symposium on Computer Architecture and High Performance Computing Workshops (SBAC-PADW), pp. 49–54. IEEE (2016)
Szabo, C., Sheng, Q.Z., Kroeger, T., Zhang, Y., Yu, J.: Science in the cloud: allocation and execution of data-intensive scientific workflows. J. Grid Comput. 12(2), 245–264 (2013)
Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M.: Workflows for e-Science: Scientific Workflows for Grids. Springer, New York (2006). https://doi.org/10.1007/978-1-84628-757-2
Teylo, L., de Paula, U., Frota, Y., de Oliveira, D., Drummond, L.M.: A hybrid evolutionary algorithm for task scheduling and data assignment of data-intensive scientific workflows on clouds. Future Gener. Comput. Syst. 76, 1–17 (2017)
Topcuouglu, H., Hariri, S., Wu, M.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13(3), 260–274 (2002)
Zhou, Y., He, F., Qiu, Y.: Optimization of parallel iterated local search algorithms on graphics processing unit. J. Supercomput. 72(6), 2394–2416 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Cieza, E., Teylo, L., Frota, Y., Bentes, C., Drummond, L.M.A. (2019). A GPU-Based Metaheuristic for Workflow Scheduling on Clouds. In: Senger, H., et al. High Performance Computing for Computational Science – VECPAR 2018. VECPAR 2018. Lecture Notes in Computer Science(), vol 11333. Springer, Cham. https://doi.org/10.1007/978-3-030-15996-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-15996-2_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-15995-5
Online ISBN: 978-3-030-15996-2
eBook Packages: Computer ScienceComputer Science (R0)