Abstract
Many scientific applications are often modeled as workflows. The data and computational resource requirements are high for such workflow applications. Cloud provides a better solution to this problem by offering the promising environment for the execution of these workflow. As it involves tremendous data computations and resources, there is a need to automate the entire process. Workflow management system serves this purpose by orchestrating workflow task and executing it on distributed resources. Pegasus is a well-known workflow management system that has been widely used in large-scale e-applications. This chapter provides an overview about the Pegasus Workflow Management System, describes the environmental setup with OpenStack and creation and execution of workflows in Pegasus, and discusses about the workflow scheduling in cloud with its issues.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mao M, Humphrey M (2011) Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In: High-performance computing, networking, storage and analysis (SC), International conference, pp 1–12, 12–18 Nov, 2011
Juve G, Chervenak A, Deelman E, Bharathi S, Mehta G, Vahi K (2013) Characterizing and profiling scientific workflows. Futur Gener Comput Syst 29(3):682–692
Prajapati HB, Shah VA (2014) Scheduling in grid computing environment 2014 fourth international conference on advanced computing & communication technologies, Rohtak, pp 315–324. doi:10.1109/ACCT. 2014.32
Wu F, Wu Q, Tan Y (2015) Workflow scheduling in cloud: a survey. J Supercomput 71(9):3373–3418
Yu J, Buyya R (2005) A taxonomy of scientific workflow systems for grid computing. ACM SIGMOD 34(3):44–49
Masdari M, ValiKardan S, Shahi Z, Azar SI (2016) Towards workflow scheduling in cloud computing: a comprehensive analysis. J Netw Comput Appl 66:64–82
Michael RG, Johnson DS (1979) Computers and intractability: a guide to the theory of NP Completeness. WH Freeman Co., San Francisco
Armbrust M et al (2009) Above the clouds: a Berkeley view of cloud computing, white paper, UC Berkeley
Foster I et al (2008) Cloud computing and grid computing 360-degree compared. Grid computing environments workshop (GCE ‘08)
Peter M, Grance T. The NIST definition of cloud computing. NIST Special Publication. http://dx.doi.org/10.6028/NIST.SP.800-145
Rodriguez MA, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2:222–235
Thain D, Tannenbaum T, Livny M (2005) Distributed computing in practice: the condor experience. Concurr Comput Exper Pract 17(2–4):323–356. http://dx.doi.org/10.1002/cpe.v17:2/4
Mohanapriya N, Kousalya G, Balakrishnan P (2016) Cloud workflow scheduling algorithms: a survey. Int J Adv Eng Technol VII(III):88–195
Iosup A, Simon O, Nezih Yigitbasi M, Prodan R, Fahringer T, Epema DHJ (2011) Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans Parallel Distrib Syst 22(6):931–945
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Kousalya, G., Balakrishnan, P., Pethuru Raj, C. (2017). Execution of Workflow Scheduling in Cloud Middleware. In: Automated Workflow Scheduling in Self-Adaptive Clouds. Computer Communications and Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-56982-6_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-56982-6_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-56981-9
Online ISBN: 978-3-319-56982-6
eBook Packages: Computer ScienceComputer Science (R0)