Skip to main content

Execution of Workflow Scheduling in Cloud Middleware

  • Chapter
  • First Online:
Automated Workflow Scheduling in Self-Adaptive Clouds

Part of the book series: Computer Communications and Networks ((CCN))

  • 1078 Accesses

Abstract

Many scientific applications are often modeled as workflows. The data and computational resource requirements are high for such workflow applications. Cloud provides a better solution to this problem by offering the promising environment for the execution of these workflow. As it involves tremendous data computations and resources, there is a need to automate the entire process. Workflow management system serves this purpose by orchestrating workflow task and executing it on distributed resources. Pegasus is a well-known workflow management system that has been widely used in large-scale e-applications. This chapter provides an overview about the Pegasus Workflow Management System, describes the environmental setup with OpenStack and creation and execution of workflows in Pegasus, and discusses about the workflow scheduling in cloud with its issues.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 49.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mao M, Humphrey M (2011) Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In: High-performance computing, networking, storage and analysis (SC), International conference, pp 1–12, 12–18 Nov, 2011

    Google Scholar 

  2. Juve G, Chervenak A, Deelman E, Bharathi S, Mehta G, Vahi K (2013) Characterizing and profiling scientific workflows. Futur Gener Comput Syst 29(3):682–692

    Article  Google Scholar 

  3. Prajapati HB, Shah VA (2014) Scheduling in grid computing environment 2014 fourth international conference on advanced computing & communication technologies, Rohtak, pp 315–324. doi:10.1109/ACCT. 2014.32

  4. Wu F, Wu Q, Tan Y (2015) Workflow scheduling in cloud: a survey. J Supercomput 71(9):3373–3418

    Article  Google Scholar 

  5. Yu J, Buyya R (2005) A taxonomy of scientific workflow systems for grid computing. ACM SIGMOD 34(3):44–49

    Article  Google Scholar 

  6. Masdari M, ValiKardan S, Shahi Z, Azar SI (2016) Towards workflow scheduling in cloud computing: a comprehensive analysis. J Netw Comput Appl 66:64–82

    Article  Google Scholar 

  7. Michael RG, Johnson DS (1979) Computers and intractability: a guide to the theory of NP Completeness. WH Freeman Co., San Francisco

    MATH  Google Scholar 

  8. Armbrust M et al (2009) Above the clouds: a Berkeley view of cloud computing, white paper, UC Berkeley

    Google Scholar 

  9. Foster I et al (2008) Cloud computing and grid computing 360-degree compared. Grid computing environments workshop (GCE ‘08)

    Google Scholar 

  10. Peter M, Grance T. The NIST definition of cloud computing. NIST Special Publication. http://dx.doi.org/10.6028/NIST.SP.800-145

  11. Rodriguez MA, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2:222–235

    Article  Google Scholar 

  12. https://pegasus.isi.edu/overview/

  13. Thain D, Tannenbaum T, Livny M (2005) Distributed computing in practice: the condor experience. Concurr Comput Exper Pract 17(2–4):323–356. http://dx.doi.org/10.1002/cpe.v17:2/4

    Article  Google Scholar 

  14. Mohanapriya N, Kousalya G, Balakrishnan P (2016) Cloud workflow scheduling algorithms: a survey. Int J Adv Eng Technol VII(III):88–195

    Google Scholar 

  15. Iosup A, Simon O, Nezih Yigitbasi M, Prodan R, Fahringer T, Epema DHJ (2011) Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans Parallel Distrib Syst 22(6):931–945

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Kousalya, G., Balakrishnan, P., Pethuru Raj, C. (2017). Execution of Workflow Scheduling in Cloud Middleware. In: Automated Workflow Scheduling in Self-Adaptive Clouds. Computer Communications and Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-56982-6_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56982-6_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56981-9

  • Online ISBN: 978-3-319-56982-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics