Skip to main content
SpringerLink
Log in

Resource Provisioning Strategy for Scientific Workflows in Cloud Computing Environment

  • Chapter
  • First Online:
Book cover Cloud Computing for Optimization: Foundations, Applications, and Challenges

Part of the book series: Studies in Big Data ((SBD,volume 39))

Abstract

Cloud computing has emerged as a computing paradigm to solve large-scale problems. The main intent of Cloud computing is to provide inexpensive computing resources on a pay-as-you-go basis, which is promptly gaining momentum as a substitute for traditional information technology (IT)-based organizations. Therefore, the increased utilization of Clouds makes successful execution of scientific applications a vital research area. As more and more users have started to store and process their real-time data in Cloud environments, resource provisioning and scheduling of huge Data processing jobs becomes a key element of consideration for efficient execution of scientific applications. The base of any real-time system is a resource, and to manage the resources to handle workflow applications in Cloud computing environment is a very tedious task. An inefficient resource management system can have a direct negative effect on performance and cost and indirect effect on functionality of the system. Indeed, some functions provided by the system may become too expensive or may be avoided due to poor performance. Thus, Cloud computing faces the challenge of resource management, especially with respect to choosing resource provisioning strategies and suitable algorithms for particular applications. The major components of resource management systems are resource provisioning and scheduling. If any system is able to fulfill the requirements of these two components, the execution of scientific workflow applications will become much easier. This chapter discusses the fundamental concepts supporting Cloud computing and resource management system terms and the relationship between them. It reflects the essential perceptions behind the Cloud resource provisioning strategies. The chapter also identifies requirements based on user’s applications associated with handling real-time data. A model for resource provisioning based on user’s requirements to maximize efficiency and analysis of scientific workflows is also proposed. QoS parameter (s) based resource provisioning strategy has been proposed for workflow applications in cloud computing environment. Validation of resource provisioning strategies is presented in this book chapter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Schiaas (2015), http://schiaas.gforge.inria.fr/simschlouder.html

  2. R. Abinaya, P. Harris, A Novel Resource Provisioning Approach for Virtualized Environment (2016)

    Google Scholar 

  3. M. Armbrust, A. Fox, R. Griffith, A.D. Joseph, R.H. Katz, A. Konwinski, G. Lee, D.A. Patterson, A. Rabkin, I. Stoica et al., Above the clouds: a Berkeley view of cloud computing (2009)

    Google Scholar 

  4. L. Bittencourt, E. Madeira, HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds. J. Int. Serv. Appl. 2, 207–227 (2011), https://dx.doi.org/10.1007/s13174-011-0032-0, https://dx.doi.org/10.1007/s13174-011-0032-0

    Article  Google Scholar 

  5. L.F. Bittencourt, E.R.M. Madeira, A performance-oriented adaptive scheduler for dependent tasks on grids. Concurr. Comput. Pract. Exper. 20(9), 1029–1049 (2008), https://dx.doi.org/10.1002/cpe.v20:9

    Article  Google Scholar 

  6. E. Burke, G. Kendall, D.L. Silva, R. OBrien, E. Soubeiga, An ant algorithm hyperheuristic for the project presentation scheduling problem, in 2005 IEEE Congress on Evolutionary Computation, vol. 3 (IEEE, 2005), pp. 2263–2270

    Google Scholar 

  7. E.K. Burke, M. Gendreau, G. Hyde, G. Kendall, G. Ochoa, E. O zcan, R. Qu, Hyperheuristics: a survey of the state of the art. J. Oper. Res. Soc. 64(12), 1695–1724 (2013)

    Google Scholar 

  8. R. Buyya, C.S. Yeo, S. Venugopal, J. Broberg, I. Brandic, Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6), 599–616 (2009)

    Article  Google Scholar 

  9. R.N. Calheiros, R. Buyya, Meeting deadlines of scientific workflows in public clouds with tasks replication. IEEE Trans. Parallel Distrib. Syst. 25(7), 1787–1796 (2014)

    Article  Google Scholar 

  10. R.N. Calheiros, R. Ranjan, R. Buyya, Virtual machine provisioning based on analytical performance and qos in cloud computing environments, in 2011 International Conference on Parallel Processing (ICPP) (IEEE, 2011), pp. 295–304

    Google Scholar 

  11. S. Chaisiri, B.S. Lee, D. Niyato, Optimization of resource provisioning cost in cloud computing. IEEE Trans. Serv. Comput. 5(2), 164–177 (2012)

    Article  Google Scholar 

  12. P. Cowling, G. Kendall, L. Han, An investigation of a hyperheuristic genetic algorithm applied to a trainer scheduling problem, in Proceedings of the 2002 Congress on Evolutionary Computation, 2002. CEC02, vol. 2 (IEEE, 2002), pp. 1185–1190

    Google Scholar 

  13. D.G. Feitelson, Workload Modeling for Computer Systems Performance evaluation (Cambridge University Press, Cambridge, 2015)

    Book  Google Scholar 

  14. I. Foster, Y. Zhao, I. Raicu, S. Lu, Cloud computing and grid computing 360-degree compared, in Grid Computing Environments Workshop, 2008. GCE08 (IEEE, 2008), p. 110

    Google Scholar 

  15. A. Fox, R. Griffith, A. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, Above the clouds: a Berkeley view of cloud computing. Dept. Electr. Eng. Comput. Sci. Univ. California Berkeley, Rep. UCB/EECS 28(13), 2009 (2009)

    Google Scholar 

  16. M. Frincu, S. Genaud, J. Gossa, Comparing provisioning and scheduling strategies for workflows on clouds, in Workshop Proceedings of 28th IEEE International Parallel and Distributed Processing Symposium (IEEE, 2013), pp. 2101–2110

    Google Scholar 

  17. S. Genaud, J. Gossa, Cost-wait trade-offs in client-side resource provisioning with elastic clouds, in 4th IEEE International Conference on Cloud Computing (CLOUD 2011) (IEEE, 2011)

    Google Scholar 

  18. F. Glover, Tabu search-part i. ORSA J. Comput. 1(3), 190–206 (1989)

    Article  Google Scholar 

  19. M.A. Iverson, F. O zguner, G.J. Follen, Parallelizing existing applications in a distributed heterogeneous environment, in 4TH Heterogeneous Computing Workshop HCW95 (Citeseer, 1995)

    Google Scholar 

  20. B. Jennings, R. Stadler, Resource management in clouds: survey and research challenges. J. Netw. Syst. Manag. 23(3), 567–619 (2015)

    Article  Google Scholar 

  21. G. Juve, E. Deelman, G.B. Berriman, B.P. Berman, P. Maechling, An evaluation of the cost and performance of scientific workflows on amazon ec2. J. Grid Comput. 10(1), 521 (2012)

    Article  Google Scholar 

  22. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B.P. Berman, P. Maechling, Scientific workflow applications on amazon ec2, in 2009 5th IEEE International Conference on E-Science Workshops (IEEE, 2009), pp. 59–66

    Google Scholar 

  23. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B.P. Berman, P. Maechling, Data sharing options for scientific workflows on amazon ec2, in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (IEEE Computer Society, 2010), p. 19

    Google Scholar 

  24. C. Lin, S. Lu, Scheduling scientific workflows elastically for cloud computing, in 2011 IEEE International Conference on Cloud Computing (CLOUD) (IEEE, 2011), pp. 746–747

    Google Scholar 

  25. W. Lin, C. Liang, J.Z. Wang, R. Buyya, Bandwidth-aware divisible task scheduling for cloud computing. Softw. Pract. Exper. 44(2), 163–174 (2014)

    Article  Google Scholar 

  26. M. Malawski, G. Juve, E. Deelman, J. Nabrzyski, Cost-and deadline-constrained provisioning for scientific workflow ensembles in IAAS clouds, in Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (IEEE Computer Society Press, 2012), p. 22

    Google Scholar 

  27. E. Michon, J. Gossa, S. Genaud, Free elasticity and free CPU power for scientific workloads on IaaS Clouds, in 18th IEEE International Conference on Parallel and Distributed Systems (IEEE, Singapour, Singapore, 2012), http://hal.inria.fr/hal-00733155

  28. I. Chana, Rajni, Bacterial foraging based hyper-heuristic for resource scheduling in grid computing. Future Gener. Comput. Syst. 29(3), 751–762 (2013)

    Google Scholar 

  29. A. Rajni, An empirical study of vm provisioning strategies on IAAS cloud, in 2016 IEEE 18th International Conference on High Performance Computing and Communications (IEEE, 2016)

    Google Scholar 

  30. J. Sen, Security and privacy issues in cloud computing, in Architectures and Protocols for Secure Information Technology Infrastructures (2013), p. 145

    Google Scholar 

  31. J. Shi, J. Luo, F. Dong, J. Zhang, J. Zhang, Elastic resource provisioning for scientific workflow scheduling in cloud under budget and deadline constraints. Cluster Comput. 19(1), 167182 (2016)

    Article  Google Scholar 

  32. S. Srinivasan, G. Juve, R.F. Da Silva, K. Vahi, E. Deelman, A cleanup algorithm for implementing storage constraints in scientific workflow executions, in 2014 9th Workshop on Workflows in Support of Large-Scale Science (WORKS) (IEEE, 2014), pp. 41–49

    Google Scholar 

  33. C. Szabo, Q.Z. Sheng, T. Kroeger, Y. Zhang, J. Yu, Science in the cloud: Allocation and execution of data-intensive scientific workflows. J. Grid Comput. 120 (2013)

    Google Scholar 

  34. D. Villegas, A. Antoniou, S.M. Sadjadi, A. Iosup, An analysis of provisioning and allocation policies for infrastructure-as-a-service clouds, in 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) (IEEE, 2012), pp. 612–619

    Google Scholar 

  35. Z. Wu, X. Liu, Z. Ni, D. Yuan, Y. Yang, A market-oriented hierarchical scheduling strategy in cloud workflow systems. J. Supercomput. 63(1), 256–293 (2013)

    Article  Google Scholar 

  36. A. Zhou, B. He, C. Liu, Monetary cost optimizations for hosting workflow-as-a-service in IAAS clouds (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lovely Professional University, Phagwara, India

    Rajni Aron

Authors
  1. Rajni Aron
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rajni Aron .

Editor information

Editors and Affiliations

  1. School of Computer Engineering, KIIT University, Bhubaneswar, Odisha, India

    Bhabani Shankar Prasad Mishra

  2. School of Computer Engineering, KIIT University, Bhubaneswar, Odisha, India

    Himansu Das

  3. Department of Information and Communication Technology , Fakir Mohan University, Balasore, Odisha, India

    Satchidananda Dehuri

  4. School of Computer Engineering, KIIT University, Bhubaneswar, Odisha, India

    Alok Kumar Jagadev

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Aron, R. (2018). Resource Provisioning Strategy for Scientific Workflows in Cloud Computing Environment. In: Mishra, B., Das, H., Dehuri, S., Jagadev, A. (eds) Cloud Computing for Optimization: Foundations, Applications, and Challenges. Studies in Big Data, vol 39. Springer, Cham. https://doi.org/10.1007/978-3-319-73676-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73676-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73675-4

  • Online ISBN: 978-3-319-73676-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation