Advertisement

Critical Path-Based Iterative Heuristic for Workflow Scheduling in Utility and Cloud Computing

  • Zhicheng Cai
  • Xiaoping Li
  • Jatinder N. D. Gupta
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8274)

Abstract

This paper considers the workflow scheduling problem in utility and cloud computing. It deals with the allocation of tasks to suitable resources so as to minimize total rental cost of all resources while maintaining the precedence constraints on one hand and meeting workflow deadlines on the other. A Mixed Integer programming (MILP) model is developed to solve small-size problem instances. In view of its NP-hard nature, a Critical Path-based Iterative (CPI) heuristic is developed to find approximate solutions to large-size problem instances where the multiple complete critical paths are iteratively constructed by Dynamic Programming according to the service assignments for scheduled activities and the longest (cheapest) services for the unscheduled ones. Each critical path optimization problem is relaxed to a Multi-stage Decision Process (MDP) problem and optimized by the proposed dynamic programming based Pareto method. The results of the scheduled critical path are utilized to construct the next new critical path. The iterative process stops as soon as the total duration of the newly found critical path is no more than the deadline of all tasks in the workflow. Extensive experimental results show that the proposed CPI heuristic outperforms the existing state-of-the-art algorithms on most problem instances. For example, compared with an existing PCP (partial critical path based) algorithm, the proposed CPI heuristic achieves a 20.7% decrease in the average normalized resource renting cost for instances with 1,000 activities.

Keywords

Cloud computing workflow scheduling utility computing critical path dynamic programming multi-stage decision process 

References

  1. 1.
    Chard, K., Bubendorfer, K.: High performance resource allocation strategies for computational economies. IEEE Transactions on Parallel and Distributed Systems 24(1), 72–84 (2013)CrossRefGoogle Scholar
  2. 2.
    Kwok, Y.K., Ahmad, I.: Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Computing Surveys (CSUR) 31(4), 406–471 (1999)CrossRefGoogle Scholar
  3. 3.
    Bajaj, R., Agrawal, D.P.: Improving scheduling of tasks in a heterogeneous environment. IEEE Transactions on Parallel and Distributed Systems 15(2), 107–118 (2004)CrossRefGoogle Scholar
  4. 4.
    Byun, E.K., Kee, Y.S., Kim, J.S., Deelman, E., Maeng, S.: Bts: Resource capacity estimate for time-targeted science workflows. Journal of Parallel and Distributed Computing 71(6), 848–862 (2011)CrossRefGoogle Scholar
  5. 5.
    De, P., Dunne, E., Ghosh, J., Wells, C.: Complexity of the discrete time-cost tradeoff problem for project networks. Operations Research 45(2), 302–306 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Yu, J., Buyya, R., Tham, C.: Cost-based scheduling of scientific workflow applications on utility grids. In: First International Conference on e-Science and Grid Computing, p. 8. IEEE (2005)Google Scholar
  7. 7.
    Yuan, Y., Li, X., Wang, Q., Zhu, X.: Deadline division-based heuristic for cost optimization in workflow scheduling. Information Sciences 179(15), 2562–2575 (2009)CrossRefzbMATHGoogle Scholar
  8. 8.
    Abrishami, S., Naghibzadeh, M., Epema, D.: Cost-driven scheduling of grid workflows using partial critical paths. IEEE Transactions on Parallel and Distributed Systems 23(8), 1400–1414 (2012)CrossRefGoogle Scholar
  9. 9.
    Yu, J., Buyya, R.: Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Scientific Programming 14(3), 217–230 (2006)Google Scholar
  10. 10.
    Chen, W.N., Zhang, J.: An ant colony optimization approach to a grid workflow scheduling problem with various qos requirements. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 39(1), 29–43 (2009)CrossRefGoogle Scholar
  11. 11.
    Wu, Z., Liu, X., Ni, Z., Yuan, D., Yang, Y.: A market-oriented hierarchical scheduling strategy in cloud workflow systems. The Journal of Supercomputing 63(1), 256–293 (2013)CrossRefGoogle Scholar
  12. 12.
    Abrishami, S., Naghibzadeh, M., Epema, D.: Deadline-constrained workflow scheduling algorithms for iaas clouds. In: Future Generation Computer Systems (2012)Google Scholar
  13. 13.
    Demeulemeester, E., Vanhoucke, M., Herroelen, W.: Rangen: A random network generator for activity-on-the-node networks. Journal of Scheduling 6(1), 17–38 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Akkan, C., Drexl, A., Kimms, A.: Network decomposition-based benchmark results for the discrete time–cost tradeoff problem. European Journal of Operational Research 165(2), 339–358 (2005)CrossRefzbMATHGoogle Scholar
  15. 15.
    Kolisch, R., Sprecher, A., Drexl, A.: Characterization and generation of a general class of resource-constrained project scheduling problems. Management Science 41(10), 1693–1703 (1995)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Zhicheng Cai
    • 1
  • Xiaoping Li
    • 1
  • Jatinder N. D. Gupta
    • 2
  1. 1.Computer Science and EngineeringSoutheast UniversityNanjingChina
  2. 2.College of Business AdministrationUniversity of Alabama in HuntsvilleHuntsvilleUSA

Personalised recommendations