Automated Software Engineering

, Volume 26, Issue 1, pp 125–159 | Cite as

Cost-aware scheduling for ensuring software performance and reliability under heterogeneous workloads of hybrid cloud

  • Chunlin LiEmail author
  • Jianhang Tang
  • Youlong Luo


Cloud computing is a rapidly growing paradigm in software engineering that offers different services. The hybrid cloud is the best choice for the enterprise to benefit by taking resources on lease from the public cloud only if private cloud resources are not sufficient. However, the key is how to provide better cloud services and improve software performance in the hybrid cloud for software engineers. In this paper, the efficient job scheduling method in the private cloud is proposed by considering the heterogeneity of hybrid cloud resources to guarantee the software performance and reliability. The experimental results show that the efficient job scheduling method can effectively reduce the average job response time and improve the system throughput. Moreover, the task scheduling method based on BP neural network in the hybrid cloud is proposed by considering both the cost and deadline constraints to ensure the quality of service (QoS) for software. The experimental results show that the task scheduling method can improve the QoS, maximize the resources utilization of private cloud and minimize the cost of hybrid cloud resources.


Hybrid cloud Heterogeneous workloads Job scheduling Software performance 



The work was supported by the National Natural Science Foundation (NSF) under grants (No.61672397, No.61873341), Application Foundation Frontier Project of WuHan (No. 2018010401011290), the Fundamental Research Funds for the Central Universities (WUT No.2017-YB-029), the Opening Project of State Key Laboratory of Digital Publishing Technology, the Opening Project of State Key Laboratory of Software Development Environment, Beihang University. Any opinions, findings, and conclusions are those of the authors and do not necessarily reflect the views of the above agencies.


  1. Abdi, S., Pourkarimi, L., Ahmadi, M., et al.: Cost minimization for deadline-constrained bag-of-tasks applications in federated hybrid clouds. Fut. Gener. Comput. Syst. 71, 113–128 (2017)CrossRefGoogle Scholar
  2. Abrishami, H., Rezaeian, A., Tousi, G.K., et al.: Scheduling in hybrid cloud to maintain data privacy. In: Proceeding of 2015 International Conference on Innovative Computing Technology, IEEE, pp. 83–88 (2015)Google Scholar
  3. Arantes, L., Friedman, R., Marin, O., et al.: Probabilistic byzantine tolerance scheduling in hybrid cloud environments. In: International Conference on Distributed Computing and NETWORKING, ACM, pp. 2–12 (2017)Google Scholar
  4. Balagoni, Y., Rao, R.R.: A cost-effective SLA-aware scheduling for hybrid cloud environment. In: IEEE International Conference on Computational Intelligence and Computing Research, IEEE, pp. 1–7 (2017)Google Scholar
  5. Bansal, M., Venkaiah, V.: Improved fully polynomial time approximation scheme for the 0-1 multiple-choice knapsack problem. In: Proceedings of SIAM Conference on Discrete Mathematics, pp. 1–10 (2004)Google Scholar
  6. Cao, Y., Lu, L., Yu, J., et al.: Online cost-aware service requests scheduling in hybrid clouds for cloud bursting. In: Web Information Systems Engineering, pp. 259–274 (2017)Google Scholar
  7. Chandra, A.K., Hirschberg, D.S., Wong, C.K.: Approximate algorithms for some generalized knapsack problems. Theoret. Comput. Sci. 3(3), 293–304 (1976)MathSciNetCrossRefzbMATHGoogle Scholar
  8. Chen, K., Powers, J., Guo, S., Tian, F.: CRESP: towards optimal resource provisioning for MapReduce computing in public clouds. IEEE Trans. Parallel Distrib. Syst. 25(6), 1403–1412 (2014)CrossRefGoogle Scholar
  9. Chopra, N., Singh, S.: Deadline and cost based workflow scheduling in hybrid cloud. In: 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Mysore, pp. 840–846 (2013)Google Scholar
  10. Chunlin, L., Xin, Y., Yang, Z., Youlong, L.: Multiple context based service scheduling for balancing cost and benefits of mobile users and cloud datacenter supplier in mobile cloud. Comput. Netw. 122, 138–152 (2017)CrossRefGoogle Scholar
  11. Clemente-Castelló, F.J., Mayo, R., Fernández, J.C.: Cost model and analysis of iterative MapReduce applications for hybrid cloud bursting. In: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), Madrid, pp. 858–864Google Scholar
  12. Clemente-Castelló, F.J., Nicolae, B., Katrinis, K., et al.: Enabling big data analytics in the hybrid cloud using iterative MapReduce. In: Proceeding of 2015 IEEE Conference on Utility and Cloud Computing, IEEE Computer Society, pp. 290–299 (2015)Google Scholar
  13. Clemente-Castelló, F.J., Nicolae, B., Mayo, R., Fernández, J.C.: Performance model of MapReduce iterative applications for hybrid cloud bursting. IEEE Trans. Parallel Distrib. Syst. 29(8), 1794–1807 (2018)CrossRefGoogle Scholar
  14. Cunha, R.L.F., Rodrigues, E.R., Tizzei, L.P., et al.: Job placement advisor based on turnaround predictions for HPC hybrid clouds. Fut. Gener. Comput. Syst. 67, 35–46 (2017)CrossRefGoogle Scholar
  15. Farokhi, S., Jamshidi, P., Lakew, E.B., et al.: A hybrid cloud controller for vertical memory elasticity: a control-theoretic approach. Fut. Gener. Comput. Syst. 65, 57–72 (2016)CrossRefGoogle Scholar
  16. Genez, T.A.L., Bittencourt, L.F., Madeira, E.R.M.: On the Performance-cost tradeoff for workflow scheduling in hybrid clouds. In: 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing, Dresden, pp. 411–416 (2013)Google Scholar
  17. Hwang, C.G., Yoon, C.P., Lee, D.: Exchange of data for big data in hybrid cloud environment. Int. J. Softw. Eng. Its Appl. 9(4), 67–72 (2015)Google Scholar
  18. Kellerer, H., Pferschy, U., Pisinger, D.: Knapsack Problems, pp. 317–347. Springer, Berlin Heidelberg (2004)CrossRefzbMATHGoogle Scholar
  19. Kuhnle, A., Alim, M.A., Li, X., Zhang, H., Thai, M.T.: Multiplex influence maximization in online social networks with heterogeneous diffusion models. IEEE Trans. Comput. Soc. Syst. 5(2), 418–429 (2018)CrossRefGoogle Scholar
  20. Li, C., Li, L.Y.: Hybrid cloud scheduling method for cloud bursting. Fundamenta Informaticae 138(4), 435–455 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  21. Li, S., Zhou, Y., Jiao, L., Yan, X., Wang, X., Lyu, M.R.: Towards operational cost minimization in hybrid clouds for dynamic resource provisioning with delay-aware optimization. IEEE Trans. Serv. Comput. 8(3), 398–409 (2015)CrossRefGoogle Scholar
  22. Li, C., Liye, Z., Hengliang, T., Luo, Y.: Mobile user behavior based topology formation and optimization in ad hoc mobile cloud. J. Syst. Softw. 148, 132–147 (2019a)CrossRefGoogle Scholar
  23. Li, C., Bai, J., Tang, J.: Joint optimization of data placement and scheduling for improving user experience in edge computing. J. Parallel Distrib. Comput. 125, 93–105 (2019b)CrossRefGoogle Scholar
  24. Liu, Y., Li, C., Yang, Z., et al.: Research on cost-optimal algorithm of multi-QoS constraints for task scheduling in hybrid-cloud. J. Softw. Eng. 9(1), 33–49 (2015)CrossRefGoogle Scholar
  25. Mell, P., Grance, T.: The NIST definition of cloud computing (2011)Google Scholar
  26. Patel, C., Gulati, R.: Identifying ideal values of parameters for software performance testing. In: 2015 International Conference on Computing, Communication and Security (ICCCS), pp. 1–5 (2015)Google Scholar
  27. Qiu, X., Li, H., Wu, C., Li, Z., Lau, F.C.M.: Cost-minimizing dynamic migration of content distribution services into hybrid clouds. IEEE Trans. Parallel Distrib. Syst. 26(12), 3330–3345 (2015)CrossRefGoogle Scholar
  28. Rasooli, A., Down, D.G.: COSHH: A classification and optimization based scheduler for heterogeneous Hadoop systems. Fut. Gener. Comput. Syst. 36, 1–15 (2014)CrossRefGoogle Scholar
  29. Shao, Y., Li, C., Tang, H.: A data replica placement strategy for IoT workflows in collaborative edge and cloud environments. Comput. Netw. 148(15), 46–59 (2019)Google Scholar
  30. Taheri, J., Zomaya, A.Y., Siegel, H.J., et al.: Pareto frontier for job execution and data transfer time in hybrid clouds. Fut. Gener. Comput. Syst. 37, 321–334 (2014)CrossRefGoogle Scholar
  31. Tang, H., Li, C., Bai, J., Tang, J., Luo, Y.: Dynamic resource allocation strategy for latency-critical and computation-intensive applications in cloud-edge environment. Comput. Commun. 134(15), 70–82 (2019)CrossRefGoogle Scholar
  32. Wang, W.J., Chang, Y.S., Lo, W.T., et al.: Adaptive scheduling for parallel tasks with QoS satisfaction for hybrid cloud environments. J. Supercomput. 66(2), 783–811 (2013)CrossRefGoogle Scholar
  33. Wei, H., Meng, F.: A novel scheduling mechanism for hybrid cloud systems. In: International Conference on Cloud Computing, IEEE, pp. 734–741 (2017)Google Scholar
  34. Weinman, J.: Hybrid cloud economics. IEEE Cloud Comput. 3(1), 18–22 (2016)CrossRefGoogle Scholar
  35. Xie, J., Song, W., Tao, X.: A study of multicast message allocation for content distribution with device-to-device communications. In: 2017 IEEE 86th Vehicular Technology Conference (VTC-Fall), Toronto, pp. 1–6 (2017)Google Scholar
  36. Yuhua, L., Minyan, L., Biao, X.: Software reliability case development method based on software reliability characteristic model and measures of defect control. In: 2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, pp. 1–6 (2016)Google Scholar
  37. Zhang, Y., Sun, J., Zhu, J.: An effective heuristic for due-date-constrained Bag-of-Tasks scheduling problem for total cost minimization on hybrid clouds. In: 2016 International Conference on Progress in Informatics and Computing (PIC), Shanghai, pp. 479–486 (2016)Google Scholar
  38. Zhou, Y.: Improved multi-unit auction clearing algorithms with interval (multiple-choice) knapsack problems. In: International Conference on Algorithms and Computation, Springer, pp. 494–506 (2006)Google Scholar
  39. Zuo, X., Zhang, G., Tan, W.: Self-adaptive learning PSO-based deadline constrained task scheduling for hybrid IaaS cloud. Autom. Sci. Eng. IEEE Trans. 11(2), 564–573 (2014)CrossRefGoogle Scholar
  40. Zuo, L., Shu, L., Dong, S., Chen, Y., Yan, L.: A multi-objective hybrid cloud resource scheduling method based on deadline and cost constraints. IEEE Access. 5, 22067–22080 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer ScienceWuhan University of TechnologyWuhanPeople’s Republic of China
  2. 2.State Key Laboratory of Digital Publishing TechnologyBeijingPeople’s Republic of China
  3. 3.State Key Laboratory of Software Development EnvironmentBeihang UniversityBeijingPeople’s Republic of China

Personalised recommendations