Dynamic provisioning of resources based on load balancing and service broker policy in cloud computing

  • Amrita JyotiEmail author
  • Manish Shrimali


Dynamic resource allocation is the key objective of the paper motivated due to a large number of user’s service request and increasing network infrastructure complexity. Load balancing and Service Broker Policy are taken as two main key areas for the dynamic provision of resources to the cloud user in order to meet the QoS requirement. While provisioning the resources, the conventional approaches degrade due to QoS performance limits such as time delay, energy, etc. To overcome those problems, we proposed a new approach to provide dynamic provisioning of resources based on load balancing and service brokering. Initially, the Multi-agent Deep Reinforcement Learning-Dynamic Resource Allocation (MADRL-DRA) is used in the Local User Agent (LUA) to predict the environmental activities of user task and allocate the task to the Virtual Machine (VM) based on priority. Next, a Load balancing (LB) is performed in the VM, which increases the throughput and reduces the response time in the resource allocation task. Secondly, the Dynamic Optimal Load-Aware Service Broker (DOLASB) is used in the Global User Agent (GUA) for scheduling the task and provide the services to the users based on the available cloud brokers (CBs). In the global agent, cloud brokers are the mediators between users and providers. The optimization problem in Global Agent (GA) is formulated by the programming of mixed integers, and Bender decomposition algorithm. The result of our proposed method is better as compared with the conventional techniques in terms of Execution Time, Waiting Time, Energy Efficiency, Throughput, Resource Usage, and Makespan.


Cloud computing Multi-agent deep reinforcement learning Dynamic optimal load-aware service broker Dynamic resource allocation Service Measurement Index Mixed Integer Programming 



  1. 1.
    Sodemann, A.A., Ross, M.P., Borghetti, B.J.: A review of anomaly detection in automated surveillance. IEEE Trans. Syst. Man Cybern. C (Appl. Rev.) 42(6), 1257–1272 (2012)CrossRefGoogle Scholar
  2. 2.
    Madni, S.H.H., Latiff, M.S.A., Coulibaly, Y.: Recent advancements in resource allocation techniques for cloud computing environment: a systematic review. Clust. Comput. 20(3), 2489–2533 (2017)CrossRefGoogle Scholar
  3. 3.
    Muthulakshmi, B., Somasundaram, K.: A hybrid ABC-SA based optimized scheduling and resource allocation for cloud environment. Clust. Comput. (2017). Google Scholar
  4. 4.
    Upadhyaya, J., Ahuja, N. J.: Quality of service in cloud computing in higher education: A critical survey and innovative model. In: Proceedings of the 2017 International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), pp. 137–140. IEEE (2017)Google Scholar
  5. 5.
    Katyal, M., Mishra, A.: A comparative study of load balancing algorithms in cloud computing environment. arXiv:1403.6918 (2014)
  6. 6.
    Zhang, Q., Cheng, L., Boutaba, R.: Cloud computing: state-of-the-art and research challenges. J. Internet Serv. Appl. 1(1), 7–18 (2010)CrossRefGoogle Scholar
  7. 7.
    Kaneria, O., Banyal, R.K.: Analysis and improvement of load balancing in cloud computing. In: Proceedings of the International Conference on ICT in Business Industry & Government (ICTBIG), pp. 1–5. IEEE (2016)Google Scholar
  8. 8.
    Ray, S., De Sarkar, A.: Resource allocation scheme in cloud infrastructure. In: Proceedings of the International Conference on Cloud & Ubiquitous Computing & Emerging Technologies (CUBE), 2013, pp. 30–35. IEEE (2013)Google Scholar
  9. 9.
    Hameed, A., Khoshkbarforoushha, A., Ranjan, R., Jayaraman, P.P., Kolodziej, J., Balaji, P., Khan, S.U.: A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems. Computing 98(7), 751–774 (2016)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Moghaddam, F.F., Ahmadi, M., Sarvari, S., Eslami, M., Golkar, A.: Cloud computing challenges and opportunities: a survey. In: Proceedings of the 1st International Conference on Telematics and Future Generation Networks (TAFGEN), 2015, pp. 34–38. IEEE (2015)Google Scholar
  11. 11.
    Wen, H., Chuang, L., Hai-ying, Z., Yang, Y.: Effective load balancing for cloud-based multimedia system. In: Proceedings of 2011 International Conference on Electronic & Mechanical Engineering and Information Technology, vol. 1, pp. 165–168. IEEE (2011)Google Scholar
  12. 12.
    Lal, A., Krishna, C.R.: Critical Path-Based ant colony optimization for scientific workflow scheduling in cloud computing under deadline constraint. In: Proceedings of the Ambient Communications and Computer Systems, pp. 447–461. Springer, SingaporeGoogle Scholar
  13. 13.
    Guddeti, R.M., Buyya, R.: A hybrid bio-inspired algorithm for scheduling and resource management in cloud environment. IEEE Trans. Serv. Comput. (2017). Google Scholar
  14. 14.
    Xiao, Z., Song, W., Chen, Q.: Dynamic resource allocation using virtual machines for cloud computing environment. IEEE Trans. Parallel Distrib. Syst. 24(6), 1107–1117 (2013)CrossRefGoogle Scholar
  15. 15.
    Maguluri, S.T., Srikant, R., Ying, L.: Stochastic models of load balancing and scheduling in cloud computing clusters. In: Proceedings of the INFOCOM, 2012, pp. 702–710. IEEE (2012)Google Scholar
  16. 16.
    Yang, J., Jiang, B., Lv, Z., Choo, K.K.R.: A task scheduling algorithm considering game theory designed for energy management in cloud computing. Fut. Gener. Comput. Syst. (2017). Google Scholar
  17. 17.
    Grover, J., Katiyar, S.: Agent based dynamic load balancing in Cloud Computing. In: Proceedings of the 2013 International Conference on Human Computer Interactions (ICHCI), pp. 1–6. IEEE (2013)Google Scholar
  18. 18.
    Wu, L., Garg, S.K., Buyya, R.: SLA-based admission control for a Software-as-a-Service provider in Cloud computing environments. J. Comput. Syst. Sci. 78(5), 1280–1299 (2012)CrossRefGoogle Scholar
  19. 19.
    Kaur, R., Luthra, P.: Load balancing in cloud computing. In: Proceedings of International Conference on Recent Trends in Information, Telecommunication and Computing, ITC (2012)Google Scholar
  20. 20.
    Tafsiri, S.A., Yousefi, S.: Combinatorial double auction-based resource allocation mechanism in cloud computing market. J. Syst. Softw. 137, 322–334 (2018)CrossRefGoogle Scholar
  21. 21.
    Dam, S., Mandal, G., Dasgupta, K., Dutta, P.: Genetic algorithm and gravitational emulation based hybrid load balancing strategy in cloud computing. In: Proceedings of the 2015 Third International Conference on Computer, Communication, Control and Information Technology (C3IT), pp. 1–7. IEEE (2015)Google Scholar
  22. 22.
    Zhao, J., Yang, K., Wei, X., Ding, Y., Hu, L., Xu, G.: A heuristic clustering-based task deployment approach for load balancing using Bayes theorem in cloud environment. IEEE Trans. Parallel Distrib. Syst. 27(2), 305–316 (2016)CrossRefGoogle Scholar
  23. 23.
    Paya, A., Marinescu, D.C.: Energy-aware load balancing and application scaling for the cloud ecosystem. IEEE Trans. Cloud Comput. 5(1), 15–27 (2017)CrossRefGoogle Scholar
  24. 24.
    Chen, J., Li, K., Tang, Z., Bilal, K., Yu, S., Weng, C., Li, K.: A parallel random forest algorithm for big data in a spark cloud computing environment. IEEE Trans. Parall. Distrib. Syst. 28, 919 (2017)CrossRefGoogle Scholar
  25. 25.
    Gill, S.S., Buyya, R.: Resource provisioning based scheduling framework for execution of heterogeneous and clustered workloads in clouds: from fundamental to autonomic offering. J. Grid Comput. (2018). Google Scholar
  26. 26.
    Singh, S., Chana, I.: EARTH: energy-aware autonomic resource scheduling in cloud computing. J. Intell. Fuzzy Syst. 30(3), 1581–1600 (2016)CrossRefGoogle Scholar
  27. 27.
    Ma, J., Li, W., Fu, T., Yan, L., Hu, G.: A novel dynamic task scheduling algorithm based on improved genetic algorithm in cloud computing. In: Wireless Communications, Networking and Applications, pp. 829–835. Springer, New DelhiGoogle Scholar
  28. 28.
    Liu, X.F., Zhan, Z.H., Deng, J.D., Li, Y., Gu, T., Zhang, J.: An energy efficient ant colony system for virtual machine placement in cloud computing. IEEE Trans. Evol. Comput. 22(1), 113–128 (2018)CrossRefGoogle Scholar
  29. 29.
    Wei, W., Fan, X., Song, H., Fan, X., Yang, J.: Imperfect information dynamic stackelberg game based resource allocation using hidden Markov for cloud computing. IEEE Trans. Serv. Comput. 11(1), 78–89 (2018)CrossRefGoogle Scholar
  30. 30.
    Pillai, P.S., Rao, S.: Resource allocation in cloud computing using the uncertainty principle of game theory. IEEE Syst. J. 10(2), 637–648 (2016)CrossRefGoogle Scholar
  31. 31.
    Peng, G., Wang, H., Dong, J., Zhang, H.: Knowledge-based resource allocation for collaborative simulation development in a multi-tenant cloud computing environment. IEEE Trans. Serv. Comput. 11(2), 306–317 (2018)CrossRefGoogle Scholar
  32. 32.
    Shojafar, M., Cordeschi, N., Baccarelli, E.: Energy-efficient adaptive resource management for real-time vehicular cloud services. IEEE Trans. Cloud Comput. 7, 196–209 (2016)CrossRefGoogle Scholar
  33. 33.
    Patel, H., Patel, R.: Cloud analyst: an insight of service broker policy. Int. J. Adv. Res. Comput. Commun. Eng. 4(1), 122–127 (2015)CrossRefGoogle Scholar
  34. 34.
    Shahdi-Pashaki, S., Teymourian, E., Tavakkoli-Moghaddam, R.: New approach based on group technology for the consolidation problem in cloud computing-mathematical model and genetic algorithm. Comput. Appl. Math. 37(1), 693–718 (2018 Mar 1)MathSciNetCrossRefzbMATHGoogle Scholar
  35. 35.
    Thanka, M.R., Maheswari, P.U., Edwin, E.B.: An improved efficient: artificial bee colony algorithm for security and QoS aware scheduling in cloud computing environment. Clust. Comput. (2017). Google Scholar
  36. 36.
    Park, J., Kim, U., Yun, D., Yeom, K.: C-RCE: an approach for constructing and managing a cloud service broker. J. Grid Comput. (2017). Google Scholar
  37. 37.
    Nagarajan, R., Thirunavukarasu, R.: A fuzzy-based decision-making broker for effective identification and selection of cloud infrastructure services. Soft Comput. 1, 15 (2018)Google Scholar
  38. 38.
    Alaei, N., Safi-Esfahani, F.: RePro-Active: a reactive–proactive scheduling method based on simulation in cloud computing. J. Supercomput. 74(2), 801–829 (2018)CrossRefGoogle Scholar
  39. 39.
    Mishra, S.K., Puthal, D., Sahoo, B., Jena, S.K., Obaidat, M.S.: An adaptive task allocation technique for green cloud computing. J. Supercomput. 74(1), 370–385 (2018)CrossRefGoogle Scholar
  40. 40.
    Somu, N., Kirthivasan, K.: A computational model for ranking cloud service providers using hypergraph based techniques. Fut. Gener. Comput. Syst. 68, 14–30 (2017)CrossRefGoogle Scholar
  41. 41.
    Gupta, I., Kumar, M.S., Jana, P.K.: Efficient workflow scheduling algorithm for cloud computing system: a dynamic priority-based approach. Arab. J. Sci. Eng. 43, 7945–7960 (2018)CrossRefGoogle Scholar
  42. 42.
    Jiang, D., Xu, Z., Liu, J., Zhao, W.: An optimization-based robust routing algorithm to energy-efficient networks for cloud computing. Telecommun. Syst. 63(1), 89–98 (2016)CrossRefGoogle Scholar
  43. 43.
    Zhang, P., Zhou, M.: Dynamic cloud task scheduling based on a two-stage strategy. IEEE Trans. Autom. Sci. Eng. 15(2), 772–783 (2018)CrossRefGoogle Scholar
  44. 44.
    Gai, K., Qiu, M., Zhao, H.: Energy-aware task assignment for mobile cyber-enabled applications in heterogeneous cloud computing. J. Parallel Distrib. Comput. 111, 126–135 (2018)CrossRefGoogle Scholar
  45. 45.
    Zhu, W., Zhuang, Y., Zhang, L.: A three-dimensional virtual resource scheduling method for energy saving in cloud computing. Fut. Gener. Comput. Syst. 69, 66–74 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer Science & EngineeringJRN Rajasthan Vidyapeeth (Deemed) UniversityUdaipurIndia

Personalised recommendations