PCVM.ARIMA: predictive consolidation of virtual machines applying ARIMA method

Abstract

Cloud computing adopts virtualization technology, including migration and consolidation of virtual machines, to overcome resource utilization problems and minimize energy consumption. Most of the approaches have focused on minimizing the number of physical machines and rarely have devoted attention to minimizing the number of migrations. They also decide based on the current resources utilization without considering the demand for resources in the future. Some approaches minimize the number of active physical machines and Service Level Agreement (SLA) violations with the number of unnecessary migrations. They consider the current resource utilization of physical machines and neglect from demands for future resource requirements. As a result, as time passes, the number of unnecessary migrations, and subsequently, the rate of SLA violations in data centers increases. Alternatively, several approaches only focus on a hardware level and reduce the physical machine’s dynamic power consumption. The lack of control over the overload of physical machines increases the amount of violation. In this paper, a framework called PCVM.ARIMA is presented that focuses on the dynamic consolidation of virtual machines over the minimum number of physical machines, minimize the number of unnecessary migrations, detect the physical machine overloading, and SLA based on the ARIMA prediction model. Moreover, the Dynamic Voltage and Frequency Scaling (DVFS) technique is used to apply the optimal frequency to heterogeneous physical machines. The experimental results show that the presented framework significantly reduces energy consumption while it improves the QoS factors in comparison to some baseline methods.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  1. 1.

    Barroso LA, Hölzle U (2007) The case for energy-proportional computing. Computer 40(12):33–37

    Article  Google Scholar 

  2. 2.

    Fan X, Weber W-D, Barroso LA (2007) Power provisioning for a warehouse-sized computer. In: ACM SIGARCH Computer Architecture News, Vol 2. ACM, pp 13–23

  3. 3.

    Murtazaev A, Oh S (2011) Sercon: server consolidation algorithm using live migration of virtual machines for green computing. IETE Tech Rev 28(3):212–231

    Article  Google Scholar 

  4. 4.

    Ding Y, Qin X, Liu L, Wang T (2015) Energy-efficient scheduling of virtual machines in cloud with deadline constraint. Future Gener Comput Syst 50:62–74

    Article  Google Scholar 

  5. 5.

    Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50

    Article  Google Scholar 

  6. 6.

    Mann ZÁ (2018) Cloud simulators in the implementation and evaluation of virtual machine placement algorithms. Softw Pract Exp 48(7):1368–1389

    Article  Google Scholar 

  7. 7.

    Guérout T, Monteil T, Da Costa G, Calheiros RN, Buyya R, Alexandru M (2013) Energy-aware simulation with DVFS. Simul Model Pract Theory 39:76–91

    Article  Google Scholar 

  8. 8.

    Veni T, Bhanu S (2013) A survey on dynamic energy management at virtualization level in cloud data centers. Comput Sci Inform Technol 3:107–117

    Google Scholar 

  9. 9.

    Shirvani MH, Rahmani AM, Sahafi A (2018) A survey study on virtual machine migration and server consolidation techniques in DVFS-enabled cloud datacenter: taxonomy and challenges. J King Saud Univ Comput Inform Sci 32:267–286

    Google Scholar 

  10. 10.

    Li B, Li J, Huai J, Wo T, Li Q, Zhong L (2009) Enacloud: an energy-saving application live placement approach for cloud computing environments. In: 2009 IEEE International Conference on Cloud Computing. IEEE, pp 17–24

  11. 11.

    Feller E, Rilling L, Morin C (2011) Energy-aware ant colony based workload placement in clouds. In: Proceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing. IEEE Computer Society, pp 26–33

  12. 12.

    Lin C-C, Liu P, Wu J-J (2011) Energy-aware virtual machine dynamic provision and scheduling for cloud computing. In: 2011 IEEE International Conference on Cloud Computing (CLOUD). IEEE, pp 736–737

  13. 13.

    Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr Comput Pract Exp 24(13):1397–1420

    Article  Google Scholar 

  14. 14.

    Huang Q, Su S, Xu S, Li J, Xu P, Shuang K (2013) Migration-based elastic consolidation scheduling in cloud data center. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems Workshops. IEEE, pp 93–97

  15. 15.

    Farahnakian F, Pahikkala T, Liljeberg P, Plosila J, Tenhunen H (2015) Utilization prediction aware VM consolidation approach for green cloud computing. In: 2015 IEEE 8th International Conference on Cloud Computing. IEEE, pp 381–388

  16. 16.

    Farahnakian F, Pahikkala T, Liljeberg P, Plosila J, Hieu NT, Tenhunen H (2016) Energy-aware VM consolidation in cloud data centers using utilization prediction model. IEEE Trans Cloud Comput (In press)

  17. 17.

    Mosa A, Paton NW (2016) Optimizing virtual machine placement for energy and SLA in clouds using utility functions. J Cloud Comput 5(1):17

    Article  Google Scholar 

  18. 18.

    Duan H, Chen C, Min G, Wu Y (2016) Energy-aware scheduling of virtual machines in heterogeneous cloud computing systems. Future Gener Comput Syst 4:142–150

    Google Scholar 

  19. 19.

    Mazumdar S, Pranzo M (2017) Power efficient server consolidation for cloud data center. Future Gener Comput Syst 70:4–16

    Article  Google Scholar 

  20. 20.

    Fu X, Zhou C (2017) Predicted affinity based virtual machine placement in cloud computing environments. IEEE Trans Cloud Comput (In press)

  21. 21.

    Wang H, Tianfield H (2018) Energy-aware dynamic virtual machine consolidation for cloud datacenters. IEEE Access 6:15259–15273

    Article  Google Scholar 

  22. 22.

    Liu Y, Sun X, Wei W, Jing W (2018) Enhancing energy-efficient and QoS dynamic virtual machine consolidation method in cloud environment. IEEE Access 6:31224–31235

    Article  Google Scholar 

  23. 23.

    Li L, Dong J, Zuo D, Wu J (2019) SLA-aware and energy-efficient VM consolidation in cloud data centers using robust linear regression prediction model. IEEE Access 7:9490–9500

    Article  Google Scholar 

  24. 24.

    Von Laszewski G, Wang L, Younge AJ, He X (2009) Power-aware scheduling of virtual machines in dvfs-enabled clusters. In: 2009 IEEE International Conference on Cluster Computing and Workshops. IEEE, pp 1–10

  25. 25.

    Lee YC, Zomaya AY (2009) Minimizing energy consumption for precedence-constrained applications using dynamic voltage scaling. In: 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. IEEE, pp 92–99

  26. 26.

    Rizvandi NB, Taheri J, Zomaya AY, Lee YC (2010) Linear combinations of dvfs-enabled processor frequencies to modify the energy-aware scheduling algorithms. In: 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid). IEEE, pp 388–397

  27. 27.

    Lee L-T, Liu K-Y, Huang H-Y, Tseng C-Y (2013) A dynamic resource management with energy saving mechanism for supporting cloud computing. Int J Grid Distrib Comput 6(1):67–76

    Google Scholar 

  28. 28.

    Hagimont D, Kamga CM, Broto L, Tchana A, De Palma N (2013) DVFS aware CPU credit enforcement in a virtualized system. In: ACM/IFIP/USENIX International Conference on Distributed Systems Platforms and Open Distributed Processing, Springer, pp 123–142

  29. 29.

    Wu C-M, Chang R-S, Chan H-Y (2014) A green energy-efficient scheduling algorithm using the DVFS technique for cloud datacenters. Future Gener Comput Syst 37:141–147

    Article  Google Scholar 

  30. 30.

    Alnowiser A, Aldhahri E, Alahmadi A, Zhu MM (2014) Enhanced weighted round robin (ewrr) with dvfs technology in cloud energy-aware. In: 2014 International Conference on Computational Science and Computational Intelligence (CSCI). IEEE, pp 320–326

  31. 31.

    Arroba P, Moya JM, Ayala JL, Buyya R (2017) Dynamic Voltage and Frequency Scaling-aware dynamic consolidation of virtual machines for energy efficient cloud data centers. Concurr Comput Pract Exp 29(10):e4067

    Article  Google Scholar 

  32. 32.

    Beloglazov A, Buyya R, Lee YC, Zomaya A (2011) A taxonomy and survey of energy-efficient data centers and cloud computing systems. Adv Comput 82(2):47–111

    Article  Google Scholar 

  33. 33.

    Arroba P, Buyya R (2015) DVFS-aware consolidation for energy-efficient clouds. In: 2015 International Conference on Parallel Architecture and Compilation (PACT). IEEE, pp 494–495

  34. 34.

    Hasanzadeh J, Najafi F, Moradinazar M (2015) How to choose an appropriate model for time series data? Iran J Epidemiol 11(1):94–102

    Google Scholar 

  35. 35.

    Calheiros RN, Masoumi E, Ranjan R, Buyya R (2014) Workload prediction using ARIMA model and its impact on cloud applications’ QoS. IEEE Trans Cloud Comput 3(4):449–458

    Article  Google Scholar 

  36. 36.

    MATLAB, “Box-Jenkins Methodology - MATLAB & Simulink.” [Online]. https://www.mathworks.com/help/econ/box-jenkins-methodology.html. Accessed 5 June 2020

  37. 37.

    Adhikari R, Agrawal R (2013) An introductory study on time series modeling and forecasting. arXiv preprint arXiv:13026613

  38. 38.

    Shojaei K, Safi-Esfahani F, Ayat S (2018) VMDFS: virtual machine dynamic frequency scaling framework in cloud computing. J Supercomput 74(11):5944–5979. https://doi.org/10.1007/s11227-018-2508-1

    Article  Google Scholar 

  39. 39.

    Motavaselalhagh F, Esfahani FS, Arabnia HR (2015) Knowledge-based adaptable scheduler for SaaS providers in cloud computing. Hum-cent Comput Inf Sci 5(1):16

    Article  Google Scholar 

  40. 40.

    Salimian L, Esfahani FS, Nadimi-Shahraki MH (2016) An adaptive fuzzy threshold-based approach for energy and performance efficient consolidation of virtual machines. Computing 98(6):641–660

    MathSciNet  Article  Google Scholar 

  41. 41.

    Torabi S, Safi-Esfahani F (2018) A dynamic task scheduling framework based on chicken swarm and improved raven roosting optimization methods in cloud computing. J Supercomput 74(6):2581–2626

    Article  Google Scholar 

  42. 42.

    Alaei N, Safi-Esfahani F (2018) RePro-Active: a reactive–proactive scheduling method based on simulation in cloud computing. J Supercomput 74(2):801–829

    Article  Google Scholar 

  43. 43.

    Momenzadeh Z, Safi-Esfahani F (2019) Workflow scheduling applying adaptable and dynamic fragmentation (WSADF) based on runtime conditions in cloud computing. Future Gener Comput Syst 90:327–346

    Article  Google Scholar 

  44. 44.

    Meshkati J, Safi-Esfahani F (2019) Energy-aware resource utilization based on particle swarm optimization and artificial bee colony algorithms in cloud computing. J Supercomput 75(5):2455–2496

    Article  Google Scholar 

  45. 45.

    Khorsand R, Safi-Esfahani F, Nematbakhsh N, Mohsenzade M (2017) ATSDS: adaptive two-stage deadline-constrained workflow scheduling considering run-time circumstances in cloud computing environments. J Supercomput 73(6):2430–2455

    Article  Google Scholar 

  46. 46.

    Kamalinasab S, Safi-Esfahani F, Shahbazi M (2019) CRFF. GP: cloud runtime formulation framework based on genetic programming. J Supercomput 75(7):3882–3916

    Article  Google Scholar 

  47. 47.

    Hemasian-Etefagh F, Safi-Esfahani F (2019) Dynamic scheduling applying new population grouping of whales meta-heuristic in cloud computing. J Supercomput 75(10):6386–6450

    Article  Google Scholar 

  48. 48.

    Shirani MR, Safi-Esfahani F (2020) Dynamic scheduling of tasks in cloud computing applying dragonfly algorithm, biogeography-based optimization algorithm and Mexican hat wavelet. J Supercomput. https://doi.org/10.1007/s11227-020-03317-8

    Article  Google Scholar 

  49. 49.

    Fadaei Tehrani A, Safi-Esfahani F (2017) A threshold sensitive failure prediction method using support vector machine. Multiag Grid Syst 13(2):97–111

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Faramarz Safi-Esfahani.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix A: The case study

Appendix A: The case study

Virtual machine consolidation improves resource efficiency and minimizes the number of active physical machines. A vm is assigned to a pm that possesses enough resources to execute it. The following example is presented to illustrate the issue of vm consolidation without the prediction of resources. In Fig. 9, at the current time t, two heterogeneous pms with maximum operating frequency are processing three computational vms. Host1 is processing both vm1 and vm2, while has enough resources to accept vm3. A conventional vm consolidation migrates vm3 to the host1 to reduce the number of active hosts. At time t + 1, the requested resources by vm1 and vm2 are increased. If host1 does not have sufficient computational resources (CPU, memory, etc.) for vm3 requirements, host1 is overloaded, and SLA violation may happen. To avoid SLA violation, vm3 should migrate to host2 again that is a new and extra migration.

Fig. 9
figure9

Consolidation method without the prediction of future resources

According to Fig. 10, the proposed PCVM.ARIMA approach at the time t for migrating vm3 to host1 and switching host2 to the sleep mode, it firstly predicts the resource utilization of the destination host (host1) soon. As predicted, not only host1 resource demand will be increased at time t + 1, but also, the total CPU utilization host1 will exceed the upper dynamic threshold Th and SLA violation will occur. Therefore, unnecessary migration of vm3 is prevented, and each pm will continue operating with an optimized frequency.

Fig. 10
figure10

Consolidation method with the prediction of future resources

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Chehelgerdi-Samani, M., Safi-Esfahani, F. PCVM.ARIMA: predictive consolidation of virtual machines applying ARIMA method. J Supercomput 77, 2172–2206 (2021). https://doi.org/10.1007/s11227-020-03354-3

Download citation

Keywords

  • ARIMA predictive model
  • Cloud computing
  • Dynamic VM consolidation
  • DVFS
  • Energy saving
  • Service Level Agreement (SLA)