An Energy Efficient and Interference Aware Virtual Machine Consolidation Algorithm Using Workload Classification
Inefficient resource usage is one of the greatest causes of high energy consumption in cloud data centers. Virtual Machine (VM) consolidation is an effective method for improving energy related costs and environmental sustainability for modern data centers. While dynamic VM consolidation can improve energy efficiency, virtualisation technologies cannot guarantee performance isolation between co-located VMs resulting in interference issues. We address the problem by introducing a energy and interference aware VM consolidation algorithm. The proposed algorithm utilizes the predictive capabilities of a Machine Learning (ML) model in an attempt to classify VM workloads to make more informed consolidation decisions. Furthermore, using recent workload data from Microsoft Azure we present a comparative study of two popular classification algorithms and select the model with the best performance to incorporate into our proposed approach. Our empirical results demonstrate how our approach improves energy efficiency by 31% while also reducing service violations by 69%.
KeywordsEnergy efficiency Interference aware Virtual machine consolidation Machine Learning Classification
The primary author would like to acknowledge the ongoing financial support provided to her by the Irish Research Council.
- 1.Moreno, I.S., Yang, R., Xu, J., Wo, T.: Improved energy-efficiency in cloud datacenters with interference-aware virtual machine placement. In: 2013 IEEE Eleventh International Symposium on Autonomous Decentralized Systems (ISADS), pp. 1–8. IEEE (2013)Google Scholar
- 2.Shaw, R., Howley, E., Barrett, E.: Predicting the available bandwidth on intra cloud network links for deadline constrained workflow scheduling in public clouds. In: Maximilien, M., Vallecillo, A., Wang, J., Oriol, M. (eds.) ICSOC 2017. LNCS, vol. 10601, pp. 221–228. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-69035-3_15CrossRefGoogle Scholar
- 3.Whitney, J., Delforge, P.: Scaling up energy efficiency across the data center industry: evaluating key drivers and barriers. Technical report, Natural Resources Defense Council (2014)Google Scholar
- 7.Shaw, R., Howley, E., Barrett, E.: An advanced reinforcement learning approach for energy-aware virtual machine consolidation in cloud data centers. In: Proceedings of the 12th International Conference for Internet Technology and Secured Transactions, pp. 61–66. IEEE, December 2017Google Scholar
- 9.Nguyen, T.H., Di Francesco, M., Yla-Jaaski, A.: Virtual machine consolidation with multiple usage prediction for energy-efficient cloud data centers. IEEE Trans. Serv. Comput. (2017). https://doi.org/10.1109/TSC.2017.2648791
- 13.Jersak, L.C., Ferreto, T.: Performance-aware server consolidation with adjustable interference levels. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing, pp. 420–425. ACM, April 2016Google Scholar
- 16.Zhang, J., Figueiredo, R.J.: Application classification through monitoring and learning of resource consumption patterns. In: 20th International Parallel and Distributed Processing Symposium, IPDPS 2006, pp. 10–20. IEEE (2006)Google Scholar
- 17.Nikravesh, A.Y., Ajila, S.A., Lung, C.H.: Towards an autonomic auto-scaling prediction system for cloud resource provisioning. In: Proceedings of the 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, pp. 35–45. IEEE (2015)Google Scholar
- 18.Mason, K., Duggan, J., Howley, E.: Evolving multi-objective neural networks using differential evolution for dynamic economic emission dispatch. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1287–1294. ACM, July 2017Google Scholar
- 20.Dixon, S.J., Brereton, R.G.: Comparison of performance of five common classifiers represented as boundary methods: Euclidean distance to centroids, linear discriminant analysis, quadratic discriminant analysis, learning vector quantization and support vector machines, as dependent on data structure. Chemometr. Intell. Lab. Syst. 95(1), 1–17 (2009)CrossRefGoogle Scholar
- 21.Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., Bianchini, R.: Resource central: understanding and predicting workloads for improved resource management in large cloud platforms. In: Proceedings of the 26th Symposium on Operating Systems Principles, pp. 153–167. ACM, October 2017Google Scholar