Abstract
With immense success and rapid growth within the past few years, cloud computing has been established as the dominant paradigm of IT industry. To meet the increasing demand of computing and storage resources, infrastructure cloud providers are deploying planet-scale data centers across the world, consisting of hundreds of thousands, even millions of servers. These data centers incur very high investment and operating costs for the compute and network devices as well as for the energy consumption. Moreover, because of the huge energy usage, such data centers leave large carbon footprints and thus have adverse effects on the environment. As a result, efficient computing resource utilization and energy consumption reduction are becoming crucial issues to make cloud computing successful. Intelligent workload placement and relocation is one of the primary means to address these issues. This chapter presents an overview of the infrastructure resource management systems and technologies and detailed description of the proposed solution approaches for efficient cloud resource utilization and minimization of power consumption and resource wastages. Different types of server consolidation mechanisms are presented along with the solution approaches proposed by the researchers of both academia and industry. Various aspects of workload reconfiguration mechanisms and existing works on workload relocation techniques are described.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Nimbus Project. http://www.nimbusproject.org/.
- 2.
vSphere ESX and ESXi, VMware Inc. http://www.vmware.com/au/products/esxi-and-esx/.
- 3.
Cloud-ready Data Center Reference Architecture. Juniper Networks, Inc. http://www.juniper.net/us/en/local/pdf/reference-architectures/8030001-en.pdf.
- 4.
RUBiS Benchmark, OW2 Consortium. http://rubis.ow2.org/.
References
Akoush S, Sohan R, Rice A, Moore A, Hopper A (2010), Predicting the performance of virtual machine migration, in Modeling, Analysis & Simulation of Computer and Telecommunication Systems (MASCOTS), 2010 IEEE International Symposium on, pp 37–46
Armbrust M, Fox A, Griffith R, Joseph A, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I et al (2010) A view of cloud computing. Communications of the ACM 53(4):50–58
Barham P, Dragovic B, Fraser K, Hand S, Harris T, Ho A, Neugebauer R, Pratt I, Warfield A (2003) Xen and the art of virtualization, in ACM SIGOPS operating systems review, pp 164–177
Barroso L, Holzle U (2007) The case for energy-proportional computing. Computer 40(12):33–37
Beloglazov A, Buyya R (2010) Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers, in proceedings of the 8th international workshop on middleware for grids, clouds and e-science, p 4
Bichler M, Setzer T, Speitkamp B (2006) Capacity planning for virtualized servers, in workshop on information technologies and systems (WITS), Milwaukee, Wisconsin, USA
Brugger B, Doerner K, Hartl R, Reimann M (2004) AntPacking-an ant colony optimization approach for the one-dimensional Bin Packing problem, evolutionary computation in combinatorial optimization, pp 41–50
Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Generat Comput Syst 25(6):599–616
Buyya R, Broberg J, Goscinski, AM (2011) Cloud computing: principles and paradigms. Wiley Online Library
Chaisiri S, Lee B-S, Niyato D (2009) Optimal virtual machine placement across multiple cloud providers, in services computing conference, 2009. APSCC 2009. IEEE Asia-Pacific, pp 103–110
Clark C, Fraser K, Hand S, Hansen J, Jul E, Limpach C, Pratt I, Warfield A (2005) Live migration of virtual machines, in proceedings of the 2nd conference on symposium on networked systems design & implementation, vol 2, pp 273–286
Coffman EG Jr, Garey MR, Johnson DS (1996) Approximation algorithms for Bin Packing: a survey, in approximation algorithms for NP-hard problems, pp 46–93
Cormen T, Leiserson C, Rivest R, Stein C (2001) Introduction to algorithms. MIT press, Cambridge
Crosby S, Brown D (2006) The virtualization reality. Queue 4(10):34–41
David C (2008) The definitive guide to the Xen Hypervisor. Prentice Hall, Upper Saddle River
Dorigo M, Stutzle T (2004) Ant colony optimization. Mit Press, Cambridge
Fan X, Weber W, Barroso L (2007) Power provisioning for a warehouse-sized computer. ACM SIGARCH Comput Archit News 35(2):13–23
Feller E, Rilling L, Morin C (2011), Energy-aware ant colony based workload placement in clouds, in proceedings of the 2011 IEEE/ACM 12th international conference on grid computing, pp 26–33
Feller E, Morin C, Esnault A (2012) A case for fully decentralized dynamic VM consolidation in clouds, in cloud computing technology and science (CloudCom), 2012 IEEE 4th international conference on, pp 26–33.
Gao Y, Guan H, Qi Z, Hou Y, Liu L (2013) A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J Comput Syst Sci 79(8):1230–1242
Guazzone M, Anglano C, Canonico M (2011) Energy-efficient resource management for cloud computing infrastructures, in cloud computing technology and science (CloudCom), 2011 IEEE third international conference on, pp 424–431
He S, Guo L, Guo Y (2011) Real time elastic cloud management for limited resources, in cloud computing (CLOUD), 2011 IEEE international conference on, pp 622–629
Hermenier F, Lorca X, Menaud J-M, Muller G, Lawall J (2009) Entropy: a consolidation manager for clusters, in proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on virtual execution environments, ACM, New York, NY, USA, pp 41–50
Industry Perspectives (2013) Using a total cost of ownership (TCO) model for your data center. http://www.datacenterknowledge.com/archives/2013/10/01/using-a-total-cost-of-ownership-tco-model-for-your-data-center/. Accessed 2 Jan 2014
Jung G, Joshi K, Hiltunen M, Schlichting R, Pu C (2009) A cost-sensitive adaptation engine for server consolidation of multitier applications, Middleware 2009, pp 163–183
Jussien N, Rochart G, Lorca X (2008) The CHOCO constraint programming solver, in CPAIOR’08 workshop on open-source software for integer and constraint programming (OSSICP’08)
Kaplan J, M Forrest W, Kindler N (2008) Revolutionizing data center efficiency. McKinsey & Company
Kivity A, Kamay Y, Laor D, Lublin U, Liguori A (2007) Kvm: the Linux virtual machine monitor, in proceedings of the Linux Symposium, pp 225–230
Kusic D, Kephart JO, Hanson JE, Kandasamy N, Jiang G (2009) Power and performance management of virtualized computing environments via lookahead control. Clust Comput 12(1):1–15
Levine J, Ducatelle F (2004) Ant colony optimization and local search for Bin Packing and cutting stock problems. J Oper Res Soc 55(7):705–716
Li B, Li J, Huai J, Wo T, Li Q, Zhong L (2009) EnaCloud: an energy-saving application live placement approach for cloud computing environments, in cloud computing, 2009. CLOUD’09. IEEE international conference on, pp 17–24
Lim MY, Rawson F, Bletsch T, Freeh VW, (2009), Padd: power aware domain distribution, in distributed computing systems, 2009. ICDCS’09. 29th IEEE international conference on, pp 239–247
Lo J (2005) VMware and CPU virtualization technology. World Wide Web electronic publication
Mell P, Grance T (2011) The NIST definition of cloud computing (draft). NIST special publication vol 800, pp 145
Meng X, Isci C, Kephart J, Zhang L, Bouillet E, Pendarakis D (2010) Efficient resource provisioning in compute clouds via VM multiplexing, in proceedings of the 7th international conference on autonomic computing, pp 11–20
Mi H, Wang H, Yin G, Zhou Y, Shi D, Yuan L (2010) Online self-reconfiguration with performance guarantee for energy-efficient large-scale cloud computing data centers, in services computing (SCC), 2010 IEEE international conference on, pp 514–521
Miller R (2013) Ballmer: Microsoft has 1 million servers. http://www.datacenterknowledge.com/archives/2013/07/15/ballmer-microsoft-has-1-million-servers/. Accessed 2 Jan 2014
Mishra M, Sahoo A (2011) On theory of VM placement: anomalies in existing methodologies and their mitigation using a novel vector based approach, in cloud computing (CLOUD), 2011 IEEE international conference on, pp 275–282
Nagarajan A, Mueller F, Engelmann C, Scott S (2007) Proactive fault tolerance for HPC with Xen virtualization, in proceedings of the 21st annual international conference on supercomputing, pp 23–32
Nelson M, Lim B, Hutchins G et al (2005) Fast transparent migration for virtual machines, in proceedings of the annual conference on USENIX annual technical conference, pp 25–25
Nguyen Van H, Dang Tran F, Menaud J-M (2009) Autonomic virtual resource management for service hosting platforms, in proceedings of the 2009 ICSE workshop on software engineering challenges of cloud computing, IEEE Computer Society, Washington, DC, USA, pp 1–8
Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, Zagorodnov D (2009) The eucalyptus open-source cloud-computing system, in cluster computing and the grid, 2009. CCGRID’09. 9th IEEE/ACM International Symposium on, pp 124–131
Smith J, Nair R (2005) Virtual machines: versatile platforms for systems and processes. Morgan Kaufmann, Burlington
Sotomayor B, Montero R, Llorente I, Foster I (2009) Virtual infrastructure management in private and hybrid clouds. Internet Comput IEEE 13(5):14–22
Speitkamp B, Bichler M (2010) A mathematical programming approach for server consolidation problems in virtualized data centers. IEEE Trans Serv Comput 3(4):266–278
Srikantaiah S, Kansal A, Zhao F (2008) Energy aware consolidation for cloud computing, in proceedings of the 2008 conference on power aware computing and systems
Takemura C, Crawford L (2009) The book of Xen: a practical guide for the system administrator. No Starch, San Francisco
Van Hein N, Tran F, Menaud J-M (2009) SLA-aware virtual resource management for cloud infrastructures, in computer and information technology, 2009. CIT ’09. Ninth IEEE international conference on, pp 357–362.
Van Hein N, Tran F, Menaud J-M, (2010), Performance and power management for cloud infrastructures, in cloud computing (CLOUD), 2010 IEEE 3rd international conference on, pp 329–336.
Vaquero L, Rodero-Merino L, Caceres J, Lindner M (2008) A break in the clouds: towards a cloud definition. ACM SIGCOMM Comput Commun Rev 39(1):50–55
Verma A, Ahuja P, Neogi A (2008) pMapper: power and migration cost aware application placement in virtualized systems, in proceedings of the 9th ACM/IFIP/USENIX international conference on middleware, Springer-Verlag New York, Inc., New York, NY, USA, pp 243–264
Verma A, Kumar G, Koller R (2010) The cost of reconfiguration in a cloud, in proceedings of the 11th international middleware conference industrial track, pp 11–16
Verma A, Kumar G, Koller R, Sen A, (2011), Cosmig: modeling the impact of reconfiguration in a cloud, in modeling, analysis & simulation of computer and telecommunication systems (MASCOTS), 2011 IEEE 19th international symposium on, pp 3–11
Vogels W (2008) Beyond server consolidation. Queue 6(1):20–26
Voorsluys W, Broberg J, Venugopal S, Buyya R (2009) Cost of virtual machine live migration in clouds: a performance evaluation, Cloud Computing, pp 254–265
Walsh W, Tesauro G, Kephart J, Das R, (2004), Utility functions in autonomic systems, in autonomic computing, 2004. Proceedings international conference on, pp 70–77
Wood T, Shenoy P, Venkataramani A, Yousif M (2009) Sandpiper: Black-box and gray-box resource management for virtual machines. Comput Netw 53(17):2923–2938
Xu J, Fortes JA (2010) Multi-objective virtual machine placement in virtualized data center environments, in Green Computing and Communications (GreenCom), 2010 IEEE/ACM Int’l conference on & int’l Conference on Cyber, Physical and Social Computing (CPSCom), pp 179–188
Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Ferdaus, M., Murshed, M. (2014). Energy-Aware Virtual Machine Consolidation in IaaS Cloud Computing. In: Mahmood, Z. (eds) Cloud Computing. Computer Communications and Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-10530-7_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-10530-7_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10529-1
Online ISBN: 978-3-319-10530-7
eBook Packages: Computer ScienceComputer Science (R0)