Skip to main content
SpringerLink
Log in

Understanding and Managing IT Power Consumption: A Measurement-Based Approach

  • Chapter
  • First Online:
Energy Efficient Thermal Management of Data Centers

  • 2349 Accesses

Abstract

The continuing, unsustainable increase in datacenter power consumption is causing researchers in industry and academia to be heavily invested in addressing power management challenges. This chapter presents the basic elements of a measurement-based approach toward managing distributed datacenter and cloud computing systems to meet both application and end-user needs and to obtain improved efficiency and sustainability in their operation. The main components of the approach presented include (1) continuous online monitoring, measurement and assessment of systems and applications behaviors and power consumption, including for online estimation of the power usage of virtual machines running application components in these virtualized systems; (2) the ability to perform these tasks efficiently at scale, so as to deal with the ever-increasing sizes and complexity of modern datacenter infrastructures; and (3) the importance of “coordinated” management methods that operate across multiple levels of abstraction and multiple layers of the management stack in an orchestrated manner.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kansal A, Kothari N, Bhattacharya A (2010) Virtual machine power metering and provisioning. In: ACM symposium on cloud computing SOCC, 2010

    Google Scholar 

  2. Bohra A, Chaudhary V (2010) VMeter: power modelling for virtualized clouds. In: Workshop on high-performance, power-aware computing (HPPAC), in conjunction with the international parallel and distributed processing symposium, 2010

    Google Scholar 

  3. Nathuji R, Somani A, Schwan K, Joshi Y (2008) CoolIT: coordinating facility and IT management for efficient datacenters. In: HotPower, in conjunction with the USENIX annual technical conference, 2008

    Google Scholar 

  4. IBM, Syracuse University New York State to build one of the world’s most energy-efficient datacenters, http://www-03.ibm.com/press/us/en/pressrelease/27612.wss, 2009

  5. Das R, Kephart JO, Lenchner J, Hamann H (2010) Utility-function-driven energy-efficient cooling in datacenters. In: International conference on autonomic computing, June, 2010

    Google Scholar 

  6. HP datacenter management solution reduces costs by 34 percent, http://www.hp.com/hpinfo/newsroom/press/2007/070625xa.html, 2007

  7. IBM helps clients “meter” datacenter power usage to help lower energy costs, http://www-03.ibm.com/press/us/en/pressrelease/19695.wss, 2006

  8. Nathuji R, Schwan K (2008) VPM tokens: virtual machine-aware power budgeting in datacenters. In: Proceedings of high performance and distributed computing HPDC, 2008

    Google Scholar 

  9. Samadiani E, Amur H, Krishnan B, and Schwan K. Coordinated Optimization of Cooling and IT Power in Datacenters. ASME Journal of Electronics Packaging, 2010

    Google Scholar 

  10. Kumar S, Talwar V, Kumar V, Ranganathan P, Schwan K (2009) vManage: loosely-coupled platform and virtualization management in datacenters. In: International conference on autonomic computing ICAC, 2009

    Google Scholar 

  11. Kusic D, Kephart J, Hanson J, Kandasamy N, Jiang G (2008) Power and performance management of virtualized computing environments via lookahead control. In: International conference on autonomic computing ICAC, 2008

    Google Scholar 

  12. Agarwala S, Routray R, Uttamchandani S (2008) ChargeView: an integrated tool for implementing chargeback in IT systems. In: Network operations and management symposium NOMS, 2008

    Google Scholar 

  13. Corrigan K, Shah A, Patel C (2010). Estimating environmental costs. In: SustainIT – workshop on sustainable information technology, 2010

    Google Scholar 

  14. Ferrero RW, Shahidehpour SM, Ramesh VC (1997) Transactional analysis in deregulated power systems using game theory. IEEE Transactions on power systems 12(3):1340–1347

    Article  Google Scholar 

  15. Clark C, Fraser K, Hand S, Hasen JG, Jul E, Limpach C, Pratt I, Warfield A (2005). Live migration of virtual machines. In: Proceedings of the symposium on networked systems design and implementation (NSDI), May 2005

    Google Scholar 

  16. The VMware ESX Server. http://www.vmware.com/products/esx/

  17. Microsoft Hyper-V Server. http://www.microsoft.com/hyper-v-server/

  18. Xen Open Source Hypervisor. http://www.xen.org

  19. Citrix XenServer. http://www.citrix.com/xenserver

  20. Amazon Elastic Compute Cloud (EC2). http://aws.amazon.com/ec2/

  21. Open Cirrus HP/Intel/Yahoo open cloud computing research testbed, http://opencirrus.org

  22. Apte R, Hu L, Schwan K, Ghosh A (2010) Look who’s talking: discovering dependencies between virtual machines using CPU utilization. In: HotCloud, in conjunction with USENIX annual technical conference, 2010

    Google Scholar 

  23. Carter J (2010) Looming challenges in server and datacenter energy efficiency. One researcher’s perspective. In: CERCS energy workshop, 2010

    Google Scholar 

  24. Koller R, Verma A, Neogi A (2010) WattApp: an application aware power meter for shared datacenters. In: International conference on autonomic computing, 2010

    Google Scholar 

  25. Menon A, Santos JR, Turner Y, Janakiraman G, Zwaenepoel W (2005) Diagnosing performance overheads in the Xen virtual machine environment. In: USENIX annual technical conference, 2005

    Google Scholar 

  26. Mahadevan P, Sharma P, Banerjee S, Ranganathan P (2009) A power benchmarking framework for network devices. In: Networking, 2009

    Google Scholar 

  27. Krishnan B, Amur H, Gavrilovska A, Schwan K (2010) VM power metering: feasibility and challenges. In: GreenMetrics, 2010

    Google Scholar 

  28. Lim MY, Porterfield A, Fowler R (2010) SoftPower: fine-grain power estimation using performance counter. In: High performance and distributed computing HPDC, 2010

    Google Scholar 

  29. Common information model distributed management task force CIM-DMTF. http://www.dmtf.org/standards/cim

  30. Massie ML, Chun BN, Culler DE (2004) The ganglia distributed monitoring system: design, implementation and experience. Parallel Computing 30:817–840

    Article  Google Scholar 

  31. Renesse RV, Birman KP, Vogels W (2003) Astrolabe: a robust and scalable technology for distributed system monitoring, management and data mining. ACM Transactions on Computer Systems 21(2):164–206

    Article  Google Scholar 

  32. Strom R, Banavar G, Chandra T, Kaplan M, Miller K, Mukherjee B, Sturman D, Ward M (1998) Gryphon: an information flow based approach to message brokering. In: International symposium on software reliability engineering, 1998

    Google Scholar 

  33. Wang C, Talwar V, Schwan K, Ranganathan P (2010) Online detection of utility cloud anomalies using metric distributions. In: Network operations and management symposium NOMS, 2010

    Google Scholar 

  34. Liang J, Ko SY, Gupta I, Nahrstedt K (2005) MON: on-demand overlays for distributed systems management. In: Workshop on real, large distributed sytems, 2005

    Google Scholar 

  35. Boulon J, Konwinski A, Qi R, Rabkin A, Yang E, Yang M (2008) Chukwa: a large scale monitoring system. In: Cloud computing and its applications, 2008

    Google Scholar 

  36. Ko SY, Yalagandula P, Gupta I, Talwar V, Milojicic D, Iyer S (2008) Moara: flexible and scalable group based querying systems. In: International conference on middleware, 2008

    Google Scholar 

  37. Druschel P, Rowstron A (2001) Pastry: scalable, distributed object location and routing for large-scale peer-to-peer systems. In: International conference on distributed systems platforms (Middleware), 2001

    Google Scholar 

  38. Rowstron A, Kermarrec A.-M, Castro M, Druschel P (2001) SCRIBE: the design of a large-scale event notification infrastructure. In: International workshop on networked group communication, 2001

    Google Scholar 

  39. HP integrated lights out (iLO). http://www.hp.com/go/ilo

  40. Cecchet E, Marguerite J, Zwaenepoel W (2002) Performance and scalability of EJB applications. In: International symposium on object oriented programming, systems, languages and applications OOPSLA, 2002

    Google Scholar 

  41. HP systems insight manager, http://www.hp.com/go/sim

  42. IBM Tivoli, http://www.ibm.com/tivoli

  43. Nagios – industry standard in open source monitoring, http://www.nagios.org/

  44. Nimsoft, http://www.nimsoft.com

  45. Candea G, Kawamoto S, Fujiki Y, Friedman G, Fox A (2004) Microreboot – a technique for cheap recovery. In: Symposium on operating systems design and implementation OSDI, 2004

    Google Scholar 

  46. Cohen I, Goldszmidt M, Kelly T, Symons J, Chase JS (2004) Correlating instrumentation data to system states: a building block for automated diagnosis and control. In: Symposium on operating systems design and implementation OSDI, 2004

    Google Scholar 

  47. Aguilera MK, Mogul JC, Wiener JL, Reynolds P, Muthitacharoen A (2003) Performance debugging for distributed systems of black boxes. In: Symposium on operating systems principles SOSP’03, 2003

    Google Scholar 

  48. Chen MY, Kiciman E, Fratkin E, Fox A, Brewer E (2002) Pinpoint: problem determination in large, dynamic internet services. In: Dependable systems and networks DSN, 2002

    Google Scholar 

  49. Barham P, Donnelly A, Isaacs R, Mortier R (2004) Using magpie for request extraction and workload modelling. In: Symposium on operating systems design and implementation OSDI’04, 2004

    Google Scholar 

  50. Kumar V, Schwan K, Iyer S, Chen Y, Sahai A (2008) A state-space approach to SLA-based management. In: Network operations and management symposium NOMS, 2008

    Google Scholar 

  51. Agarwala S, Alegre F, Schwan K, Mehalingham J (2007) E2EProf: automated end-to-end performance management for enterprise systems. In: Dependable systems and network DSN, 2007

    Google Scholar 

  52. Agarwala S, Schwan K (2006) SysProf: online distributed behavior diagnosis through fine-grain system monitoring. In: International conference on distributed computing systems ICDCS, 2006

    Google Scholar 

  53. Bahl P, Chandra R, Greenberg A, Kandula S, Maltz DA, Zhang M (2007) Towards highly reliable enterprise network services via inference of multi-level dependencies. In: SIGCOMM, 2007

    Google Scholar 

  54. Arpaci-Dusseau AC, Arpaci-Dusseau RH (2001) Information and control in gray-box systems. In: Symposium on operating systems principles SOSP, 2001

    Google Scholar 

  55. Nugent JA, Arpaci-Dusseau AC, Arpaci-Dusseau RH (2003) Controlling your place in the file system with gray-box techniques. In: USENIX annual technical conference, general track, 2003, pp. 311–323

    Google Scholar 

  56. Lakhina A, Crovella M, Diot C (2005) Mining anomalies using traffic feature distributions. In: SIGCOMM, 2005

    Google Scholar 

  57. Lakhina A, Crovella M, Diot C (2004) Diagnosing network-wide traffic anomalies, In: SIGCOMM, 2004

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Experimental Research in Computer Systems, School of Computer Science, College of Computing, Georgia Institute of Technology, Atlanta, GA, USA

    Ada Gavrilovska, Karsten Schwan, Hrishikesh Amur, Bhavani Krishnan, Jhenkar Vidyashankar, Chengwei Wang & Matt Wolf

Authors
  1. Ada Gavrilovska
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karsten Schwan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hrishikesh Amur
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bhavani Krishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jhenkar Vidyashankar
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Chengwei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Matt Wolf
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ada Gavrilovska .

Editor information

Editors and Affiliations

  1. George W. Woodruff School of, Mechanical Engineering, Georgia Institute of Technology, Ferst Dr. 771, Atlanta, 30332, Georgia, USA

    Yogendra Joshi

  2. George W. Woodruff School of, Mechanical Engineering, Georgia Institute of Technology, Ferst Dr. 771, Atlanta, 30332, Georgia, USA

    Pramod Kumar

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Gavrilovska, A. et al. (2012). Understanding and Managing IT Power Consumption: A Measurement-Based Approach. In: Joshi, Y., Kumar, P. (eds) Energy Efficient Thermal Management of Data Centers. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-7124-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-7124-1_4

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4419-7123-4

  • Online ISBN: 978-1-4419-7124-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation