Skip to main content

Advertisement

SpringerLink
Log in

Emerging evaluation issues: persistence, behavior, rebound, and policy

  • Original Article
  • Published:
Energy Efficiency Aims and scope Submit manuscript

Abstract

In this paper, we focus on a select group of technical and policy issues, which are currently important and/or are expected to become more critical in the coming years. The first set of technical issues deals with the evaluation of (1) persistence, (2) behavior and behavior change, and (3) rebound. We provide an overview of the importance of these issues, discuss key data collection and analytical challenges involved in evaluating them, and identify some recent methodological advances that have been made in these areas. These technical issues are becoming more important as energy efficiency and demand side management are increasingly being relied upon as a means of achieving long-term energy resource and environmental objectives. The second set of policy issues deals with (1) the evaluation of energy efficiency at the “policy” rather than the “program” level, (2) the use of “top-down” rather than “bottom-up” evaluation of energy efficiency programs and policies, and (3) closing the loop between evaluators and implementers. We provide an overview of the importance of these issues, particularly as seen by policymakers at the state, federal, and international levels.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. They also noted a lack of in-depth studies in process equipment, some shell measures, and specific end uses like cooking, refrigeration, and air compressors.

  2. In at least one study of an incentive-based early replacement program, high rates of free riders were found, so that early retirement was not really achieved (personal communication with Robert Wirtshafter, May 24, 2011).

  3. These papers are found at: http://uc-ciee.org/index.php?option=com_content&view=article&id=18&Itemid=47)

  4. BECC: www.BECCconference.org

  5. It is important to point out that behavior and technology are often seen as an integrated whole: for example, one cannot promote a technology or evaluate a technology’s effectiveness without considering the behavioral aspects of that particular technology. This integration makes the assessment of attribution even more challenging.

  6. In Europe, policies and programs are often used interchangeably, while in the USA, they are seen as distinct.

  7. CALMAC: www.calmac.org; CEE: www.cee1.org.

  8. The EMEEES project: http://www.evaluate-energy-savings.eu/emeees/en/the_project/project_description.php

References

  • Donnelly, K. (2010). The technological and human dimensions of residential feedback: an introduction to the broad range of today’s feedback. In K. Ehrhardt-Martinez & J. Skip Laitner (Eds.), People-centered initiatives for increasing energy savings. Washington, D.C.: American Council for an Energy-Efficient Economy.

    Google Scholar 

  • Electric Power Research Institute (EPRI). (2010). Guidelines for designing effective energy information feedback pilots: research protocols. Report 1020855. Palo Alto: EPRI.

    Google Scholar 

  • Gillingham, K., Newell, R., & Plamer, K. (2004). Retrospective examination of demand-side energy efficiency policies. Report RFF DP 04–19 REV. Washington, DC: Resources for the Future.

    Google Scholar 

  • Goldstein, D., Martinez, S., & Roy, R. (2011). Are there rebound effects from energy efficiency?—an analysis of empirical data, internal consistency, and solutions. Available at: ElectricityPolicy.com. Accessed 1 May 2011

  • Gynther, L., Mikkonen, I., & Smits, A. (2010). Evaluation of European energy behavioural change programmers, Proceedings of the 2010 International Energy Program Evaluation Conference, Paris, France: IEPEC. Available at: http://www.iepec.org/2010PapersTOC/2010TOC.htm.

  • Horowitz, M. (2007). Changes in electricity demand in the U.S. from the 1970s to 2003. The Energy Journal, 28(3), 93–119.

    Article  Google Scholar 

  • Horowitz, M. (2010). Measuring the savings from energy efficiency policies: a step beyond program evaluation. Energy Efficiency, 4(1), 43–56.

    Article  Google Scholar 

  • Integral Analytics, SageView Associates, & TecMarket Works. (2011). Evaluation of the home energy comparison report. Oregon: TecMarket Works.

    Google Scholar 

  • Keating, K. (1991). Persistence of energy savings. In E. Hirst & J. Reed (Eds.), Evaluation handbook (pp. 89–99). Oak Ridge: Oak Ridge National Laboratory. Report ORNL/CON-33, Chapter 6.

    Google Scholar 

  • Khan, J., Harmelink, M., Harmsen, R., Irrek, W., & Labanca, N. (2007). From theory based policy evaluation to SMART policy design: summary report of the AID-EE project. Utrecht, the Netherlands: ECOFYS Netherlands bv. Available at: http://www.aid-ee.org/documents.htm.

  • Kiss, B., McCormick, K., Neij, L., & Mundaca, L. (2010). Policy Instruments for Energy Efficiency in Buildings: Experiences and Lessons from the Nordic Countries, Proceedings of the 2010 International Energy Program Evaluation Conference, Paris, France: IEPEC. Available at: http://www.iepec.org/2010PapersTOC/2010TOC.htm.

  • Lapillonne, B., Bosseboeuf, D., & Thomas, S. (2009). Top-down evaluation methods of energy savings: a summary report, Grenoble, Switzerland: Enerdata; Paris, France: ADEME; and Wuppertal, Germany: Wuppertal Institute.

  • Lin, J., Cao, B., Cui, S., Wang, W., & Bai, X. (2010). Evaluating the effectiveness of urban energy conservation and GHG mitigation measures: the case of Xiamen City, China. Energy Policy, 38(9), 5123–5132.

    Article  Google Scholar 

  • Mundaca, L., & Neij, L. (2010). A meta-analysis of bottom-up ex-ante energy efficiency policy evaluation studies. Proceedings of the 2010 International Energy Program Evaluation Conference, Paris, France: IEPEC. Available at: http://www.iepec.org/2010PapersTOC/2010TOC.htm.

  • Nadel, S. (1993). The takeback effect: fact or fiction? Washington, DC: American Council for an Energy-Efficient Economy.

    Google Scholar 

  • Nadel, S. (2011). Our perspective on the ‘rebound effect’—is it true that the more efficient a product becomes, the more its owner will use it? January 12. Available at: http://www.aceee.org/blog/2011/01/our-perspective-rebound-effect-it-true-more-efficient-pro.

  • Owen, D. (2010). The efficiency dilemma. The New Yorker, Dec. 20.

  • Proctor Engineering Group. (1999). Summary report of persistence studies: assessment of technical degradation factors, final report. San Rafael: Proctor Engineering Group.

    Google Scholar 

  • Ridge, R., Jacobs, P., Tress, H., Hall, N., & Evans, B. (2011). One solution to capturing the benefits of early replacement: approximately correct is good enough. Proceedings of the 2011 International Energy Program Evaluation Conference, Boston, MA: IEPEC.

  • Skumatz, L., Khawaya, M., & Colby, J. (2009). Lessons learned and next steps in energy efficiency measurement and attribution: energy savings, net to gross, non-energy benefits, and persistence of energy efficiency behavior. Available at: http://uc-ciee.org/energyeff/energyeff.html.

  • Sorrell, S. (2007). The rebound effect: an assessment of the evidence for economy-wide energy saving from improved energy efficiency. London: UK Energy Research Centre.

    Google Scholar 

  • Thomas, S., Boonekamp, P., Vreuls, H., Broc, J., Bosseboeuf, D., Lapillonne, B., & Labanca, N. (2010). How to measure the overall energy savings linked to policies and energy services at the national level. Proceedings of the 2010 International Energy Program Evaluation Conference, Paris, France: IEPEC. Available at: http://www.iepec.org/2010PapersTOC/2010TOC.htm

  • Togeby, M., Dyhr-Mikkelsen, K., Larsen, A., & Bach, P. (2010). Portfolio evaluation and its impact on energy efficiency policy. Proceedings of the 2010 International Energy Program Evaluation Conference, Paris, France: IEPEC. Available at: http://www.iepec.org/2010PapersTOC/2010TOC.htm

  • Vine, E. (2008). Strategies and policies for improving energy efficiency programs: closing the loop between evaluation and implementation. Energy Policy, 36(10), 3872–3881.

    Article  Google Scholar 

  • Vine, E., du Pont, P., & Waide, P. (2001). Evaluating the impact of appliance efficiency labeling programs and standards: process, impact, and market transformation evaluations. Energy-The International Journal, 26(11), 1041–1059.

    Article  Google Scholar 

  • Vine, E., Hall, N., Keating, K., Kushler, M., & Prahl, R. (2010). Emerging issues in the evaluation of energy efficiency programs. Proceedings of the 2010 International Energy Program Evaluation Conference, Paris, France: IEPEC. Available at: http://www.iepec.org/2010PapersTOC/2010TOC.htm.

  • Vine, E., Sullivan, M., Lutzenhiser, L., Blumstein, C., & Miller, B. (2011). Experimentation and the evaluation of energy efficiency programs: will the Twain meet? Proceedings of the 2011 International Energy Program Evaluation Conference. Boston, MA: IEPEC.

  • Vreuls, H., Boonekamp, P., & Pauwels, H. (2007). Energy savings lifetimes of measures: will the new European harmonized lifetimes account for less energy savings compared to the policy induced energy savings measures? Proceedings of the 2007 International Energy Program Evaluation Conference. Chicago, IL: IEPEC.

Download references

Author information

Authors and Affiliations

  1. Lawrence Berkeley National Laboratory, Building 90-4000, Berkeley, CA, 94720, USA

    Edward Vine

  2. California Institute for Energy and Environment, Berkeley, CA, USA

    Edward Vine

  3. TecMarket Works, 165 West Netherwood Road, Oregon, WI, USA

    Nick Hall

  4. American Council for an Energy-Efficient Economy, 1751 Brookshire Ct., Williamston, MI, 48895-9372, USA

    Martin Kushler

  5. Prahl & Associates, 1601 N Palm Ave., Pembroke Pines, FL, USA

    Ralph Prahl

  6. 6902 SW 14th Ave., Portland, OR, 97219, USA

    Kenneth M. Keating

Authors
  1. Edward Vine
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nick Hall
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kenneth M. Keating
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Martin Kushler
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ralph Prahl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Edward Vine.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vine, E., Hall, N., Keating, K.M. et al. Emerging evaluation issues: persistence, behavior, rebound, and policy. Energy Efficiency 6, 329–339 (2013). https://doi.org/10.1007/s12053-012-9174-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12053-012-9174-6

Keywords

Search

Navigation