14
National Action Plan for Energy Efficien cy www.epa.gov/ eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis, US EPA April 11, 2007 NAESB

National Action Plan for Energy Efficiency eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Embed Size (px)

Citation preview

Page 1: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

National Action Plan for Energy Efficiency

www.epa.gov/ eeactionplan

National Action Plan Model Energy Efficiency Program Evaluation Guide

Cynthia Cummis, US EPAApril 11, 2007NAESB

Page 2: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Topics

• Objectives• Model Evaluation Guide

description• Advisory Committee• Why a program evaluation guide• Programs addressed and audience• Overview of scope and contents• Process and schedule

Page 3: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Objectives

The National Action Plan supports use of energy efficiency as a resource equivalent to generation. Therefore, it is important that the benefits of energy efficiency programs can be accurately documented with minimal transaction costs.

• The objectives of this project are: – Create a Model Guide that states, cities, utilities, private companies,

and others can use as a framework to define their own “institution-specific” or “program-specific” evaluation requirements

– Build consensus on basic evaluation approaches and definitions in order to promote consistent evaluations across different jurisdictions

• To support these objectives, the Guide will be widely promoted and industry organizations will be asked to endorse the Guide as a best practices document.

Page 4: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Evaluation Guide Description

This Model Guide is intended to:

• Define a policy neutral, state of the art approach to evaluation for calculating energy savings and avoided emissions

• Provide guidance for preparing jurisdiction specific program evaluation protocols that are consistent with the Model Guide

• Provide basic process and technical guidance on evaluation issues and requirements for efficiency resource programs

• Establish common evaluation definitions and terminology

• Provide a single, concise reference document for program evaluation resources currently available in the public domain

Page 5: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Advisory Committee

• The Advisory Committee will provide input on the content and scope of the document as well as the recommended audience. The committee will also help with outreach and encouragement for jurisdictions to endorse the Guide.

• The current members of this group are:• Commissioner Dian Grueneich, California PUC, co-chair• Diane Munn, EEI, co-chair• Chris James, Connecticut Department of Environmental

Protection• Rick Leuthauser, MidAmerican Energy Company• Jan Schori, Sacramento Municipal Utility District• Peter Smith, NYSERDA

Page 6: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Why a Program Guide

• There are widely recognized protocols for the measurement and verification (M&V) of energy savings from single projects (e.g., International Performance Measurement Verification Protocol)

• However, similar widely accepted protocols or guidance documents for measuring energy savings from programs do not exist

• M&V protocols do not address issues unique to program evaluation

• Use of good statistical samples for sites and expansion of sample analysis results to the program population

• Use of inexpensive and readily available site energy consumption and program tracking data

• Regression analysis of energy use/savings from multiple sites

• Analysis of attribution (free ridership, spillover, program effects) - net to gross ratios

Page 7: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Why a Program Guide - New Imperatives for Consistent Program Evaluation

• New state policies for reducing and measuring greenhouse gas (GHG) emissions– With federal policies likely to follow

• Markets for peak load reductions that allow bids from energy efficiency programs– Such as New England ISO Program

• Increasing interest in Energy Efficiency Portfolio Standards

Page 8: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Programs Addressed and Evaluation Focus

• Program types addressed:– Primary focus - resource acquisition, downstream efficiency

programs

– Market transformation, codes and standards, and upstream programs will also be referenced

• Evaluation focus

– Primary focus - impact evaluation (kWh, kW, therm savings)

– Will describe, but not provide guidance on:

• Process and market evaluations

• Potential studies

• Cost-effectiveness evaluation

Page 9: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Intended Audience

• Program evaluation managers and policy decision makers looking for guidance (e.g., a roadmap) on process and key issues relating to:– Documenting energy savings (and to lesser degree cost-effectiveness)– Documenting avoided emissions

• Program designers looking to understand how their programs will be evaluated

• Energy efficiency community looking for:– A credible reference document that provides guidance, best-practices, and

links to additional resources– Common definitions and terminology– Approaches to quantifying avoided emissions from energy efficiency

programs

Page 10: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

How the Guide Can Be Used

• Each jurisdiction (states, utilities, companies, etc.) will define their own jurisdiction-specific program evaluation requirements based on the Model Guide. The Model Guide itself will be policy neutral.

• The Model Guide will be a resource that lays out various evaluation issues that need to be addressed for each jurisdiction’s specific requirements and constraints (e.g., budgets, uncertainty tolerance, net to gross issues, time period of evaluation, etc.)

• The Model Guideline will allow for consistency in counting savings among jurisdictions’ energy efficiency programs, which can be particularly important for climate change mitigation programs.

Page 11: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Evaluation Approach

The general approach of the model guideline can be described as follows:

• Gross program energy savings are determined using one of the following options: – A sample of project savings are determined– Statistical analyses of large volumes of energy billing data– Quality assurance reviews of existing documentation

• Gross Program savings are then converted to net energy savings using a range of possible considerations (e.g., free rider corrections)

• Emission factors are derived and applied to net savings in order to determine avoided emissions– Provide description of possible approaches – Policy context matters

Page 12: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Expected Contents

1. Executive Summary

2. Introduction to energy efficiency

3. Scope and uses of this guide 4. Introduction to evaluation 5. Overview of evaluation

approach and options 6. Decision Tree for preparing a

jurisdiction specific program guideline – “bringing it all together”

7. Discussion of evaluation issues and cost-effectiveness

9. Calculating gross and net energy savings

10. Calculating avoided emissions

11. Confirming persistence of savings

12. Reporting evaluation results

Appendix A - Terminology

Appendix B – Uncertainty

Appendix C – Resources

Page 13: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

Process and Schedule

• Document will rely primarily on existing protocols

• Steve Schiller is the principal author with support of Technical Group:– Derik Broekhoff, World Resources Institute– Nick Hall, Tec Market Works – M. Sami Khawaja, Quantec– David Sumi, PA Consulting– Laura Vimmerstedt, National Renewable Energy Lab

• The Guide will be sent out for review by a wide range of evaluation professionals and industry participants

• Will reach out to additional organizations for endorsement• Draft available for review this summer

Page 14: National Action Plan for Energy Efficiency  eeactionplan National Action Plan Model Energy Efficiency Program Evaluation Guide Cynthia Cummis,

For Further Information

Contact: Steve Schiller at [email protected] or Niko Dietsch, US EPA, at [email protected]