Technical Resource Manual Management Plan August 15, 2018...TRM Management Plan. As part of the initial TRM Management Plan filing, the Joint Utilities 7 Case 15-M-0252 – In the

1

Technical Resource Manual Management Plan

August 15, 2018

2

TABLE OF CONTENTS

I. Introduction ....................................................................................................................................... 3

II. Purpose .............................................................................................................................................. 5

III. Overview ........................................................................................................................................... 6

IV. Organizational Structure ................................................................................................................... 7

V. TRM Administrative Details ............................................................................................................. 9

A. Cyclical Filing Schedule ................................................................................................................... 9

B. Addition/Change Process ................................................................................................................ 10

C. TRM MC Activities ........................................................................................................................ 13

1. Meetings. ..................................................................................................................................... 13

2. Detailed Work Plan ..................................................................................................................... 13

3. Vendor Support ........................................................................................................................... 15

4. Outstanding Revisions ................................................................................................................ 15

5. Emerging Technologies .............................................................................................................. 15

D. Transparency ................................................................................................................................... 16

Appendix A

Appendix B

Appendix C

Appendix D

Appendix E

Appendix F

3

I. Introduction

As directed in the New York State Public Service Commission’s (“Commission”) March 15, 2018

Order Authorizing Utility-Administered Energy Efficiency Portfolio Budgets and Targets for

2019-2020 in Case 15-M-0252 (“March 2018 Order”), 1 Central Hudson Gas and Electric

Corporation (“Central Hudson”), Consolidated Edison Company of New York, Inc. (“Con

Edison”), National Fuel Gas Distribution Corporation (“National Fuel”), New York State Electric

& Gas Corporation (“NYSEG”), Niagara Mohawk Power Corporation d/b/a National Grid, The

Brooklyn Union Gas Company d/b/a National Grid NY and KeySpan Gas East Corporation d/b/a

National Grid (collectively “National Grid”), Orange and Rockland Utilities, Inc. (“O&R”),

Rochester Gas and Electric Corporation (“RG&E”), and Long Island Electric Utility Servco LLC

as agent of and acting on behalf of Long Island Lighting Company d/b/a LIPA (“LIPA”)

(collectively the “TRM Administrators 2 ”) hereby submit this Technical Resource Manual

(“TRM”) Management Plan.

The Commission first required the development of TRM Management Plans in its February 26,

2015 Order Adopting Regulatory Policy Framework and Implementation Plan (the “REV Track

One Policy Order”)3 and expanded on the requirement in its January 22, 2016 Order Authorizing

Utility-Administered Energy Efficiency Portfolio Budgets and Targets for 2016-2018 (the “2016

Utility Energy Efficiency Order”) in Case 15-M-0252.4

The REV Track One Policy Order stated:

The utilities will work collectively to support the maintenance of a New York State TRM,

while allowing for utility territory specific inputs, as appropriate. The Joint Utilities will

file a TRM Management Plan by no later than June 1, 2015. Upon filing this plan, the

1 Case 15-M-0252 – In the Matter of Utility Energy Efficiency Programs, Order Authorizing Utility-Administered Energy

Efficiency Portfolio Budgets and Targets for 2019-2020, (issued and effective March 15, 2018) (“March 2018 Order”), ordering

clause 11. 2 Long Island Electric Utility Servco LLC, as agent of and acting on behalf of Long Island Lighting Company d/b/a LIPA

(“LIPA”), was added in 2016, changing the reference from “Joint Utilities” to “TRM Administrators” as a result.

3 Case 14-M-0101 – Proceeding on Motion of the Commission in Regard to Reforming the Energy Vision (“REV Proceeding”),

Order Adopting Regulatory Policy Framework and Implementation Plan (issued and effective February 26, 2015). 4 Case 15-M-0252 – In the Matter of Utility Energy Efficiency Programs, Order Authorizing Utility-Administered Energy

Efficiency Portfolio Budgets and Targets for 2016-2018 (issued and effective January 22, 2016).

4

utilities will assume responsibility for the TRM from Staff. This plan should include a

process that ensures each utility’s and NYSERDA’s input is considered, all changes to the

TRM are transparent to Staff and stakeholders, and an updated TRM will be filed annually

in accordance with the schedule discussed below. In addition the TRM Management Plan

should include any plans for the use of contractor support, including the expected schedule

for obtaining such support. Staff will retain a monitoring and auditing role.5

Accordingly, the Joint Utilities’ representatives, with the participation of New York State

Department of Public Service (“DPS”) Staff (“Staff”), the New York State Energy Research and

Development Authority (“NYSERDA”), and Public Service Enterprise Group (“PSEG”)/Long

Island Power Authority (“LIPA”), began the TRM Transition Subcommittee with a kick-off

meeting on April 1, 2015. Representatives from the Joint Utilities were present at the initial

meeting, and subsequent meetings were held with the aforementioned parties in order for the Joint

Utilities to successfully issue an initial TRM Management Plan on June 1, 2015.

On June 19, 2015, the Commission issued its Order Authorizing Utility-Administered Gas Energy

Efficiency Portfolios for Implementation Beginning January 1, 2016 (the “2015 Gas Energy

Efficiency Order”), which directed: (1) “all gas utilities implementing energy efficiency programs

in 2016 to participate in the maintenance of the TRM,” and (2) modification of the TRM

Management Plan filed on June 1, 2015.”6

On October 15, 2015, the Secretary to the Commission established a new matter number dedicated

to the TRM, Matter 15-01319, In the Matter of the Technical Resource Manual. This Matter was

5 REV Proceeding, supra note 1. 6 Case 15-M-0252 – In the Matter of Utility Energy Efficiency Programs, Order Authorizing Utility-Administered Gas Energy

Efficiency Portfolios for Implementation Beginning January 1, 2016 (issued and effective June 19, 2015) (“2015 Gas Energy

Efficiency Order”), at 13.

5

intended by Staff to facilitate the transparent and orderly conduct of activities related to the TRM,

aiding parties in tracking developments.

On January 22, 2016, the Commission issued the 2016 Utility Energy Efficiency Order which

directed the Joint Utilities to make additional modifications to the TRM Management Plan.7

The March 2018 Order then directed the utilities to file a TRM Evaluation, Measurement and

Verification (“EM&V”) Coordination Report that “include[s] a plan to use the information gleaned

through EM&V activities to improve assumptions and factors within the TRM.”8 The March 2018

Order also directed the TRM Management Committee to update the TRM Management Plan.9

II. Purpose

The initial purpose of the TRM Transition Subcommittee (a “form and fold” subcommittee of the

E2 Working Group10) was to prepare a plan that will facilitate an effective transition, from Staff

to the Joint Utilities, of the functional responsibility for maintaining the TRM. As part of this

transition, the TRM Transition Subcommittee provided input, and the Joint Utilities designed the

TRM Management Plan to provide the foundational venue for utilities to work together to maintain

and update the TRM prospectively. Now that the transition from Staff to the Joint Utilities has

been effectuated, the TRM Transition Subcommittee has folded.

Per the REV Track One Policy Order, the Joint Utilities assumed responsibility from Staff for

maintaining and updating the TRM, effective June 1, 2015, when the Joint Utilities filed the initial

TRM Management Plan. As part of the initial TRM Management Plan filing, the Joint Utilities

7 Case 15-M-0252 – In the Matter of Utility Energy Efficiency Programs, Order Authorizing Utility-Administered Energy

Efficiency Portfolio Budgets and Targets for 2016-2018 (issued and effective January 22, 2016), at 40 and 41. 8 March 2018 Order, ordering clause 10. 9 March 2018 Order, ordering clause 11. 10 The E2 Working Group was established in February 2014 and operated in the context of broader Commission proceedings. The

E2 Working Group has been subsumed into the Clean Energy Advisory Council (“CEAC”). The CEAC Steering Committee

consists of Staff, NYSERDA, representatives from the major electric and gas utilities, LIPA, the New York Power Authority

(“NYPA”), PSEG, and designees from various working groups. CEAC meetings are open to all stakeholders and parties in Cases

07-M-0548, 15-M-0252, 14-M-0094, and 14-M-0101. The CEAC’s primary objective is to support innovation and collaboration

leading to the development of the most impactful clean energy programs and to reduce cost and achieve scale for these resources,

including an effective transition from current clean energy program offerings and on-going delivery thereafter.

6

established a TRM Management Committee (“TRM MC”) that replaced the folded Technical

Manual Subcommittee, the details of which are described in greater detail herein. Version 3 of the

TRM, also known as the New York Standard Approach for Estimating Energy Savings from Energy

Efficiency Programs- Residential, Multi-family, and Commercial/Industrial Measures, Version 3,

was provided to the Joint Utilities by Staff. A letter indicating this fact was filed by Staff on June

1, 2015 in Case 15-M-0252.11 Supporting documentation, as listed in Appendix A to this Plan, was

also provided to the Joint Utilities by Staff.12

The primary purpose of the TRM is to provide a standardized, accurate, fair, and transparent

approach for estimating gross savings. To do so, the TRM provides standardized energy savings

calculations and assumptions at the measure level for estimating energy savings.13 It should be

noted that the TRM is not intended to measure net energy and net demand savings (i.e., savings

that have been adjusted based on completed evaluation study results, incorporating adjustments

such as free ridership, spillover, market effects, etc.). The Plan presented herein addresses the on-

going methodology and practices that the TRM MC will undertake to maintain and update the

TRM.

III. Overview

The TRM Management Plan generally describes the overall process used to maintain and update

the TRM, as described in greater detail herein. This process accommodates a variety of inputs,

including but not limited to: (1) impact evaluation findings or focused Measurement and

Verification (“M&V”) analyses relevant to savings algorithms; (2) studies documenting emerging

and developing technology; (3) updates to industry standards or energy conservation codes; and

(4) demand savings assumptions.

The TRM will continue to evolve over time and will incorporate various inputs, some of which

are currently not known. The complexity of some of the inputs may require further analysis in

11 Case 15-M-0252 – Letter from Colleen L. Gerwitz, DPS Director of the Office of Clean Energy, to the Commission Secretary,

filed on June 1, 2015. 12 Staff developed and provided Appendix A to the Joint Utilities for use and inclusion in the TRM Management Plan. 13 Additionally, the TRM provides measure-specific effective useful lifetimes.

7

order to be understood and appropriately integrated into the TRM. Additionally, there may be a

need to engage specialized industry expertise to aid in such understanding and integration.

In the future, utility program administrators will continue to plan and conduct EM&V studies or

focused M&V analyses at any of the following levels: technology or measure level, program level,

portfolio level, and/or statewide level. TRM revisions will make use of relevant EM&V impact

study findings or detailed impact M&V analyses.

IV. Organizational Structure

A TRM MC was formally established on June 1, 2015, with the initial filing of the TRM

Management Plan. To create the TRM MC, each utility identified one lead representative who

would participate in ongoing TRM MC activities. Representation on the TRM MC from the major

utilities, consisting of Central Hudson, Con Edison, National Fuel, NYSEG, National Grid, O&R,

and RG&E is required. 14 Each lead representative is responsible for inviting other company

representatives to participate in ongoing TRM MC meetings as appropriate.

Although each of the nine utility legal entities specified in the introduction have equal

representation on the TRM MC, in accordance with the requirements specified in the REV Track

One Policy Order and further clarified in the 2015 Gas Energy Efficiency Order, there are

differences with respect to the TRM MC’s voting structure and funding structure, both of which

are described in greater detail herein. With respect to voting, there are a total of seven votes, with

Con Edison, Central Hudson, National Fuel, National Grid, NYSEG/RGE, O&R, and LIPA each

representing a single vote. With respect to funding, the member companies of the TRM MC have

agreed upon a set funding methodology, which is also described in greater detail herein. The

funding methodology is at the utility legal entity level, with the exception of National Grid, which

is shown as a consolidated number for all three National Grid legal entities. These differences are

14 Representation on the TRM MC from Corning Natural Gas Corporation and St. Lawrence Gas Company, Inc. is strongly

encouraged, to the extent that these utilities have energy efficiency interests in the future.

8

specified here for transparency purposes and have been agreed upon by the member companies of

the TRM MC.

The TRM MC will ensure NYSERDA has input (by inviting NYSERDA to participate in TRM

MC meetings and activities), and that all changes made to the TRM are transparent to both Staff

and stakeholders, as described in greater detail below. The TRM MC is responsible for adding new

measures to the TRM, and maintaining and updating the TRM, in accordance with the

Commission’s Orders outlined above.

Two co-chairs from the TRM MC are selected to serve a term of twelve months.15 The co-chairs

are responsible for establishing the monthly meeting schedule, facilitating meetings, prioritizing

workloads, managing all TRM MC activities, and ensuring that TRM MC deliverables are met.

Additional meetings, beyond monthly meetings, are scheduled on an as needed basis. Through

regular meetings of TRM MC, and through work contributions from “form and fold”

subcommittees,16 the TRM will be maintained and updated.

Within the organizational structure, the co-chairs may appoint designees or request assistance from

members of the TRM Administrators in order to complete specific detailed tasks. For example, the

co-chairs have appointed a Secretary designee that is responsible for general administration work,

scheduling meetings, facilitating communication, and other ad hoc assignments.

The TRM MC has agreed upon the fixed cost share percentages17 outlined below for contracting

purposes, based on an on-going productive dialogue and negotiation process facilitated amongst

member companies. To the extent that the TRM MC incurs costs associated with: (1) obtaining

15 Co-chairs are not prohibited from serving multiple consecutive terms, with the TRM MC’s consensus. The member companies

of the TRM MC have agreed that co-chair representatives only be from combination utilities because these companies have the

necessary expertise in both the electric and natural gas industries. After the conclusion of a twelve-month term, the TRM MC

reserves the right to identify new co-chairs or continue operating with the existing co-chairs. To the extent agreement is not

reached in selecting new co-chairs, the existing co-chairs may choose to continue to serve for the next twelve-month term. After

the completion of two consecutive twelve-month terms, a new co-chair should be selected. 16“Form and fold” subcommittees would be comprised of TRM MC member company personnel. 17 Cost share percentages were informed by EM&V work previously completed under EEPS. The cost share percentages outlined

in this document are derived from contract negotiations amongst the TRM MC member companies, which occurred as part of

bringing on-board the TRM Administrative Vendor (described in greater detail herein). The cost share percentages shown above

will be applied to TRM Administrative Vendor invoices, which are approved for payment, as support work is completed. Each

member company is responsible for paying such approved invoices through their Commission-approved EM&V budget.

9

administrative support, or (2) maintaining and updating the TRM, the following percentages will

be utilized:

Central Hudson 3%

Con Edison 38%

LIPA 11%

National Fuel 4%

National Grid 31%

NYSEG 6%

O&R 2%

RG&E 5%

To the extent that the TRM MC identifies a need to switch cost methodologies, or make further

adjustments to individual cost shares resulting from new contract negotiations for TRM

Administrative Vendor support, the TRM MC will revise the TRM Management Plan accordingly

and file the updated TRM Management Plan with the Commission.18

V. TRM Administrative Details

A. Cyclical Filing Schedule

The primary function of the TRM MC will be to issue TRM updates that reflect information from

EM&V studies, M&V analyses, technology changes, or updates to industry codes and standards.

The TRM MC will file quarterly record of revisions for any additions or revisions to the TRM, for

stakeholder benefit and transparency purposes. A consolidated TRM will be filed once a year that

incorporates the changes from the previous twelve-month’s record of revision filings. The annual

filing is submitted in April of each year. A representative example of a typical cyclical filing

18 Under extenuating circumstances, the fixed cost share percentages may be adjusted temporarily, if all TRM MC members

agree and the decision is documented with a vote.

10

schedule is included as Appendix B to this filing. The cyclical filing schedule will document, the

filing schedule for record of revisions and the annual update.

B. Addition/Change Process

The TRM MC has established a functional workflow process to outline how submittals for measure

additions, or revisions to existing measures in the TRM, will be worked and advanced through the

TRM MC. A copy of this functional workflow process is included as Appendix C “TRM MC-

Addition/Change Process” to this filing, and will be posted to the website.19 Submittals prepared

by TRM MC member companies and submittals prepared by non-TRM MC entities (described in

more detail below) will both follow the same functional workflow process.20 Proposed new and

proposed revised measures may be submitted at any time during the calendar year. Submitted

measures will then be considered by the TRM Administrators on a continuous basis in accordance

with the functional workflow. The TRM MC will seek to complete submittals requiring a short-

term review within five weeks. For items requiring a more comprehensive review, review will

typically take at least eight weeks to complete. Specific start dates and estimated end dates will be

established when submittals are received. Such dates will be communicated to the TRM MC and

the submitting party. Dates will ultimately be tracked and updated within the detailed work plan

maintained by the TRM MC. TRM Administrators will discuss if a submittal should undergo a

short-term review or a more comprehensive review during TRM MC meetings. This determination

will be based on member company judgment (e.g., items that could influence this judgment could

include workload, availability of resources, the complexity of the submittal, necessary filing

requirements). It should be noted that emerging technologies and new market innovations will also

be accommodated within this workflow, however; the timelines for these submittals will be

discussed and established during TRM MC meetings. The TRM MC reserves the right to accelerate

or temporarily postpone the review of submittals, as necessary. In addition, the TRM MC may

elect to postpone the review of a submittal when appropriate (e.g., if additional information has

been requested or if consultation with technical expertise is deemed necessary). A resubmittal is

19 http://www3.dps.ny.gov/W/PSCWeb.nsf/All/72C23DECFF52920A85257F1100671BDD?OpenDocument. 20 The term “entity” is not restrictive – it could include utilities, Staff, NYSERDA, technology providers, stakeholders, or any

other entity not specified that is working on a submittal. The TRM MC also recognizes that multiple entities may be working

together on a submittal.

11

required when there is a “NO” vote on the proposed addition or revision, while a postponement is

required when the TRM MC requires further research or supporting documentation. In the case of

a postponement or resubmittal, the TRM MC will communicate to the submitting party the reason

behind the postponement or resubmittal. The TRM MC will vote on submittals for their potential

inclusion in the TRM. The voting structure is described in greater detail in the Organizational

Structure section. Votes cast by TRM Administrators are defined below. The following voting

definitions have been further refined by the TRM MC during the preparation of the TRM

Management Plan:

“YES” – defined as no technical issues with the submittal being presented based on the

best available information known by the TRM MC.

“NO” – defined as technical issues with the submittal being presented, or outstanding

questions that have not been addressed in full. “NO” votes are meant to work towards a

consensus process, and require further discussions (between or during TRM MC meetings),

to move the submittal forward. The entity21 presenting a submittal that receives a “NO”

vote is responsible for responding to the technical issues or outstanding questions identified

by the TRM MC, or to inform the TRM MC that the submittal should no longer be

considered. “NO” votes can be re-voted to “YES” or “ABSTAIN” based on discussions

that ensue or additional information that is ultimately presented. To the extent a submittal

receives a “NO” vote and no action has occurred to respond to the “NO” vote within two

calendar months, then TRM MC member companies can elect to nullify the submittal;

requiring a new submittal if the measure is presented in the future. Reasons for a nullified

submittal will be documented in quarterly record of revision filings for transparency

purposes.22

“ABSTAIN” – defined as a vote that does not stop the TRM MC’s consensus process from

moving forward. The reason a TRM MC member is electing an “ABSTAIN” vote can be

21 Id. 22 Rather than filing exhaustive meeting notes from each of these discussions, the TRM MC will summarize reasons for nullified

submittals within the quarterly record of revision filings, for transparency purposes.

12

provided: (1) during the voting process, or (2) during discussions at TRM MC meetings.

These reasons will be documented in TRM MC voting spreadsheets.

It should be noted that the TRM Administrator’s voting process only considers the technical

accuracy of submittals being presented. If a measure or technology is included in or added to the

TRM, it does not mean that it is supported or expressly endorsed by the member companies of the

TRM MC (e.g., for gas-only utilities, non-gas measures or technologies may never be supported

or expressly endorsed). There is no guarantee that measures included in the TRM will be offered

by all utilities.

When a submittal receives “YES” or “ABSTAIN” votes from all TRM MC member companies,

then the change has officially been adopted by the TRM MC. Adopted additions or revisions will

formally be documented in the quarterly Record of Revision filing and with effective dates in the

detailed work plan.

It is important to note that submittals to the TRM MC require a specific form and format, which

includes among other things: supporting references, resource documentation, calculation, and

input variances. A template for the specific form and format will be made available on the DPS

website23 and is included in Appendix D to this filing. Any entity24 wishing to prepare a new or

revised measure submittal is encouraged to contact member companies of the TRM MC, the TRM

MC co-chairs, or a designee (such as the Secretary designee described earlier) directly with

questions or completed submittals. The TRM MC should be able to address any questions that

arise when a submittal is in the process of being prepared and the TRM MC will determine when

a submittal is ultimately deemed complete and is ready for TRM MC membership voting.

Submittals to change existing content within the TRM must be accomplished by redlining the

existing page or pages in the currently effective TRM. Supporting information, if available, for the

redlined changes being made must accompany the redlined document. Once the redlined document

is prepared it can be submitted to any member company within the TRM MC or the TRM MC co-

chairs, Secretary designee, or other designee of the TRM MC co-chairs. During TRM MC

23 See http://www3.dps.ny.gov/W/PSCWeb.nsf/All/72C23DECFF52920A85257F1100671BDD?OpenDocument. 24 Supra note 15.

13

meetings, any input (either verbal during meetings or written between meetings) received from

TRM MC member companies, Staff, NYSERDA, or other external stakeholders is welcomed and

will be considered by the TRM MC.

C. TRM MC Activities

The following work activities are conducted by the TRM MC to support its on-going, primary

purpose of maintaining and updating the TRM:

1. Meetings.

The TRM MC will schedule meetings which will be communicated to all TRM MC participants.

The purpose of these meetings is to discuss progress on current work, planning for future work,

and to discuss any outstanding items.

2. Detailed Work Plan

The TRM Administrators will follow and manage a detailed work plan which will include a recap

of work completed, and an on-going workload prioritization list. A representative example of a

current, detailed work plan is included as Appendix B to this filing. The TRM Administrators will

include a copy of the most up-to-date version of the detailed work plan within quarterly record of

revision filings, for transparency purposes. A list of approved measures for the quarter and a brief

explanation for measures not approved will be included in the detailed work plan each quarter.

The detailed work plan will focus on codes, standards, demand savings updates, new measures,

emerging technologies, as well as results from on-going EM&V studies.

a) Codes, Standards, and Demand Savings

The TRM Administrators will continue to assess current TRM assumptions such as:

codes/standards, baselines, input variables, and components of savings algorithms. The TRM MC

obtained contractor support (“TRM Administrative Vendor”) in late 2016, and immediately

initiated a thorough review of energy codes, industry standards and demand savings assumptions.

The progress of the review will be tracked within the detailed work plan described above. The

TRM MC initiated a global update process to review all existing measures to update codes,

standards, and demand savings. A measure priority list was developed for the global update

process, with measures most frequently included in member company programs receiving the

highest priority. Once the global update process is complete, the TRM Administrators will work

14

with the TRM Administrative Vendor to develop an ongoing process for updating these items

prospectively, where applicable, in order to maintain an accurate and reliable TRM. The approach

and plan for updating codes, standards and demand savings assumptions will be documented

within the detailed work plan described above.

b) New Measures

The TRM Administrators will incorporate new measures into the TRM as submittals are developed

and provided to the TRM MC. The TRM Administrators require that submittals adhere to the

Addition/Change process described above, and that each submission follow the standardized

format. The most up to date version of the standardized format template is located on the DPS

website.25

c) EM&V

Results from filed EM&V and M&V studies should be presented to the TRM MC by the utility or

third-party entity that managed the study following the Addition/Revision process defined in this

plan. The TRM MC expects that the party filing completed EM&V results, where an update to the

TRM is necessary (e.g., these changes are typically found in impact evaluation studies), present

such updates to the TRM MC within 60 days of completion for their review and consideration.

This may be in the form of a redline submittal or the identification of items to be added to the

detailed work plan (when items are identified requiring further research, analysis or investigation).

It should be noted that submittals resulting from completed evaluation studies may be presented at

any time during the calendar year. EM&V revisions will be included in the above detailed work

plan with the corresponding effective dates. To the extent that the TRM MC is facing a significant

workload with respect to pending submittals under review, member companies will prioritize the

workload during discussions at TRM MC meetings.

Pursuant to ordering clause 10 of the March 2018 Order, the TRM MC filed a TRM EM&V

Coordination Report with the Commission, which includes a plan to use information gleaned

through EM&V activities to improve assumptions and factors within the TRM. This Report is

provided as Appendix F to the Management Plan.

25 http://www3.dps.ny.gov/W/PSCWeb.nsf/All/72C23DECFF52920A85257F1100671BDD?OpenDocument.

15

3. Vendor Support

The TRM Administrators have contracted with a vendor that will provide administrative and

technical support to the TRM MC. The scope of work outlining the role of this vendor is included

as Appendix E to this filing.

4. Outstanding Revisions

Outstanding revisions to the TRM will continue to be identified, discussed and prioritized during

TRM MC meetings. Other potential items (e.g., form and format, consistency of reference

citations, and the relevancy of appendices) will also be prioritized during TRM MC meetings.

5. Emerging Technologies

The TRM MC’s approach to emerging technologies uses a multi-faceted plan to proactively

engage stakeholders and to continuously and appropriately update the TRM. The TRM MC’s

method includes:

a) Member utility contributions

The utilities, both individually and collectively, utilize the knowledge they gain through direct

market interactions with customers, vendors, contractors, technology innovators, and other

stakeholders, to develop new TRM measures from which market players can benefit. As such,

the TRM MC regularly brings new measures to the TRM, reflecting “market demand” for

emerging technologies. The member utility submissions follow the process and timeline outlined

in Appendix C of the Management Plan, when measures are considered for potential inclusion in

the TRM.

b) Third party contributions

Market actors, such as vendors, NYSERDA, and manufacturers, are welcome to bring new

measure submittals to the TRM MC. To encourage continuous market development, TRM MC

works with these entities to advise the following: (1) how to prepare submittals for the TRM

MC’s consideration, and (2) supporting documentation that should be provided. All measures

submitted to the TRM MC must align with the format provided in Appendix D of this document,

before they can be considered for technical merit or voting.

c) EM&V and market potential studies

TRM MC members and NYSERDA regularly perform market potential and baseline studies to

identify areas of the marketplace where there may be opportunities for increased measure uptake.

16

The TRM MC collaborates with NYSERDA to ensure all studies completed by NYSERDA are

considered when planning for TRM development. In addition, TRM MC members conduct

impact evaluations of their individual energy efficiency programs. Upon completion of any such

study, the results are analyzed in accordance with the protocol outlined in the “EM&V” section

above. The TRM MC will review the results of these analyses and, depending on the results,

emerging technologies could be identified and considered for possible incorporation into the

TRM.

d) Stakeholder Forums

In consultation with NYSERDA, Staff, and other stakeholders, the TRM MC will host a

minimum of one in-person stakeholder forum each year. The forum(s) will provide a general

overview of the TRM, and will be designed to engage Staff, NYSERDA and third parties about

emerging technologies, which could potentially be added to the TRM. Since stakeholder forums

need to be coordinated with Staff and NYSERDA, the TRM MC recognizes that the schedule of

forums will need to be determined, and information regarding the logistics of the forums will

need to be prepared and disseminated. These forums may potentially occur as a part of the

schedule of energy efficiency topical forums that Staff was ordered to develop in the March

Order.26 Notification of stakeholder forums will be formally filed under Matter 15-01319.

D. Transparency

One of the primary goals of the TRM MC is to ensure transparency with respect to past and current

versions of the TRM, and the functional processes employed by the TRM MC. To that end,

26 Case 15-M-0252 – March 2018 Order, at ordering clause 17.

17

stakeholders are encouraged to contact TRM MC Administrators, or the TRM co-chairs directly,

to the extent they have questions or wish to prepare a submittal for the TRM MC’s consideration.

The contact information for the current TRM MC co-chairs and secretary are located on the DPS

website.27

If a non-TRM MC entity28 wishes to prepare a submittal for the TRM MC’s consideration, the

process to do so (as well as the timing of the process) is described above in the “Addition/Revision

Process” section of the TRM Management Plan. The TRM MC will include non-TRM MC entities

in TRM MC meetings, as needed, to: (1) review or move forward a submittal, or (2) identify if

outside technical expertise is necessary.29 The TRM MC co-chairs, or a designee named by the co-

chairs, will be in contact with non-TRM MC entities to discuss the status of their submittal(s), as

well as “next steps” in the functional workflow.

Although different utilities may sponsor the cover letters of filings, each TRM MC member

company will have a signee on the filing, unless an alternative arrangement has been made by the

TRM MC (i.e., one utility filing on behalf of TRM MC member companies, or a majority of TRM

MC member companies sponsoring a filing). TRM filings will be made through the Commission’s

Document and Matter Management (“DMM”) system, in Matter 15-01319.30 When quarterly

record of revisions, or annual TRM filings are completed, the information filed becomes a public

document, thus ensuring stakeholder transparency.

The TRM MC will continue to work with Staff to coordinate website updates and to post relevant

information that pertains to the TRM or the TRM MC. The opportunity to collaborate and

coordinate with Staff in this regard is greatly appreciated by the TRM MC and will help expand

the reach of TRM information to stakeholders and members of the general public.

27 See http://www3.dps.ny.gov/W/PSCWeb.nsf/All/72C23DECFF52920A85257F1100671BDD?Open Document. 28 Supra note 17. 29 The TRM Administrators reserve the right to caucus, when necessary, and will provide follow up from those discussions (e.g.,

this may be necessary for the TRM Administrators to make a group decision, about the need for and cost of outside technical

expertise). 30 Matter 15-01319 – In the Matter of the New York State Technical Resource Manual.

August 15, 2018 Appendix A

TRM Management Plan

Appendix A. New York State Department of Public Service

TRM Supporting Documents

August 15, 2018 Appendix A

Materials provided to the Joint Utilities by Staff, as described above in the TRM Management Plan:

I. All previously approved technical resource manuals, in Adobe PDF file format, as listed below:

a. New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs - Selected Residential and Small Commercial Measures (Electric), December 28, 2008

b. New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs (Gas) - Selected Residential and Small Commercial Gas Measures, March 25, 2009

c. New York Standard Approach for Estimating Energy Savings from Energy Efficiency Measures in Multi-family Programs, July 9, 2009

d. New York Standard Approach for Estimating Energy Savings from Energy Efficiency Measures in Commercial Industrial Programs, September 1, 2009

e. New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs - Single Family Residential Measures, December 16, 2009

f. New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs - Residential, Multi-family, and Commercial/Industrial Measures (Version 1), October 15, 2010

g. New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs – Residential, Multi-family, and Commercial/Industrial Measures (Version 2), December 12, 2014

II. A list of in progress measures previously submitted to the Technical Manual Subcommittee (“TMSC”), and associated material.

III. The May 11, 2010 Evaluation Advisory Group (“EAG”) White Paper - Technical Manual Proposed Recommendations. An EAG review of the five Technical Manuals approved by the Commission between December 2008 and December 2009 for consolidation and streamlining into one manual, the October 15, 2010 TRM.

IV. A list of website addresses typically utilized by Staff during research, analysis, and clarification of TRM issues.

V. A compiled list of completed EEPS 1 & EEPS 2 EM&V Studies. VI. A Staff compiled list of issues to be reviewed and addressed in future revisions of the

TRM.

August 15, 2018 Appendix B

TRM Management Plan

Appendix B. TRM MC - Schedules and Work Plan


Cyclical Filing Schedule

Below is a representative sample of the cyclical filing schedule that shows all filings that will

occur throughout the year. The schedule below, updated as of the date of this filing, shows all

filings anticipated through the end of calendar 2019.

Item No. Filing Due Date

1 2017 Q3 Record of Revision 9/30/2017



4 TRM Version 6 Filing (for 2019) 4/15/2018





9 TRM Version 7 Filing (for 2020) 4/15/2019





Tentative High Level Annual Schedule

Below are the high level goals the committee will be focused on each year through 2019. The details and

sub-tasks of this schedule will be documented within the detailed work plan. Any changes will be addressed

in the detailed work plan.

Year High Level Annual Schedule

2017

*Initiate revisions to TRM through a global update process *Update codes and standards *Update demand savings/coincidence factors * Update formulae, variables, references, etc., as each measure is reviewed during the global update *Add new measures that align with REV and CEF *Incorporate results from any filed EM&V studies

2018

*Estimated completion of the global update process by 12/31/2018. *Add new measures that align with REV and CEF *Incorporate results from any finalized and filed EM&V studies *File EM&V coordination report per the March 2018 Order

2019 *Add new measures that align with REV and CEF *Incorporate results from any finalized and filed EM&V studies *Emerging technology stakeholder forum(s)


Detailed Work Plan

Attached is a representative sample of the detailed work plan. Since this document will be

continuously refined, any updates to the detailed work plan will be included in the quarterly record

of revision and will be located on the DPS TRM website.1

1 http://www3.dps.ny.gov/W/PSCWeb.nsf/All/72C23DECFF52920A85257F1100671BDD?OpenDocument

No. Task

Estimated

Completion

Date

Effective Date

in TRMComments

1 File Q3 2017 ROR To be filed by Central Hudson on 9/29/17

New Measures

C&I Commerical Tier 1 APS (TrickleStar)12/31/2017 1/1/2018

New measure submitted by TrickleStar. To be reviewed September 2017. Anticipated

effective date in TRM is 1/1/18

C&I Commerical Clothes Dryer (National Fuel)12/31/2017 1/1/2018

New measure submitted by National Fuel Gas. To be reviewed September 2017.

Anticipated effective date in TRM is 1/1/18

Existing Measure Updates w/ effective date

R Residential Thermostat – Wi‐Fi (Communicating) 9/30/2017 1/1/2018

C&I Commercial Thermostat – Wi‐Fi (Communicating) 9/30/2017 1/1/2018

C&I Chiller – Air and Water Cooled 9/30/2017 1/1/2018

R Light Emitting Diode (LED), Compact Fluorescent Lamp (CFL) and

Other Lighting9/30/2017 1/1/2018

C&I Interior and Exterior Lamps and Fixtures 9/30/2017 1/1/2018

C&I Refrigerated Case LED 9/30/2017 1/1/2018

C&I Interior Lighting Control 9/30/2017 1/1/2018

C&I

Fan Motor – with Electronically Commutated (EC) Motor, for

Refrigerated Case or Walk‐In Cooler

9/30/2017 1/1/2018

C&I Anti‐Condensation Heater Control 9/30/2017 1/1/2018

C&I Variable Frequency Drive – Fan and Pump 9/30/2017 1/1/2018

2

Review EM&V studies filed by 9/15/17 for incorporation into

4/15/18 Annual Filing

4/15/2018 1/1/2019TRM MC meeting in October will identify and discuss EM&V studies filed within the last

year. A review schedule will be developed during the October 2017 meeting to address

potential TRM updates for inclusion in annual TRM filing 4/15/18

3 File Q4 2017 ROR To be filed by NYSEG/RG&E 12/28/17

New Measures (TBD)

Existing Measure Updates w/ effective date

R Blower Fan – with Electronically Commutated (EC) Motor, for 12/31/2017 1/1/2019

C&I Air Conditioner– Unitary 12/31/2017 1/1/2019

C&I Chiller ‐ Cooling Tower 12/31/2017 1/1/2019

C&I Furnace and Boiler 12/31/2017 1/1/2019

C&I Heat Pump Air Source, Packaged (PTHP) 12/31/2017 1/1/2019

R Heat Pump Water Heater (HPWH) ‐Air Source 12/31/2017 1/1/2019

R Indirect Water Heater 12/31/2017 1/1/2019

R Storage Tank and Instantaneous Domestic Water Heater 12/31/2017 1/1/2019

C&I Storage Tank Water Heater 12/31/2017 1/1/2019

R Refrigerator and Freezer Recycling 12/31/2017 1/1/2019

C&I Air Compressor 12/31/2017 1/1/2019

R Air Conditioner ‐ Central (CAC) 12/31/2017 1/1/2019

R Heat Pump ‐ Air Source (ASHP) 12/31/2017 1/1/2019

C&I Bi‐Level Lighting 12/31/2017 1/1/2019

R Clothes Dryer 12/31/2017 1/1/2019

R Advanced Power Strip 12/31/2017 1/1/2019

C&I Refrigerated Case Night Cover 12/31/2017 1/1/2019

C&I Evaporator Fan Control 12/31/2017 1/1/2019

R Air Conditioner ‐ Room (RAC) 12/31/2017 1/1/2019

C&I Economizer – Air Side, with dual enthalpy control 12/31/2017 1/1/2019

4 Complete TRM global updates (the entire manual) 12/31/2018

5Updating business simulations TBD

Estimated completion will be in 2019

6

Identification and isolation of gross‐to‐net adjustments

embedded in savings estimation methodologies

TBDEstimated completion will be in 2020

9/30/17 ‐ Third Quarter Record of Revision TRM Filing

Illustrative Example of Detailed Work Plan

**SAMPLE**

August 15, 2018 Appendix C

TRM Management Plan

Appendix C. TRM MC – Addition/Revision Workflow Process

Sends proposed addition/change with supporting docs to TRM MC

Secretary

Requesting Party

Adds request to the detailed work plan

with estimated start and end dates based

on # of measures

TRM MC Secretary

Schedules a meeting with the team &

requesting party to review the proposed addition or change

Requesting PartyTRM MC Secretary

Approved by all voting

members?

Record of Revision and/or Annual filing

is prepared

TRM MC Secretary/Voting Members

Files revision/addition to Matter

# 15-01319 in accordance with filing schedule*

TRM MC Voting Member

Addition/Change Complete

Submits final, approved mark up

or addition to Secretary

Requesting Party

*TRM MC has developed a schedule with each Program Administrator participating on this committee assigned to all filings through 2018.

Provides revised request (if needed)

and written responses to comments

Requesting Party

Final Review (if needed)

TRM MC Voting Members &

Vendor

Members Vote on the request

TRM MC Voting Members

TRM MC – ADDITION/CHANGE PROCESS

TRM MC Secretary will document request complete and close it.

Third party/external entities can submit their requests to the committee following the same steps.

Further research needed?

Measure will be postponed for

further research and request will be

resubmitted

Requesting Party&

TRM MC/Vendor

Reviews measures/provides vendor

feedback

TRM MCVoting Members

Meeting needed?

Circulate to the TRM

MC Voting Members/vendor

for review/feedback

TRM MC Secretary

Makes revisions/sends to DPS Staff and NYSERDA for

review

Vendor/TRM MC Secretary/Co-Chairs

Provides feedback on the revision/

addition

DPS Staff/NYSERDA

YES

NOComplete

submission?YES

NO

YES

YES

NO

Request Denied

Resubmit the request

NOThe requesting party can choose to look into the request further based on comments/feedback and lack of consensus. However; the requesting party will be required to resubmit the request.

See Timeline Estimates

= 27 Business Days

= 42 Business Days

Measu

re R

evisio

n/

Addition Su

bmitt

ed

10 Business Days

Send to

DPS S

taff/

NYSERDA/3

rd Party

for R

eview

7 Business Days

Schedule

Meetin

g to

Discuss

(If N

eeded)

5 Business Days

Finaliz

e Revi

sion/

Addition W

rite U

p

3 Business Days

TRM M

C Vote

on th

e

Revisio

n/Additi

on

2 Business Days

Measu

re R

evisio

n/

Addition Su

bmitt

ed

15 Business Days

Send to

DPS S

taff/

NYSERDA/3

rd Party

for R

eview

12 Business Days

Schedule

Meetin

g to

Discuss

(If N

eeded)

5 Business Days

Finaliz

e Revi

sion/

Addition W

rite U

p

5 Business Days

TRM M

C Vote

on th

e

Revisio

n/Additi

on

5 Business Days

SINGLE MEASURE

MULTIPLE MEASURES *5 distinct measures or fewer

August 15, 2018 Appendix D

TRM Management Plan

Appendix D. Measure Template

August 15, 2018 Appendix D

Define Sector

Name of Measure Measure Description

A BRIEF SUMMARY OF THE MEASURE (See current descriptions in the TRM as examples)>>

Method for Calculating Annual Energy and Peak Coincident Demand Savings

<<SHOW THE CALCULATION(S) IN DETAIL<< where:

<<INCLUDE DEFINITION OF VARIABLES IN RELATION TO THE INFORMATION REQUIRED IN THE CALCULATION(S)>>

Summary of Variables and Data Sources

<<DETAIL APPROPRIATE INFORMATION HERE>>

Coincidence Factor (CF)


Baseline Efficiencies from which Savings are Calculated


Compliance Efficiency from which Incentives are Calculated


Operating Hours


Effective Useful Life (EUL)


Ancillary Fossil Fuel Savings Impacts

<<IF REQUIRED>>

Ancillary Electric Savings Impacts

<<IF REQUIRED>>

References

<<LIST ALL REFERENCES HERE (INCLUDING SUPPORTING STUDIES)>>

Record of Revision

Record of Revision Number Issue Date

Return to Table of Contents

August 15, 2018 Appendix E

TRM Management Plan

Appendix E. TRM MC - Administrative Support


Scope of Work

TRM Administrative Vendor Technical TRM Editor – Roles/Responsibilities

The primary responsibility of the Technical TRM Editor is to provide administrative assistance, ensuring that changes to the TRM are maintained in an effective and accurate manner. The editor role at this level would also provide technical support for measures, particularly new measures. This may include the research and provision of energy savings and or cost information for individual measures, as directed by the TRM MC. Specific responsibilities for the selected vendor include but are not limited to:

Take redlined changes approved by the TRM MC and effectuate the redline changes into the relevant sections of the official TRM. Relevant sections may include, but are not limited to, engineering algorithms, technical descriptions, page number alignment, table of contents referencing, footnote management, appendix management, document formatting services, etc. Examples are included in the embedded files in the Reference Documents section.

Document and compile a list of revisions made in the TRM, utilizing a record of revision format provided by the TRM MC. Documentation shall include the name of the measure being revised, revision number, issue date, effective date, description of the revision, and the page number in which the revision is located.

Provide a secure means of exchanging electronic documents with the members of the TRM MC.

Assist the TRM MC by working directly with New York State Department of Public Service Staff (“Staff”) to publically post most current versions of the TRM. This may include: coordinating with Staff to have a document posted on the Department of Public Service website, or possibly issuing e-mails or notifications. Specific direction for this task will be provided by the TRM MC. Quarterly updates is the minimum expectation required. It should be noted that the March quarterly update represents the “annual” update, with changes to become effective January 1st of the following year.

Attend TRM MC meetings. Typically these meetings are two hours in length and held on a bi-weekly basis. In addition, ad hoc meetings may be scheduled by the TRM MC, depending on workload requirements. For the purposes of preparing a bid response, 6 to 10 hours of meeting time should be anticipated on a monthly basis.

When tasked with the development of a new measure, develop engineering narratives for the TRM MC’s consideration, using the specified form and format for each measure.


This may include incorporating information from evaluation, measurement or verification work completed within New York State or on a national level. Examples are included in the embedded files in the Reference Documents section.

Perform independent reviews of approved redlined changes being effectuated into the TRM, and advise the TRM MC if additional edits may be necessary for future consideration.

At the direction of the TRM MC, perform code and standards reviews for specific measures. Make suggested redlines for the TRM MC’s potential consideration. To the extent this type of work is authorized by the TRM MC, individual scopes of work will be presented to the Technical TRM Editor. The Technical TRM Editor will then have the opportunity to prepare a price quotation to perform such work, using the hourly rates established in the TRM bid sheet. The price quotation will ultimately be subject to the TRM MC’s review and approval before such work is awarded and authorized to commence.

Make recommendations to the TRM MC on ways to streamline and/or standardize the TRM document.

Research measures identified by the TRM MC and provide accurate and reliable cost and savings information on the measures. This would be provided for informational purposes and not included as part of the TRM

August 15, 2018 Appendix F

TRM Management Plan

Appendix F. EM&V Coordination Report

TECHNICAL RESOURCE MANUAL EVALUATION MEASUREMENT &

VERIFICATION COORDINATION REPORTTechnical Resource Manual Management Committee

July 12, 2018

Prepared By:

TRC Energy Services

10 Maxwell Drive, Suite 200 Clifton Park, NY 12065

TRM EM&V Coordination Report July 2018 i

TABLE OF CONTENTS

1.0 INTRODUCTION ......................................................................................... 1

2.0 PREVALENT MEASURES ............................................................................. 2

3.0 NON‐PREVALENT MEASURES .................................................................... 3

4.0 CURRENT EM&V ACTIVITIES ...................................................................... 6

5.0 COORDINATION PLAN ............................................................................. 17

APPENDICES

Appendix A – Results of Utility Measure Prevalence Survey Appendix B – NYSERDA Planned Evaluation Studies

TRM EM&V Coordination Report July 2018 1

1.0 Introduction On February 26, 2015, the New York State Public Service Commission (“Commission”) issued an Order Adopting Regulatory Policy Framework and Implementation Plan1 in the Reforming the Energy Vision (“REV”) Proceeding (Case 14‐M‐0101), which assigned the responsibility of management and maintenance of the New York State Technical Resource Manual (“NYS TRM” or “TRM”) to Central Hudson Gas and Electric Corporation (“Central Hudson”), Consolidated Edison Company of New York, Inc. (“Con Edison”), National Fuel Gas Distribution Corporation (“National Fuel”), New York State Electric & Gas Corporation (“NYSEG”), Niagara Mohawk Power Corporation d/b/a National Grid, The Brooklyn Union Gas Company d/b/a National Grid NY and KeySpan Gas East Corporation d/b/a National Grid (collectively “National Grid”), Orange and Rockland Utilities, Inc. (“O&R”), Rochester Gas and Electric Corporation (“RG&E”), and Long Island Electric Utility Servco LLC as agent of and acting on behalf of Long Island Lighting Company d/b/a LIPA (“LIPA”); collectively referred to as the Technical Resource Manual Management Committee (“TRM MC”).2 The TRM MC assumed management responsibility for the NYS TRM on June 1, 2015, at which time the TRM MC filed a TRM Management Plan with the Commission.3 The TRM MC contracted with TRC Energy Services (“TRC”) to provide administrative and technical support in June 2016. The Order Authorizing Utility‐Administered Energy Efficiency Portfolio Budgets and Targets for 2016‐2018 (“January 2016 Order”), issued and effective January 22, 2016, stated the following:

... the Commission will periodically identify areas that the TRM MC should focus on in order to further the goals of REV. In this order, the Commission identifies the estimates of demand savings, compliance with applicable industry standards and codes, and emerging technologies, such as geothermal systems and low‐temperature air‐source heat pumps, as areas deserving greater attention than previously received. The Commission also clarifies here that the responsibility of the utilities, with regard to the TRM, is to ensure an unbiased technical review of the estimated energy and demand savings included in or proposed for inclusion in the TRM, and that every vote is premised on the technical merits of the estimated energy and demand savings calculations without regard to whether or not the voting member endorses the measure for which the calculations or language are proposed. The Commission directs the utilities to revise the TRM Management Plan, in consultation with Staff, to address the concerns described above.4

Starting in the second quarter of 2017,5 the TRM MC and its contractor TRC initiated a global TRM update process to review every measure within the TRM for accurate and up‐to‐date demand savings, codes, standards and energy savings calculations. The global update process was developed in response to the

1 Case 14‐M‐0101 ‐ Proceeding on Motion of the Commission in Regard to Reforming the Energy Vision, Order Adopting Regulatory Policy Framework and Implementation Plan, issued and effective February 26, 2015. 2 Long Island Electric Utility Servco LLC, as an agent of and acting on behalf of Long Island Lighting Company d/b/a LIPA, was added to the NY TRM Management Committee in 2016. 3 The most recent TRM Management Plan was filed with the Commission on September 26, 2017, in Matter 15‐01319. 4 Case 15‐M‐0252 ‐ In the Matter of Utility Energy Efficiency Programs, Order Authorizing Utility‐Administered Energy Efficiency Portfolio Budgets and Targets for 2016‐2018 (issued January 22, 2016), p. 40. 5 Batches 1‐3 of the global update process were filed with the Commission in June 2017, in Matter 15‐01319. The development of batches began in the second quarter of calendar 2017.


Commission requirements outlined above. However, the TRM MC’s process went a step further, to enhance the accuracy of all measure components. This comprehensive measure review is anticipated to be completed by the third quarter of 2018. The final step of the global update process is to review the appendices of the TRM starting in the fourth quarter of 2018. Overall, the global update process has provided a standardized, fair and transparent approach to ensuring each measure in the TRM is up to date with the most recent data available. This Evaluation, Measurement and Verification (“EM&V”) Coordination Report is being submitted by the utilities and TRC, in response to ordering clause ten of the Commission’s Order Authorizing Utility‐Administered Energy Efficiency Portfolio Budgets and Targets for 2019‐2020 (“March 2018 Order”), issued and effective March 15, 2018.6 Ordering clause ten requires the utilities to:

…within 90 days of this Order…file a Technical Resource Manual (TRM) and Evaluation Measurement & Verification (EM&V) Coordination Report. The Report must include a plan to use information gleaned through EM&V activities to improve assumptions and factors within the TRM.7

The subsequent pages of this report outline the “prevalent” and “non‐prevalent” measures in the TRM, current and planned EM&V activities being undertaken by TRM MC members, how current EM&V work will impact TRM measures, and the process the TRM MC will use to address measures not currently “covered” via current and planned EM&V activities.

2.0 Prevalent Measures As required by the March 2018 Order, the utilities (both individually and collectively) conducted a review of all measures contained in the TRM, and the prevalence of those measures within the utilities’ portfolios. To gauge measure prevalence, each of the utilities completed a survey indicating the number of incentives issued, by measure, during calendar year 2017. LIPA/PSEG‐LI was not required to participate in the survey effort, or in the development of the TRM EM&V Coordination Report, since it is not regulated by the Commission.8 Therefore, it is important to note that the content of this report does not include information from LIPA/PSEG‐LI, unless specifically noted. Full results from this survey are presented in Appendix A.

The “prevalent” measures were identified using the following criteria:

Measures with the highest collective number of incentives issued statewide are considered most prevalent.

Measures that had a smaller number of incentives issued, but were offered by a large number of utilities, are also considered prevalent. Measures offered by at least three utilities are considered prevalent.

Any measure offered by two or fewer companies is not included in the prevalent list, however, these measures are still addressed later in the TRM EM&V Coordination Report.

6 Case 15‐M‐0252 ‐ In the Matter of Utility Energy Efficiency Programs, Order Authorizing Utility‐Administered Energy Efficiency Portfolio Budgets and Targets for 2019 – 2020 (issued March 15, 2018). 7 In a letter from the Commission’s Secretary dated May 22, 2018, the Commission granted an extension to July 12, 2018, for the submittal of the TRM EM&V Coordination Report. This was filed in Case 15‐M‐0252 on May 22, 2018. 8 This was discussed and reviewed with Staff on May 2, 2018.


The tables in Figures 1 and 2 below display the resultant prevalent measures for both Single and Multi‐Family (“RES and MF”) and Commercial and Industrial (“C&I”).

Figure 1 ‐ Prevalent Measures within the NYS TRM ‐ RES and MF

* National Fuel did not offer Indirect Water Heaters in calendar year 2017. The small quantity of indirect water heaters associated with National Fuel represents commitments associated with 2016 installs.

Figure 2 ‐ Prevalent Measures in the NYS TRM – C&I

3.0 Non‐Prevalent Measures Every measure in the TRM that is not expressly defined as prevalent, based on the criteria and analysis outlined above, is termed “non‐prevalent” solely for the purposes of this TRM EM&V Coordination Report. The utilities methodically defined the terms “prevalent” and “non‐prevalent” for use in this TRM EM&V Coordination Report for consistency purposes and in response to the Commission’s March 2018 Order. The “non‐prevalent” measures within the TRM are further separated into two distinct groups. The first group (outlined in Figures 3 and 4) includes measures for which at least one incentive was

Residential and Multifamily

Quantity of

Incentives

# Utilities

Offering

Incentive Companies Offering

Light Emitting Diode (LED), Compact Fluorescent Lamp (CFL) and Other Lighting 2,397,263 5 Con Ed, OR, CH, NYSEG/RGE, NG

Faucet – Low‐Flow Aerator 99,889 4 Con Ed, OR, CH, NYSEG/RGE

Showerhead – Low Flow 60,007 5 Con Ed, OR, CH, NYSEG/RGE, NG

Thermostat – Wi‐Fi (Communicating) 26,536 6 All

Furnace and Boiler 22,757 6 All

Storage Tank and Instantaneous Domestic Water Heater 12,705 5 Con Ed, OR, NYSEG/RGE, NFG, NG

Refrigerator and Freezer Recycling 10,196 4 Con Ed, OR, CH, NYSEG/RGE

Heat Pump ‐ Air Source (ASHP) 7,862 3 CH, Con Ed, O&R

Blower Fan – with Electronically Commutated (EC) Motor for Furnace Dist 3,892 3 CH, Con Ed, NYSEG/RGE

Air Conditioner ‐ Central (CAC) 1,508 3 CH, Con Ed, O&R

Hot Water Pipe Insulation 1,321 3 Con Ed, NYSEG/RGE, NG

Advanced Power Strip 1,229 4 OR, CH, NYSEG/RGE, NG

Indirect Water Heater 818 6 All*

Outdoor Reset Control for Hydronic Boiler 371 4 Con Ed, OR, CH, NG

Heat Pump Water Heater (HPWH) – Air Source 216 4 Con Ed, OR, CH, NG

Commercial & Industrial

Quantity of

Incentives

# Utilities

Offering


Interior and Exterior Lamps and Fixtures 1,449,973 5 Con Ed, OR, CH, NYSEG/RGE, NG

Refrigerated Case LED 24,404 4 Con Ed, OR, NYSEG/RGE, NG

Interior Lighting Control 25,115 5 Con Ed, OR, CH, NYSEG/RGE, NG

Furnace and Boiler 671 5 Con Ed, CH, NYSEG/RGE, NG, NFG

Variable Frequency Drive – Fan and Pump 298 4 Con Ed, OR, CH, NYSEG/RGE

Anti‐Condensation Heater Control 288 3 Con Ed, OR, CH

Unitary Air Conditioner and Unitary & Applied Heat Pump 144 4 Con Ed, OR, CH, NYSEG/RGE

Thermostat – Wi‐Fi (Communicating) 89 3 NYSEG/RGE, NG, NFG


processed statewide during calendar year 2017. The second group (outlined in Figures 5 and 6) includes measures for which no incentives were processed statewide during calendar year 2017.9 Figure 3 ‐ Non‐Prevalent Measures within the NYS TRM ‐ RES and MF

9 Although incentives were issued for non‐communicating, programmable thermostats in calendar 2017, this measure was removed from the entirety of this TRM EM&V Coordination Report, because all utilities have removed the measure from current program offerings at the request of Staff.

Residential and MF

Quantity of

Incentives

# Utilities

Offering


Air Conditioner ‐ Room (RAC) 18,720 2 Con Ed, O&R

Dishwasher 3,768 2 Con Ed, O&R

Clothes Washer 2,950 2 Con Ed, O&R

Furnace Tune‐Up 2,311 2 NYSEG/RGE, O&R

Thermostatic Radiator Valve – One Pipe Steam Radiator 847 2 Con Ed, NG

Dehumidifier 487 2 Con Ed, O&R

Learning Thermostat 475 2 CH, NYSEG/RGE

Energy Management System (EMS) 456 1 Con Ed

Air Leakage Sealing 193 2 Con Ed, NG

Air Conditioner – Room (RAC) Recycling 186 2 Con Ed, O&R

Thermostatic Shower Restriction Valve 75 2 CH, O&R

Refrigerator and Freezer Replacement 69 2 Con Ed, O&R

Clothes Dryer 64 1 NFG

Duct Sealing and Insulation 4 2 CH, O&R

Opaque Shell Insulation 24 1 Con Ed


Figure 4 ‐ Non‐Prevalent Measures within the NYS TRM ‐ C&I

* Commercial Kitchen measures were not part of the NY TRM in 2017. National Grid incentives processed during 2017 were part of a pilot program. National Fuel had one such measure incented on a customized basis during 2017.

Figure 5 ‐ RES and MF TRM Measures for which No Incentives were Processed Statewide

Commercial & Industrial

Quantity of

Incentives

# Utilities

Offering


Faucet – Low Flow Aerator 39,625 2 NG, Con Ed

Showerhead – Low Flow 9,720 1 NG

Steam Trap Repair or Replacement – Low Pressure Space Heating 8,464 1 NG

Bi‐Level Lighting 9,787 1 Con Ed

Fan Motor – with EC Motor, for Refrigerated Case or Walk‐In Cooler 1,498 2 Con Ed, O&R

Low‐Flow Pre‐Rinse Spray Valve 1,278 2 NG, Con Ed

Air Compressor 687 2 NG, O&R

Ovens, Steamers, Fryers and Griddles* 379 2 NG, NFG

Freezer and Cooler Door Strip 233 1 Con Ed

Evaporator Fan Control 166 1 Con Ed

Refrigerated Case Night Cover 118 1 Con Ed

Indirect Water Heater 53 2 NG, CH

Freezer and Cooler Door Gaskets 25 1 Con Ed

BPM Motors for HVAC Circulation (Blower) Fan 24 1 NYSEG/RGE

Chiller – Air and Water Cooled 20 2 Con Ed, NYSEG/RGE

Motor Replacement 20 1 Con Ed

Duct ‐ Sealing and Insulation 17 1 NG

Combination Ovens* 12 1 NG

Storage Tank Water Heater 10 1 NG

Residential and MF

Air Purifier (Cleaner)

Window and Through‐the‐Wall Air Conditioner Cover and Gap Sealer

Window Replacement

Air Conditioner and Heat Pump ‐ Refrigerant Charge Correction

Air Conditioner and Heat Pump ‐ Right‐Sizing

Circulator Pump – with Electronically Commutated (EC) Motor, for Hydronic Distribution

Heat Pump – Ground Source (GSHP)

Sub‐Metering


Figure 6 ‐ C&I TRM Measures for which No Incentives were Processed Statewide

4.0 Current EM&V Activities In accordance with the March 2018 Order, the utilities, both individually and collectively, identified and compiled a list of the major EM&V activities that are currently being performed or are currently planned. This is important because the identified EM&V activities, once completed, can support a review, verification or potential update of TRM assumptions, helping to improve the accuracy of measure‐specific energy savings valuation. The utilities compared the list of EM&V activities to the “prevalent” and “non‐prevalent” measures described above. The results of this comparison demonstrate that an EM&V activity will touch upon every prevalent measure listed in Figures 1 and 2. These EM&V activities will verify current TRM assumptions, or inform potential updates to TRM assumptions. It should be noted, however, that the nature of EM&V activities is such that the utilities will not know whether the study results will necessitate tangible changes to measures until the EM&V activity is complete.10 Although LIPA/PSEG‐LI did not participate in the measure prevalence survey, the company did provide information about EM&V activities, as documented in Figures 7 and 8. In addition, the New York State Energy Research and Development Authority (“NYSERDA”) provided a list of planned evaluation studies, which is provided in Appendix B of this report. The TRM MC plans to continue to work with NYSERDA to coordinate evaluation efforts. Specifically, the MC will continue its

10 It is possible that EM&V activities may simply confirm current TRM assumptions, finding them to be valid and accurate. In addition, for measures with slower customer uptake and for new measures being offered, it is possible that billing analysis may not necessarily produce statistically significant results that could be relied upon to inform TRM updates.

Commerical & Industrial

Engine Block Heater Timer

Clothes Dryer

Insulated Holding Cabinets

Refrigerator Replacement

Tier 1 Advanced Power Strip

Vending Machine and Novelty Cooler Time Clock

Air Conditioner – Room (Window)

Cool Roof

Window – Film

Window – Glazing

Air Dryer ‐ Refrigerated

Engineered Air Nozzle

No Air Loss Water Drain

Air Conditioner and Heat Pump ‐ Refrigerant Charge Correction

Chiller ‐ Cooling Tower

Chiller System Tune‐Ups

Economizer – Air Side, with Dual Enthalpy Control

Boiler Tune‐Up

Air Conditioner and Heat Pump – Packaged Terminal

Demand Control Ventilation (DCV)

Air‐Cooled Refrigeration Condenser


current practice of inviting NYSERDA to participate in measure reviews with the TRM MC and Staff, seeking input from relevant NYSERDA EM&V studies as measure updates occur. The TRM Management Plan specifically states:

“During TRM MC meetings, any input (either verbal during meetings or written between meetings) received from TRM MC member companies, Staff, NYSERDA, or other external stakeholders is welcomed and will be considered by the TRM MC.”11

In addition to collaborating with NYSERDA during measure reviews, the TRM MC strongly encourages NYSERDA’s evaluation Staff and/or its contractors to present measure revisions (or additions where applicable) to the TRM MC, based upon its completed evaluation studies. The TRM MC wishes to learn from NYSERDA’s completed evaluation studies, and welcomes its input and feedback to help improve the TRM. Welcoming NYSERDA’s participation in measure reviews and in the sharing of evaluation results is one way the utilities are compliant with Clean Energy Guidance Document CE‐05: Evaluation, Measurement & Verification Guidance, which states: “The output of EM&V activities should be transparent, useful, and actionable [emphasis added].”12 Figure 7 identifies EM&V activities that may potentially impact the TRM at large.

Figure 7 ‐ EM&V Activities with the Potential to Impact the TRM

Furthermore, utilities have EM&V activities occurring that may not directly impact the TRM, but provide insight into initiatives including energy efficiency, renewables, distributed energy, storage, emerging technologies, and behavioral studies. Figures 8 and 9 include a list of all “prevalent” measures in the Single and Multi‐Family and Commercial and Industrial sections of the NY TRM, respectively, and a description of EM&V activities (in progress or planned) that may result in changes to specific measures.

11 Matter 15‐01319 ‐ In the Matter of New York State Technical Resource Manual, Updated Revised Technical Resource Manual Management Plan (filed on September 26, 2017), p. 10. 12 Case 15‐M‐0252‐ In the Matter of Utility Energy Efficiency Programs, Clean Energy Guidance Document CE‐05: Evaluation, Measurement and Verification Guidance, p. 14.

Study Name Sponsoring Company Start Date Expected

Completion Date

Measure and Market Assessment National Grid and RGE/NYSEG Q2 2017 Q4 2018

C&I Gas Measure Assessment National Grid Q2 2019 Q4 2020

Climate Zone Analysis National Grid Q2 2018 Q3 2018

Smart AC Study Con Ed Q1 2018 Q4 2018

WSHP Study Con Ed Q1 2019 Q4 2019

EV Charging Con Ed Q1 2020 Q4 2020

ESRPP Study Con Ed Q1 2021 Q4 2021

Solar PV System Output Study LIPA/PSEG‐LI Q2 2018 Q2 2019

Commercial and Residential Potential Study LIPA/PSEG‐LI Q3 2017 Q3 2018

C&I Custom ‐ Impact Evaluation Central Hudson Q1 2020 Q4 2020

C&I Prescriptive ‐ Impact Evaluation Central Hudson Q1 2021 Q4 2021

Small Business Direct Install Central Hudson Q1 2019, 2020, 2021 Q4 2019, 2020, 2021

Res and C&I Carbon Reduction Central Hudson Q1 2020, 2021 Q4 2020, 2021

Residential Appliance Saturation Survey Central Hudson Q1 2018 Q4 2018


Figure 8 ‐ EM&V Activities for Prevalent RES and MF TRM MeasuresResidential and Multifamily Sponsoring

Company

Start Date Expected

Completion

Date

Description

Light Emitting Diode (LED), Compact Fluorescent Lamp (CFL) and Other Lighting

Multi‐Family Sector Con Ed Q2 2017 Q4 2018 Process and Impact Evaluation

Residential In‐Home Research PSEG‐LI Q2 2016 Q4 2017 This was an assesment of the prevalence of various lighting types in residences in the PSEG LI

area and the associated annual hours of use (HOU) and summer peak coincidence factors (CF). A

second objective was to look at the incidence of pool pumps and dehumidifiers, and

opportunities for energy and demand savings through efficient equipment upgrades. This was

submitted to TRM after the measure was reviewed during global updates. It will be included in

future revisions.

Residential Lighting (POS) Process and Impact

Evaluations

Central Hudson Q1 2019 Q4 2019 Will focus on an assessment of program procedures, customer satisfaction and customer

awareness. To evaluate impacts for the Residential Lighting programs, CH will use a multi‐step

review approach including a review of savings estimation approaches, a tracking database

review and verification of the calculations used for deemed measures. CH will also conduct an

attribution study for this program to determine the extent of free ridership and if necessary

identify strategies for increasing net impacts.

CenHub Online Store Impact Evaluation Central Hudson Q1 2020 Q4 2020 Will use a multi‐step approach including a review of savings estimation approaches, a tracking

database review, a verification of calculations for deemed measures, and validating

assumptions based on participants’ surveys.

Online Marketplace Impact/Process Evaluation O&R Q2 2017 Q4 2018 Online marketplace and behavioral energy education program. Measures impacted are sold on

the online marketplace. No impact to TRM from behavioral program is expected.

Faucet – Low‐Flow Aerator







Showerhead – Low Flow







9

Residential and Multifamily Sponsoring

Company

Start Date Expected

Completion

Date

Description

Thermostat – Wi‐Fi (Communicating)

Residential HVAC ‐ Upstream Con Ed Q2 2019 Q4 2020 Process and Impact Evaluation

Residential Impact Evaluation NYSEG/RGE Q3 2017 Q4 2019 Study is evaluating the savings achieved from the Companies residential gas rebate program.

Determine the accurate central heating and cooling full load hours of residential single‐family

homes similar to those listed in the New York Technical Manual (NYTM) Develop an estimate of

annual natural gas and electricity savings due to the Companies’ residential gas program.

Realization rates will be developed from this analysis. Operating profiles for heating and

cooling equipment found in the homes. Estimate the heating and cooling energy and demand

savings potential of learning (smart) thermostats.




Residential Gas Impact Evaluation National Fuel Q3 2019 Q4 2020 Included in this impact evaluation is National Fuel's Residential Rebate Program. While the

study is not expected to begin until summer of 2019, the Company is initiating conceptual work

on the EM&V Work Plan for this study. As part of this effort, the Company will consider

partnership opportunities with other program administrators. Includes all measures in the

Company's Residential Rebate Program.

Residential Thermostat Study O&R Q1 2018 Q4 2018 Impact Evaluation



Furnace and BoilerResidential HVAC ‐ Upstream Con Ed Q2 2019 Q4 2020 Process and Impact Evaluation

Residential Impact Evaluation NYSEG/RGE Q3 2017 Q4 2019 Study is evaluating the savings achieved from the Companies residential gas rebate program.

Determine the accurate central heating and cooling full load hours of residential single‐family

homes similar to those listed in the New York Technical Manual (NYTM) Develop an estimate of

annual natural gas and electricity savings due to the Companies’ residential gas program.

Realization rates will be developed from this analysis. Operating profiles for heating and

cooling equipment found in the homes. Estimate the heating and cooling energy and demand

savings potential of learning (smart) thermostats.

Residential HVAC Process & Impact Evaluation Central Hudson Q1 2019 Q4 2019 In 2019 CH will conduct a process evaluation for the Residential HVAC Program that will focus on

an assessment of program procedures, customer satisfaction and customer awareness. In

addition, CH will evaluate impacts for the Residential HVAC programs, using a multi‐step

engineering review approach that follows NY’s TRM.






10


Company

Start Date Expected

Completion

Date

Description

Storage Tank and Instantaneous Domestic Water Heater







Refrigerator and Freezer RecyclingMulti‐Family Sector Con Ed Q2 2017 Q4 2018 Process and Impact Evaluation

Refrigerator Recycling Impact Analysis O&R Q2 2018 Q3 2018 Deemed savings values for primary and secondary recycled refrigerators. Study is based on a

multi‐variable regression model utilizing 2016/2017 program participant data.

Heat Pump ‐ Air Source (ASHP)

Residential Upstream Evaluation Con Ed Q2 2019 Q4 2020 Process and Impact Evaluation





Blower Fan – with Electronically Commutated (EC) Motor for Furnace Dist






Air Conditioner ‐ Central (CAC)


Hot Water Pipe InsulationMulti‐Family Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Advanced Power Strip






11


Company

Start Date Expected

Completion

Date

Description

Indirect Water Heater






Outdoor Reset Control for Hydronic Boiler


Heat Pump Water Heater (HPWH) – Air Source





Residential Sector Con Ed Q2 2019 Q4 2020 Process and Impact Evaluation


Figure 9 ‐ EM&V Activities for Prevalent C&I TRM Measures

Commercial & Industrial Sponsoring

Company

Start Date Expected

Completion

Date

Description

Interior and Exterior Lamps and Fixtures

Commercial & Industrial Sector (including

Self‐Direct and EE Auction)

Con Ed Q2 2017 Q4 2018 Process and Impact Evaluation

Non Residential Impact Evaluation NYSEG/RG&E Q3 2017 Q4 2019 Study is evaluating the savings achieved from the Companies commercial and industrial rebate

program and the small business direct program. Verification of reported program results. Evaluate

measure gross kWh, kW, and therm savings. Realization rates will be developed from this

analysis. Development of coincidence factors, annual lighting run‐time hours, and lighting load

shapes by facility type. Determination of effective useful life (EUL), and lifetime savings for 5 of

the most common lighting measures and technologies.

NWA Study Central Hudson Q1 2018 Q3 2018 Coincidence factor study for lighting in each NWA area.

Pomona NWA study O&R Q2 2017 Q4 2018 Load reduction (demand response and energy efficiency measures). Goal is to reduce 6 MW (1

MW from Energy Efficiency, 5 MW from Demand Response) to delay Pomona substation

construction. Natural gas chiller, solar and battery installations included. Battery RFP vendor

considerations through BCA.

Refrigerated Case LED

CDI Sector (AKA Small Business) Con Ed Q2 2019 Q4 2020 Process and Impact Evaluation


program and the small business direct program Verification of reported program results –Evaluate


analysis.





Interior Lighting Control





program and the small business direct program Verification of reported program results –Evaluate


analysis.

NWA Study Central Hudson Q2 2018 Q3 2018 Coincidence factor study for lighting in each NWA area.






Commercial & Industrial Sponsoring

Company

Start Date Expected

Completion

Date

Description

Furnace and Boiler




Joint Non‐Residential Impact Evaluation

With NYSERDA

National Fuel Q3 2018 Q4 2019 National Fuel plans to partner with NYSERDA on a joint impact evaluation of non‐residential

programs. Included in this impact evaluation is National Fuel's Non‐Residential Rebate Program,

as well as several NYSERDA programs. The Scope of Work for this study is currently being

developed and drafted. Includes all measures in the Company's Non‐Residential Rebate Program.

Variable Frequency Drive – Fan and Pump




Large C&I non‐lighting measure study O&R not started; TBD Q4 2020 Motors, HVAC. Pre‐metering on non‐lighting projects

Anti‐Condensation Heater ControlCommercial & Industrial Sector (including




Unitary Air Conditioner and Unitary & Applied Heat Pump





Thermostat – Wi‐Fi (Communicating)

Joint Non‐Residential Impact Evaluation

With NYSERDA

National Fuel Q3 2018 Q4 2019 National Fuel plans to partner with NYSERDA on a joint impact evaluation of non‐residential

programs. Included in this impact evaluation is National Fuel's Non‐Residential Rebate Program,

as well as several NYSERDA programs. The Scope of Work for this study is currently being

developed and drafted. Includes all measures in the Company's Non‐Residential Rebate Program.


Expanding upon the analysis, Figures 10 and 11 include a list of all “non‐prevalent” measures in the Single and Multi‐Family and Commercial and Industrial sections of the NY TRM, respectively, and a description of EM&V activities (in progress or planned) that may result in changes to specific measures. Figure 10 ‐ EM&V Activities for Non‐Prevalent RES and MF Measures

*Note: See Figure 12 (later on in the TRM EM&V Coordination Report) for additional information to address measures represented in this table, without planned EM&V activities.

Residential and MF Study Name Sponsoring

Company

Start Date Expected

Completion Date

Description

Air Conditioner ‐ Room (RAC) ESRPP Program Evaluation Con Ed Q2 2017 Q4 2018 Impact Evaluation

Dishwasher ESRPP Program Evaluation Con Ed Q2 2017 Q4 2018 Impact Evaluation

Clothes Washer ESRPP Program Evaluation Con Ed Q2 2017 Q4 2018 Impact Evaluation

Furnace Tune‐Up Residential Impact Evaluation RGE/NYSEG Q3 2017 Q4 2019 Study is evaluating savings achieved from

residential gas rebate program

Thermostatic Radiator Valve – One Pipe

Steam Radiator

Multi‐Family Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Dehumidifier Multi‐Family Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Learning Thermostat Residential Impact Evaluation RGE/NYSEG Q3 2017 Q4 2019 Study is evaluating savings achieved from

residential gas rebate program

Residential Thermostat Study O&R Q1 2018 Q4 2018 Impact Evaluation

CenHub Online Store Impact Evaluation Central

Hudson

Q1 2020 Q4 2020 Will use a multi‐step approach including a

review of savings estimation approaches, a

tracking database review, a verification of

calculations for deemed measures, and

validating assumptions based on

participants’ surveys.

Energy Management System (EMS) Multi‐Family Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Air Leakage Sealing Multi‐Family Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Air Conditioner – Room (RAC) Recycling Multi‐Family Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Thermostatic Shower Restriction Valve* ‐ ‐ ‐ ‐ ‐

Refrigerator and Freezer Replacement ESRPP Program Evaluation Con Ed Q2 2017 Q4 2018 Impact Evaluation

ESRPP Program Evaluation Con Ed Q2 2017 Q4 2018 Impact Evaluation

Residential Impact Evaluation National Fuel Q3 2019 Q4 2020 Impact Evaluation

Duct Sealing and Insulation* ‐ ‐ ‐ ‐ ‐

Opaque Shell Insulation Multi‐Family Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Clothes Dryer


Figure 11 ‐ EM&V Activities for Non‐Prevalent C&I TRM Measures

*Note: See Figure 12 (later on in the TRM EM&V Coordination Report) for additional information to address measures represented

in this table, without planned EM&V activities. None of the studies planned by the utilities, NYSERDA or LIPA/PSEG‐LI are expected to specifically affect the measures listed in Figures 5 and 6, for which no incentives were issued during calendar year 2017. Prioritization As finalized EM&V activity results are presented to the TRM MC for consideration and disposition, measures defined as “prevalent” in this report will get priority treatment, compared to the normal, on‐going workload and measures defined as “non‐prevalent.” Filling the Gaps Based on the above tables, all “prevalent” measures have at least one EM&V activity (in progress or planned) that may inform updates to each measure. The measures shown in Figure 12 below represent non‐prevalent measures without an EM&V activity currently planned by a utility. One common reason

Commercial & Industrial Study Name Sponsoring

Company

Start Date Expected

Completion Date

Description

Faucet – Low Flow Aerator Smart Kids / New Movers Kit

Program Evaluation

Con Ed Q2 2018 Q4 2018 Impact Evaluation

Showerhead – Low Flow Smart Kids / New Movers Kit

Program Evaluation


Steam Trap Repair or Replacement – Low

Pressure Space Heating

Multi‐Family Program

Evaluation


Bi‐Level Lighting C&I Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Fan Motor – with EC Motor, for Refrigerated

Case or Walk‐In Cooler

CDI Program Evaluation Con Ed Q2 2019 Q4 2020 Impact Evaluation

Low‐Flow Pre‐Rinse Spray Valve CDI Program Evaluation Con Ed Q2 2019 Q4 2020 Impact Evaluation

Ovens, Steamers, Fryers and Griddles* ‐ ‐ ‐ ‐ ‐

Freezer and Cooler Door Strip CDI Program Evaluation Con Ed Q2 2019 Q4 2020 Impact Evaluation

Evaporator Fan Control CDI Program Evaluation Con Ed Q2 2019 Q4 2020 Impact Evaluation

Refrigerated Case Night Cover CDI Program Evaluation Con Ed Q2 2019 Q4 2020 Impact Evaluation

Indirect Water Heater* ‐ ‐ ‐ ‐ ‐

Freezer and Cooler Door Gaskets CDI Program Evaluation Con Ed Q2 2019 Q4 2020 Impact Evaluation

BPM Motors for HVAC Circulation (Blower)

Fan*

‐ ‐ ‐ ‐ ‐

C&I Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Large C&I non‐lighting measure

study

O&R not started; TBD Q4 2020 C&I non‐lighting measures

Air Compressor Impact Evaluation of Custom

Compressed Air Installations

National Grid Q2 2016 Q3 2017 Impact Evaluation ‐ submitted to TRM

after the measure was reviewed

during global updates. Will include in

future revisions.

C&I Program Evaluation Con Ed Q2 2018 Q4 2019 Impact Evaluation

Large C&I non‐lighting measure

study

O&R not started; TBD Q4 2020 C&I non‐lighting measures

Duct ‐ Sealing and Insulation* ‐ ‐ ‐ ‐ ‐

Combination Ovens* ‐ ‐ ‐ ‐ ‐

Storage Tank Water Heater Joint Non‐Residential Impact

Evaluation With NYSERDA

National Fuel Q3 2018 Q4 2019 National Fuel plans to partner with

NYSERDA on a joint impact evaluation

of non‐residential programs.

Included in this impact evaluation is

National Fuel’s Non‐Residential

Rebate Program and several NYSERDA

programs. The study's scope of work

is currently being developed and

drafted. Includes all measures in the

Company’s Non‐Residential Rebate

Program.

Chiller – Air and Water Cooled

Motor Replacement


these measures do not currently have associated EM&V activities planned is the number of incentives issued for these non‐prevalent measures has been low. Due to customer uptake (in many cases) there is not a large enough sample size available to achieve statistically significant results, and as such, it would not be an effective use of limited ratepayer funds to attempt a billing analysis and/or metering/logging study in order to produce unreliable valuation results. It should be noted that some of the measures in Figure 12 are also newer measures, just starting to become available in programs. A comprehensive list of reasons that these measures do not currently have associated EM&V activities planned is provided in Figure 12. To address any measures that are not being reviewed by an existing study, the TRM MC will contract with TRC to perform a TRM benchmarking/technical validity review (similar to the global update process described earlier in the TRM EM&V Coordination Report and currently being employed by the TRM MC), to identify information sources that would potentially inform an update to that measure. A schedule for this review will be developed in the fourth quarter of 2018, once the global update process has been completed.

Figure 12 – Non‐prevalent Measures Intended for Future Study or Research

Measure Number of Incentives Reason no current study

RES Thermostatic Shower Restriction valve 75 Sample Size

RES Duct Sealing and Insulation 4 Sample Size

C&I Ovens, Steamers, Fryers and Griddles13 378 New Measure

C&I Indirect Water Heater 53 Sample Size

C&I EC BPM Motors for HVAC Circ Fan 24 Sample Size

C&I Duct Sealing and Insulation 17 Sample Size

C&I Combination Ovens 12 Sample Size; New Measure

Addressing Potential Conflicts The Commission’s March 2018 Order requires the utilities to indicate how potential conflicts in the results of EM&V activities will be handled. Generally, the utilities do not anticipate a significant number of direct conflicts for EM&V results, based on the historical track record of such occurrences and the utilities’ experience of operating programs and conducting EM&V activities during the Energy Efficiency Portfolio Standard (“EEPS”). Regardless, the utilities would jointly address any conflicts that arise on a case‐by‐case basis. To make progress on a potential conflict, the specific details would need to be known and vetted for technical merit. Most utilities study measures that are installed in their own unique service territories. Since some TRM factors include a regional aspect (e.g., equivalent full load heating hours) the possibility of conflicting information is further minimized. If conflicts do occur, the utilities envision that the full TRM MC would discuss the specifics of each scenario in detail and continue to strive to reach consensus, adopting TRM changes or resolving areas of conflict in a manner that provides for the most accurate energy savings valuation across all utilities. Stated more simply, the utilities envision that the TRM MC would use the consensus process, currently employed by the TRM MC and documented in the TRM Management Plan, for the purposes of measure

13 This new measure shows a significant number of incentives issued because the majority of the 378 incentives for C&I Ovens, Steamers, Fryers and Griddles occurred as part of a National Grid pilot program.


reviews. Any decision to resolve conflicting EM&V information would be fully documented with a vote, utilizing the existing voting protocol that has already been established and is also described in detail within the TRM Management Plan.

5.0 Coordination Plan

The TRM MC recognizes the value of coordination between the utilities, NYSERDA and third parties when planning EM&V studies that may have a direct impact on the TRM. The most recent TRM Management Plan, filed by the TRM MC on September 26, 2017, includes information about the processes by which the TRM MC operates and coordinates among member utilities and other stakeholders, such as NYSERDA or third‐parties:

The TRM MC will ensure NYSERDA has input (by inviting NYSERDA to participate in TRM MC meetings and activities), and that all changes made to the TRM are transparent to both Staff and stakeholders…14

EM&V studies that may have an impact on the TRM, and are completed by September 15 of each year, are evaluated by the TRM MC for potential updates to the TRM. Any updates resulting from the EM&V review are incorporated into prospective quarterly record of revision filings, and ultimately are incorporated into annual filings of the consolidated TRM. For the purposes of incorporating updates into prospective filings in a timely manner, the TRM MC uses September 15 of each year as a practical point to pause and reflect upon relevant EM&V studies recently completed. However, utilities, NYSERDA, or third‐party entities may submit EM&V studies at any point throughout the year for consideration by the TRM MC. The formal dates for this coordination are currently outlined in Clean Energy Guidance Document CE‐01: Utility Energy Efficiency Program Cycle.15 Per the March 2018 Order, Staff will issue a new System Energy Efficiency Plan (“SEEP”) guidance document. Related to the issuance of new SEEP guidance, the utilities understand that the aforementioned Clean Energy Guidance Document CE‐01 may be revised or possibly rescinded. While this may be the case, the TRM MC wishes to keep the September 15 date intact for the continued purpose of coordinating EM&V results and effectuating timely updates to TRM filings.

14 Matter 15‐01319 ‐ In the Matter of New York State Technical Resource Manual, Updated Revised Technical Resource Manual Management Plan (filed September 26, 2017), p. 5. 15 Case 15‐M‐0252 ‐ Clean Energy Guidance Document CE‐01: Utility Energy Efficiency Program Cycle, filed on July 28, 2016.


Appendix A – Results of Utility Measure Prevalence Survey


TRM MEASURE PREVALENCE SURVEY RESULTS – INDIVIDUALLY AND COLLECTIVELY ‐ RESIDENTIAL & MULTIFAMILY SECTOR

Calendar year 2017 quantities.Units

Central

HudsonCon Edison

NYSEG/

RG&E

National

Fuel

National

GridO&R Grand Total

Light Emitting Diode (LED), Compact Fluorescent Lamp (CFL) and Other Lighting # of lamps or fixtures 484,815 1,799,920 90,455 20,386 1,687 2,397,263

Faucet – Low‐Flow Aerator # of faucets aerators 131 65,940 33,796 22 99,889

Showerhead – Low Flow # of Showerheads 164 40,600 15,286 3,931 26 60,007

Thermostat – Wi‐Fi (COMMUNICATING) # of thermostats 359 6,582 3,884 830 14,467 414 26,536

Furnace and Boiler # of boilers 450 580 4,490 4,844 11,999 394 22,757

Air Conditioner ‐ Room (RAC) # of AC's 18,293 427 18,720

Storage Tank and Instantaneous Domestic Water Heater # water heaters 59 590 554 11,463 39 12,705

Refrigerator and Freezer Recycling # of items recycled 1,569 318 6,576 1,733 10,196

Heat Pump ‐ Air Source (ASHP) # of HP's 948 6,887 27 7,862

Blower Fan – with Electronically Commutated (EC) Motor for Furnace Dist # of Fans 98 220 3,574 3,892

Dishwasher # of dishwashers 3,600 168 3,768

Clothes Washer # of washers 2,852 98 2,950

Furnace Tune‐Up # of tune ups 2,309 2 2,311

Air Conditioner ‐ Central (CAC) # of AC's 249 981 278 1,508

Hot Water Pipe Insulation # of rebates 445 684 192 1,321

Advanced Power Strip # of power strips 437 383 43 366 1,229

Thermostatic Radiator Valve – One Pipe Steam Radiator # of TRVs 703 144 847

Indirect Water Heater # of water heaters 40 71 36 29 551 91 818

Dehumidifier # of dehumidifiers 446 41 487

Learning Thermostat # of thermostats 121 354 475

Energy Management System (EMS) # EMS Systems 456 456

Outdoor Reset Control for Hydronic Boiler # of systems installed 163 36 67 105 371

Heat Pump Water Heater (HPWH) – Air Source # of water heaters 83 7 112 14 216

Air Leakage Sealing # of rebates 186 7 193

Air Conditioner – Room (RAC) Recycling # of ACs 127 59 186

Thermostatic Shower Restriction Valve # of valves 68 7 75

Refrigerator and Freezer Replacement # of items replaced 66 3 69

Clothes Dryer # of dryers 64 64

Opaque Shell Insulation # of rebates 24 24

Duct Sealing and Insulation # of rebates 2 2 4


TRM MEASURE PREVALENCE SURVEY RESULTS – INDIVIDUALLY AND COLLECTIVELY ‐ COMMERICAL & INDUSTRIAL SECTOR

Calendar year 2017 quantities.Units

Central

Hudson

Con

Edison

NYSEG/

RG&E

National

Fuel

National

GridO&R Grand Total

Interior and Exterior Lamps and Fixtures # of lamps or fixtures 76,343 573,341 291,065 465,022 44,202 1,449,973

Faucet – Low Flow Aerator # of aerators 315 39,310 39,625

Interior Lighting Control # of controls installed 150 17,988 385 6,342 250 25,115

Refrigerated Case LED # of Lamps 15,405 6,753 2,180 66 24,404

Bi‐Level Lighting # of sensors installed 9,787 9,787

Showerhead – Low Flow # of showerheads 9,720 9,720

Steam Trap Repair or Replacement – Low Pressure Space Heating # of steam traps 8,464 8,464

Fan Motor – with EC Motor, for Refrigerated Case or Walk‐In Cooler # of motors 1,135 363 1,498

Low‐Flow Pre‐Rinse Spray Valve # valves 276 1,002 1,278

Air Compressor #compressors 686 1 687

Furnace and Boiler # of furnaces or boilers 43 21 166 35 406 671

Ovens, Steamers, Fryers and Griddles # of pcs equipment 1 378 379

Variable Frequency Drive – Fan and Pump # of VFDs installed 7 159 97 35 298

Anti‐Condensation Heater Control # controls installed 1 187 100 288

Freezer and Cooler Door Strip # rebates 233 233

Evaporator Fan Control # controls installed 166 166

Unitary Air Conditioner and Unitary & Applied Heat Pump # of pcs equipment 40 18 66 20 144

Refrigerated Case Night Cover # of covers 118 118

Thermostat – Wi‐Fi (Communicating) # of thermostats 4 3 82 89

Indirect Water Heater # of water heaters 2 51 53

Freezer and Cooler Door Gaskets # of gaskets 25 25

BPM Motors for HVAC Circulation (Blower) Fan # motors 24 24

Chiller – Air and Water Cooled # chillers 10 10 20

Motor Replacement # of replacements 20 20

Duct ‐ Sealing and Insulation # rebates 17 17

Combination Ovens # of ovens 12 12

Storage Tank Water Heater # water heaters 10 10


Appendix B – NYSERDA Planned Evaluation Studies

NYSERDA Planned Evaluation Study Schedule as of 5‐31‐18

Sector/CEF Chapter; Study TypeMarket or

ImpactEvaluation Year(s)

Planned Start (subject

to change)

Planned End (final

report date, subject to

change)

Planned Evaluation Scope (subject to change)

Agriculture ‐ Advancing Agricultural Energy

Technologies

Market Baseline Market 2018 2017 2019 Market evaluation will draw on the logic model and will include baseline measurements of key

market indicators including, but not be limited to, the rate at which underused or emerging

technologies are adopted and replicated by participants and non‐participants and knowledge of

and confidence in the benefits of underused or emerging approaches and technologies.

Communities ‐ Clean Energy Communities Market Baseline Market 2017 2017 2017 This program intervention will include surveys/interviews with samples of communities at

various stages and levels of involvement to assess effectiveness and value of the Clean Energy

Communities Portal and resources provided, which High‐Impact Actions communities have

implemented, and which ones they have not, barriers to implementing energy actions, Cost of

implementing High‐Impact Actions, detailed information on implemented actions, including

project impacts, and related actions by non‐participating communities that are causally linked

to the intervention

Commercial ‐ Commercial Real Estate (CRE)

Tenant

Market Baseline Market 2017 2017 2018 Baseline measurements of key market indicators include, but are not limited to, the volume and

rate of turn‐over of leased commercial office space, current use of building‐specific above code

energy efficiency approaches, real estate broker awareness and practices around incorporating

energy efficiency into options into leasing dialogue, awareness and practices of architects and

engineers regarding incorporating above code energy efficiency into tenant space designs, etc.

Industrial ‐ Continuous Energy Improvement

(OSEM & SEM)

Market Baseline Market 2017 2017 2017 Market Evaluation is planned in a coordinated manner for On‐site Energy Manager, Strategic

Energy Management, and Energy Management Information System. Because the market actors

overlap across strategies and the evaluation of SEM and OSEM are complete, to reduce survey

fatigue, the evaluation of EMIS will be included in the future assessment of SEM and OSEM.

Market Evaluation will be aligned with the logic model(s) and will include baseline and

longitudinal measurement of key indicators of programmatic and broader market success.

Baseline measurements of key performance indicators may include, but not limited to: current

market penetration of On‐site Energy Managers, current state of service provider knowledge

and experience in providing these services, etc., the current market penetration of SEM, current

state of facility knowledge and experience in SEM practices, etc.

This listing includes studies currently planned into 2020 sorted by planned start date; additional studies are planned for out‐years (e.g., continued longitudinal measurements for market studies), but actual timing for out‐year studies is dependent on

completion of the near‐term studies listed below. In addition, where initiative progress indicates timing to begin impact evaluations, the timing of some impact evaluations is TBD.

This table represents NYSERDA's current plans for evaluation in the coming years covering CEF, NY Green Bank and legacy portfolios (e.g., EEPS); the scope of the studies described below is largely drawn from published CEF Chapter filings but is subject

to change as work gets underway.

Final evaluation plans and resultant studies are/will be posted in the EM&V Matter Number on DMM (16‐02180); final studies are also posted on NYSERDA's website (https://www.nyserda.ny.gov/About/Publications/Program‐Planning‐Status‐and‐

Evaluation‐Reports/Evaluation‐Contractor‐Reports).

The study start/end dates should be considered tentative; ultimate timing for studies is influenced by program launch, evaluation study prioritization, seasonality in data collection and other similar factors.

Measure‐specific analyses are identified where known, or can be inferred from Sector/CEF Chapter notations. By the nature of some initiatives, however, this information has not yet been determined.

NYSERDA Planned Evaluation Studies 1 of 14




to change)

Planned End (final


change)


Clean Transportation ‐ Electric Vehicles

(Innovation)

Market Baseline Market 2017 2017 2017 Baseline measurements of key performance indicators include, but are not limited to, the

number of charging stations installed, consumer awareness, and number of electric vehicles

registered in NYS. In these areas, NYSERDA will first utilize existing information and will fill gaps

in information as needed and feasible for appropriate baselining.

Energy Storage ‐ Reducing Barriers to

Deploying Distributed Energy Storage

Market Baseline Market 2017 2017 2017 Baseline evaluation activities include, but are not limited to, measuring indicators including cycle

time of projects and balance of system costs for distributed energy storage systems. In these

areas, NYSERDA will first utilize existing information and will fill gaps in information as needed

and feasible for appropriate baselining.

Renewables Optimization ‐ Energy Storage

and Technology Development

Market Baseline Market 2017 2017 2017 Baseline measurements of key performance indicators include, but are not limited to, metrics

related to hardware cost. In these areas, NYSERDA will first utilize existing information and will

fill gaps in information as needed and feasible for appropriate baselining.

Agriculture ‐ Greenhouse Lighting and

Systems Engineering

Market Baseline Market 2018 2017 2019 Market Evaluation will draw on the logic model and will include baseline and longitudinal

measurement of key indicators of market success including current market penetration of

control systems in greenhouses, current product lifespans and current crop production yields.

Grid Modernization ‐ High Performing Grid Market Baseline Market 2018 2017 2018 N/A

Multifamily Performance ‐ Market Rate Concurrent

Impact

Evaluation

Impact 3/1/2016 ‐ 12/29/2017 2017 2018 Evaluation contractors work with NYSERDA Evaluation and Program staffs to provide feedback

on measure baselines and review of pre and post‐retrofit measurement plans, which may

include accompanying technical review contractors on site visits.

Industrial and Process Efficiency Post‐Retrofit

Assessment

Impact

Evaluation

Impact 1/1/2012 ‐ 12/29/2017 2017 2018 The evaluation includes an estimation of the evaluated savings for the Program, which includes

energy and demand savings for electricity, and energy savings for natural gas/fuel achieved

using site verification, pre‐post energy consumption analysis, and energy modeling.

Innovation Capacity and Business

Development ‐ M‐Corps

Market Baseline Market 2017 2017 2018 Market baseline measurements of key market indicators may include, but are not limited to,

time‐to‐market for cleantech products, manufacturing strategies developed for cleantech

products, and private investment leverage.

NY‐Sun Solar PV Impact

Evaluation

Impact 2008 ‐ 2016 2017 2018 This impact evaluation encompasses NYSERDA‐funded solar photovoltaic (PV) projects from

2008‐2016. This includes programs funded under NY‐Sun and other NYSERDA‐funded solar PV

initiatives from 2011 – 2016, as well as solar projects completed in 2008 to establish persistence

of solar PV systems. Evaluation metrics include supplied power per site and region, gross energy

production ‐ first year, gross energy production – long term persistence, capacity factors and

performance modeling.

Low‐to‐Moderate Income ‐ REVitalize Market Baseline Market 2017 2017 2018 Market Evaluation includes baseline measurements and longitudinal measurement of key

progress indicators. In these areas, NYSERDA will first utilize existing information and will fill

gaps in information as needed and feasible. NYSERDA will attempt to measure the influence of

the technology transfer activities to determine the number of LMI and EJ communities that

undertake community energy planning activities and implement community‐scale clean energy

projects as a result of the technology transfer; and the number of LMI customer that benefit

from the community‐scale clean energy projects supported directly through pilots and that

result from the technology transfer activities.





to change)

Planned End (final


change)


Commercial ‐ Real Time Energy Management

(Commercial Energy Management)

Market Baseline Market 2017 2017 2018 This market baseline evaluation included measurements of key performance indicators including

awareness of RTEM (and Remote Energy Monitoring), combined as Energy Management (EM)

among owners, operators and providers, size of the current EM market, use of EM by decision

makers to assess operational risk, use of EM to support broader energy efficiency goals, etc.

Multi‐Sector ‐ Technical Services ‐ Agriculture Market Baseline Market 2018 2017 2019 Key market baseline indicators include, but are not limited to, the number of qualified and active

energy‐focused firms; rate at which clean energy technologies are adopted and replicated by

participants and non‐participants; knowledge of and confidence in the benefits of clean energy

approaches and technologies; and impact of any incentive offering changes on measure

adoption and participation

Workforce Development ‐ Industry

Partnerships

Market Baseline Market 2017 2017 2018 Market baseline measurements of key market indicators may include, but are not limited to,

increased wages for trainees, increase in number of workers trained, and employee retention.

Communities ‐ Clean Energy Communities Market Update

1

Market 2018 2018 2019 Longitudinal measurements including, but not limited to, updates of the baseline metrics or key

performance indicators.

Clean Energy Products Market Baseline Market 2017 2018 2018 Baseline measurements of key market indicators of ASHP‐related components include but are

not limited to: number and dollar value of incentives; availability and use of new sales models,

cost‐savings calculator, mapping tool, training materials and promotional materials; increased

upstream and midstream market actor awareness of the value of units; increased customer

understanding of the value of the products; number of units sold; increased demand for units;

reduced up‐front cost of units; and increased stocking and sales of units. Given the upstream‐

focused, market transformational nature of this initiative, impact evaluation will be market‐

based, triangulating data such as number of units sold, secondary data such as such as national‐

level sales data (e.g., HARDI), and data collected from market actors including the influence of

the initiative in increasing demand and adoption of targeted products. Deemed savings values

will be applied to net unit sales to estimate energy savings.

Commercial ‐ Code to Zero Market Baseline Market 2018 2018 2019 Market evaluation will draw on the logic model and will include baseline measurements of key

market indicators. Baseline measurements of key market indicators include, but are not limited

to, the number of recipients receiving training and improvement in code compliance levels.

Resource Acquisition Transition ‐ Combined

Heat and Power

Mid‐Course

Review ‐ Impact

Market 2018 2018 2019 Evaluation M&V will be conducted for a sample of systems, according to the International

Performance Measurement & Verification Protocol (IPMVP) method(s) most appropriate given

the improvements made.

Communities ‐ Community Energy

Engagement (Clean Energy Engagement)

Market Baseline Market 2018 2018 2019 This evaluation will include surveys/interviews with samples of communities at various stages

and levels of involvement to assess effectiveness of the locally‐based organizations and the

resources provided; barriers to households and communities to implementing clean energy

projects; investigating the awareness of and interest in locally‐based organizations’ services; and

documenting the experience and expectations of households in completing clean energy

projects and contractors interacting with the locally‐based organizations.





to change)

Planned End (final


change)



(OSEM & SEM)

Market Update

1

Market 2018 2018 2018 Regular (e.g., annual or biennial) and measurement of market change will occur once the

program is underway and will provide follow up measurement to these baseline indicators as

well as assess level of replication of strategic energy management practices and on‐site energy

managers into non‐pilot facilities, the models for replication, and the associated benefits.


(OSEM & SEM)

Market Update

2

Market 2019 2018 2020 Regular (e.g., annual or biennial) and measurement of market change will occur once the

program is underway and will provide follow up measurement to these baseline indicators as

well as assess level of replication of strategic energy management practices and on‐site energy

managers into non‐pilot facilities, the models for replication, and the associated benefits.

Energy‐Related Environmental Research Citation analysis

‐ Market

Market 2017 2018 2018 NYSERDA will rely upon regular, ongoing input from the Science and Program Advisors, as well

as from external stakeholders, to monitor and prioritize energy‐related environmental issues,

and to effectively target program resources. The regular updating of the research plans, as well

as output from funded research projects, will help staff measure success of efforts and identify

opportunities for program adjustments. Regular citation analyses will be conducted on articles

published through the program. This analysis will provide the number of citations of NYSERDA

program research outputs by other researchers and studies. Obtaining citation information

helps document if and how the research findings supported by this program are being used by

other researchers.



Market Update

1

Market 2018 2018 2018 Regular (e.g., annual or biennial) updates to key performance indicators and measurement of

market change, including the number of projects and type of energy storage systems approved

by AHJs, are planned.



Market Update

1

Market 2018 2018 2018 Regular (e.g., annual) updates to key performance indicators and measurement of market

change will occur to assess changes in hardware costs and other market indicators.

Commercial EEPS Legacy Final Impact

Evaluation

Impact 10/1/2013 ‐

12/31/2017

2018 2019 Evaluation M&V will be conducted for a sample of systems, according to the International



Commercial/Industrial ‐ FlexTech/Local Law

87

MAR Study Impact 1/1/2009 ‐ 2/29/2016 2018 2019 This impact evaluation addresses the Flex Tech program overall and will separately present the

impact of projects with measures installed in response to New York City Local Law 87 (LL87). The

scope of this impact evaluation include a measure adoption rate analysis.

On‐Site Power ‐ Fuel Cell Soft Cost Reduction

(Incentive Program)

Market

Baseline, TMA

Market 2018 2018 2019 Market evaluation draws on the logic model and will address key indicators such as sales of fuel

cell systems; changes in familiarity regarding methods that monetize fuel cell benefits; and the

demonstration of high‐value use cases.

Resource Acquisition Transition (and EEPS

legacy) ‐ Residential Home Performance with

Energy Star/EmPower/Residential Transition

Impact

Evaluation

Impact 1/1/2012 ‐ 12/31/2016 2018 2019 This impact evaluation condenses into a singular, comprehensive effort the evaluation of

NYSERDA’s two umbrella existing homes retrofit programs: Home Performance with ENERGY

STAR® (HPwES), and EmPower New York (EmPower) along with National Fuel Gas Distribution

Corporation’s (NFGDC) Low Income Usage Program (LIURP) which is administered through

EmPower. The outputs from this study will be evaluated gross energy savings and realization

rates for electric and natural gas measures incented through the residential programs. Delivered

fuel impacts are also planned. Evaluation M&V will be conducted for a sample of participating

spaces/buildings, according to the International Performance Measurement & Verification

Protocol (IPMVP) method(s) most appropriate given the improvements made.





to change)

Planned End (final


change)


Commercial ‐ K‐12 Schools Market Baseline Market 2018 2018 2019 Baseline measurement of key market indicator is planned and include, but not limited to, the

number of benchmark reports, awareness and utilization of utility programs and NYSERDA for

measure installation, number of schools receiving recognition for clean energy activities, and

number of schools with understanding of the benefits of clean energy and efficient operations.

Large Scale Renewables ‐ Large Scale Wind

Balance of System Cost Study

Market Baseline Market 2018 2018 2018 Baseline balance‐of‐system costs for large‐scale wind.

New Construction ‐ Net Zero Energy Buildings Market Market 2018 2018 2019 This market baseline evaluation is in the development phase and will be coordinated with the

evaluation of the New Construction and Code to Zero initiatives.

New Construction Comprehensive Strategy ‐

LMI

Market Market 2018 2018 2019 Market baseline measurements of key market indicators include but are not limited to: the

number of advanced buildings and units built in NYS, participants attending workshops/trainings

and projects utilizing model measure packages.


Market Rate

Market Baseline Market 2018 2018 2019 Market baseline measurements of key market indicators include but are not limited to: the

number of advanced buildings and units built in NYS, participants attending workshops/trainings

and projects utilizing model measure packages.

Building Innovations ‐ Next Gen HVAC Market

Assessment

Market 2017 2018 2018 Market evaluation draws on the theory of change outlined in the logic model and will

longitudinal measurement of key indicators of success, such as leveraged funds, products

developed and demonstrated, increased revenue, and ultimately replication through increased

awareness and technology adoption. The evaluation of this initiative is planned as part of the

evaluation of Renewable Heating & Cooling.

NY Green Bank Market Evaluation Market Baseline Market 2018 2018 2019 Assess financial market transformation across different financial product types.

Low‐to‐Moderate Income ‐ RetrofitNY Market Baseline Market 2017 2018 2019 Evaluation plan is under development

Renewable Heating & Cooling ‐ Heat Pumps

and Solar Thermal

Market Baseline Market 2018 2018 2018 Market baseline evaluation activities include surveys/interviews with market participants at

various stages and levels of involvement to assess improvements in awareness and customer

confidence in Renewable Heating and Cooling, effectiveness of tools such as the customer

targeting tool, RFP template, marketing materials and standard protocols for assessments,

feasibilities, design and M&V, and installed cost by category. This evaluation will combine

research objectives from NextGen HAVC, and ASHP (Products) and inform other ASHP‐related

initiatives.

Renewable Heating & Cooling ‐ Renewable

Heat NY

Market Baseline Market 2018 2018 2018 Market Evaluation includes baseline measurements of key indicators of programmatic and

broader market success. including, but not limited to, the size of existing base of biomass HVAC

installers, designers, and engineers relative to size of those qualified under Renewable Heat New

York, Sales of NYSERDA qualified biomass boilers compared to sales of all biomass boilers

statewide, and customer satisfaction with installers and equipment.

Workforce Development ‐ Industry

Partnerships

Market Update

1

Market 2018 2018 2019 Regular (e.g., annual or biennial) updates to key performance indicators and measurement of

market change, including but not limited to, number of incumbent workers advanced/promoted,

of industry partnerships established, number of workers who participate in an internship or

apprenticeship, and disadvantaged workers (LMI) entering building operations and maintenance

careers.





to change)

Planned End (final


change)


Agriculture ‐ Advancing Agricultural Energy

Technologies

Market Update

1

Market 2019 2019 2020 Regular longitudinal measurements (e.g., annual or biennial) will include updates of the baseline

metrics as well as additional measurements to assess market change resulting from the

initiative.

Multi‐Sector ‐ Clean Energy Advanced Market

Performance (AMP) Challenge

Market

Assessment

Market 2019 2019 2019 Baseline measurements of key market indicators include but are not limited to number of

energy efficiency projects undertaken, number of companies using market solutions that reduce

or eliminate barriers to scale for energy efficiency services, and energy efficiency sales cycle

lifetime (i.e., time spent from assessment to plug‐in).

Clean Energy Products Market Update

1

Market 2019 2019 2020 Longitudinal measurements including, but not limited to, updates of the baseline metrics or key

performance indicators specific to ASHP technologies.


Development ‐ CleanTech StartUp

Market Update

1

Market 2019 2019 TBD Regular (e.g., annual or biennial) updates to key performance indicators and measurement of

market change, including, but not limited to, accelerating the time to market for cleantech

startup companies, product commercialization, revenue generated by new commercial products

and products that have previously been commercialized, and jobs created/retained by client

companies are planned.


Heat and Power

Market

Evaluation

Market 2019 2019 2019 Market evaluation draws on the logic model and will address key indicators such as sales of

systems; changes in familiarity regarding methods that monetize benefits; and the

demonstration of high‐value use cases. Further, market interest in combined systems (CHP

paired with other energy efficiency or renewable technologies) will be measured.


Tenant

Market Update

1

Market 2018 2019 2019 Regular (e.g., annual or biennial) update to key performance indicators and measurement of

market change, including, but not limited to, usefulness, uptake and outcomes of standardized

efficiency packages; replication of commercial real estate building‐specific packages into non‐

NYSERDA funded facilities; the models for replication; and the associated benefits.



Market Update

1


market changes will be conducted to assess changes in the effectiveness of the locally‐based

organizations and the resources provided; barriers to households and communities to

implementing clean energy projects; investigating the awareness of and interest in locally‐based

organizations’ services; and documenting the experience and expectations of households in

completing clean energy projects and contractors interacting with the locally‐based

organizations.

Grid Modernization ‐ DER Integration Market Update

1

Market 2019 2019 TBD Updates to key performance indicators and measurement of market change are planned.



Market Update

2

Market 2019 2019 TBD Regular (e.g., annual) updates to key performance indicators and measurement of market

change will occur to assess changes in hardware costs and other market indicators.

Agriculture ‐ Greenhouse Lighting and

Systems Engineering

Market Update

1

Market 2019 2019 2020 Updates to key performance indicators and measurement of market change, including level of

market adoption (replication into non‐pilot facilities), and the associated benefits.


Development ‐ M‐Corps

Market Update

1

Market 2018 2019 2019 Regular (e.g., annual) updates to key performance indicators and measurement of market

change, include but are not limited to number of commercial cleantech products introduced,

revenue generated, and time‐to‐market.





to change)

Planned End (final


change)


Clean Transportation ‐ Public Transportation

& Electrified Rail

Market Update

2


market change are planned for when the initiative is underway. Sources of data include public

and commercially available data, and primary data collection through surveys of key market

actors.


and Solar Thermal

Market Update

1

Market 2019 2019 2020 Progress assocaited with this and other related initiatives will be measured through periodic

(e.g., annual or semi‐annual) surveys of market participants at various stages and levels of

involvement to assess improvements in awareness and customer confidence in Renewable

Heating and Cooling, effectiveness of tools such as the customer targeting tool, RFP template,

marketing materials and standard protocols for assessments, feasibilities, design and M&V, and

installed cost by category. This evaluation will combine research objectives from NextGen HAVC,

and ASHP (Products) and inform other ASHP‐related initiatives.


Heat NY

Market Update

1

Market 2019 2019 2020 Progress associated with this initiative will primarily be measured through periodic (e.g., annual

or semi‐annual) assessment of key indicators of programmatic and broader market success

including, but not limited to, change in the size of existing base of biomass HVAC installers,

designers, and engineers relative to size of those qualified under Renewable Heat New York,

change in sales of NYSERDA qualified biomass boilers compared to sales of all biomass boilers




Market Update

1

Market 2018 2019 TBD Key performance indicators measurements including awareness of RTEM (and Remote Energy

Monitoring), combined as Energy Management (EM) among owners, operators and providers,

size of the current EM market, use of EM by decision makers to assess operational risk, use of

EM to support broader energy efficiency goals, etc.

Commercial ‐ Code to Zero Market Update

1

Market 2019 2020 2021 Regular longitudinal measurements (e.g., annual or biennial) will include updates of the baseline

metrics as well as additional measurements to assess market change resulting from the

initiative. Due to the historically demonstrated difficulty of obtaining samples for studying code

compliance, Delphi panels will be utilized in order to track key indicators in the initiative that

would traditionally require widespread data collection to measure, such as the number of

jurisdictions adopting alternative enforcement business structures and stretch codes. This will

allow NYSERDA to trade expensive, widespread sampling for focused, expert consensus where

appropriate. In order to supplement the panels, a targeted longitudinal study may be conducted

for a limited number of representative jurisdictions. This longitudinal study would not be used to

draw conclusions about the population of new construction or renovation projects, but rather as

a comparison to the Delphi panel responses to validate findings or raise questions in need of

additional research.





to change)

Planned End (final


change)


NY Green Bank Market Evaluation Market Update

1

Market 2020 2020 2021 Update to key performance indicators and measurement of change.


Development ‐ CleanTech StartUp

Market Baseline Market 2017 N/A 2018 Market baseline measurements of key market indicators include, but are not limited to, the

number of client companies engaged, client companies graduated, and geographic coverage of

client companies engaged.


(Innovation)

Market Update

1

Market 2018 N/A 2019 Regular (e.g., annual or biennial) updates to key performance indicators and measurement of

market change are planned. Sources of data include public and commercially available data, and

primary data collection through surveys of key market actors.

Low‐to‐Moderate Income ‐ Low‐Income

Community Solar

Market Baseline Market 2017 N/A 2018 Market baseline measurements may include, but are not limited to, the number of community

solar projects contracted by NYSERDA for low income customer subscriptions and number of

outreach and marketing campaigns by NYSERDA focused on low income community solar

customers.


Community Solar

Market Update

1


market change, including but not limited to: number of community solar subscriptions, and

customer acquisition/management and financing costs for LMI solar projects are planned.


Community Solar

Market Update

2

Market 2019 N/A TBD Regular (e.g., annual or biennial) updates to key performance indicators and measurement of

market change, including but not limited to: number of community solar subscriptions, and

customer acquisition/management and financing costs for LMI solar projects are planned.


& Electrified Rail

Market Baseline Market 2017 N/A 2018 Market baseline activity includes measurement of key indicators including transit ridership and

financial investment levels in transit. In these areas, NYSERDA will first utilize existing

information and will fill gaps in information as needed and feasible for appropriate baselining.


& Electrified Rail

Market Update

1


market change are planned for when the initiative is underway. Sources of data include public

and commercially available data, and primary data collection through surveys of key market

actors.

Multi‐Sector ‐ Technical Services ‐ Single

Family

Market Baseline Market 2018 N/A N/A Key market baseline indicators include, but are not limited to, the number of qualified and active






Legacy) ‐ Agricultural Audits

Impact

Evaluation

Impact TBD TBD TBD This evaluation is planned to include an assessment of measures installed on participating farms

recommended in the audit. Evaluation M&V will be conducted for a sample of participating

sites/projects, according to the International Performance Measurement & Verification Protocol

(IPMVP) method(s) most appropriate given the improvements made.

Multi‐Sector ‐ Clean Energy Advanced Market

Performance (AMP) Challenge

Impact

Evaluation

Impact TBD TBD TBD As projects mature and measures are installed or process improvements implemented,

measurement and verification will be conducted at the pilot facilities to verify energy savings.

This verification will be conducted according to the International Performance Measurement &

Verification Protocol (IPMVP) method(s) most appropriate given the improvements

made. Depending on the extent of replication identified in Market Evaluation, impact evaluation

will quantify the level of benefits, including energy savings.





to change)

Planned End (final


change)


Communities ‐ Clean Energy Communities Final Impact

Evaluation

Impact TBD TBD TBD Evaluation M&V will be conducted for a sample of participating spaces/buildings, according to

the International Performance Measurement & Verification Protocol (IPMVP) method(s) most

appropriate given the improvements made. Evaluation M&V will rely heavily on the CRE data

stream and analysis to validate program estimated savings.


Heat and Power

Final Impact

Evaluation



appropriate given the improvements made.

Commercial ‐ New Construction EEPS Legacy Final Impact

Evaluation





Tenant

Market Update

2

Market 2019 TBD TBD Regular (e.g., annual or biennial) update to key performance indicators and measurement of

market change, including, but not limited to, usefulness, uptake and outcomes of standardized

efficiency packages; replication of commercial real estate building‐specific packages into non‐

NYSERDA funded facilities; the models for replication; and the associated benefits.


Tenant

Impact

Evaluation



appropriate given the improvements made. Evaluation M&V will rely heavily on the CRE data

stream and analysis to validate program estimated savings.



Impact

Evaluation








(OSEM & SEM)

Impact

Evaluation








(OSEM & SEM)

Impact

Evaluation











to change)

Planned End (final


change)



(OSEM & SEM)

Final Impact

Evaluation








(Innovation)

Market Update

2

Market 2019 TBD TBD Regular (e.g., annual or biennial) updates to key performance indicators and measurement of

market change are planned. Sources of data include public and commercially available data, and

primary data collection through surveys of key market actors.


(Innovation)

Final Impact

Evaluation

Impact TBD TBD TBD Evaluation M&V will be conducted for a sample of projects, according to the International



Energy‐Related Environmental Research Market Update

1

Market 2018 TBD TBD NYSERDA will rely upon regular, ongoing input from the Science and Program Advisors, as well








other researchers.

Energy‐Related Environmental Research Market Update

2

Market 2019 TBD TBD NYSERDA will rely upon regular, ongoing input from the Science and Program Advisors, as well








other researchers.

Multi‐Sector ‐ Energy Efficiency Soft Cost

Challenge

Market Baseline Market 2017 TBD TBD Market baseline measurements of key market indicators include, but are not limited to, the

number of energy efficiency projects undertaken, number of companies using market solutions

that reduce or eliminate barriers to scale for energy efficiency services, and energy efficiency

sales cycle lifetime (i.e., time spent from assessment to plug‐in).


Challenge

Market Update

1


market change, include, but not limited to, the reduction in customer acquisition and transaction

costs, shorter energy efficiency sales cycle lifetime, and increased energy efficiency deployment

in underserved markets are planned.





to change)

Planned End (final


change)



Challenge

Market Update

2


market change, include, but not limited to, the reduction in customer acquisition and transaction

costs, shorter energy efficiency sales cycle lifetime, and increased energy efficiency deployment

in underserved markets are planned.



Market Update

2


market change, including the number of projects and type of energy storage systems approved

by AHJs, are planned.

Energy Storage Impact Evaluation Impact

Evaluation

Impact TBD TBD TBD TBD



Impact

Evaluation







Residential ‐ Engaging New Markets Market Baseline Market 2018 TBD TBD Given the targeted market groups and barriers addressed by this intervention, it is anticipated

that market evaluation of this initiative will leverage the update of the Residential Statewide

Building Stock (RSBS) study planned for 2018. The objective of the RSB study will be to update

key metrics from the baseline activity reported in 2014 with particular focus on metrics

including, but not limited to, energy use and the penetration of energy‐efficient equipment,

building characteristics, and energy management practices in the residential single‐family sector.

Information on respondent household characteristics and the stocking practices of upstream

market actors is also planned to be collected. Key market indicators for any initiative‐specific

evaluation activity will include, but not be limited to, the number of qualified and active energy‐

focused firms; the rate at which clean energy activities specific to this initiative are adopted and

replicated by participants and non‐participants; knowledge of and confidence in the benefits of

clean energy approaches and technologies by homeowners, contractors, real estate

professionals and other key market actors; and the impact that changes to incentive offerings

have on measure adoption, participation, and demand for energy efficiency information and

services. A market‐based evaluation approach will leverage industry sales data, market actor

survey responses, and awareness studies and will seek to measure the adoption rate of clean

energy for homeowners influenced by initiative market actors and related activities. Primary

data collection will include surveys of manufacturers and upstream market actors and will be

supplemented with secondary data including sector‐level market studies. Publicly and

commercially available data will be utilized to inform the measurement of key market indicators.

Updates to key performance indicators will occur periodically (e.g., annually or semi‐annually).





to change)

Planned End (final


change)


Residential ‐ Engaging New Markets Impact

Evaluation








(Incentive Program)

Market Update,

TMA

Market 2019 TBD TBD Market evaluation draws on the logic model and will address key indicators such as sales of fuel

cell systems; changes in familiarity regarding methods that monetize fuel cell benefits; and the

demonstration of high‐value use cases.


(Incentive Program)

Impact

Evaluation







Resource Acquisition Transition ‐ Industrial Mid‐Course

Review ‐ Impact

Impact TBD TBD TBD As this program matures and improvements made, measures installed, or behavioral changes

implemented, measurement and verification will be conducted.

Commercial ‐ K‐12 Schools Impact

Evaluation

Impact TBD TBD TBD Evaluation M&V will be conducted according to the International Performance Measurement

and Verification Protocol (IPMVP) method(s) most appropriate given the measures promoted by

this initiative. Evaluation M&V of direct savings will focus on areas of greatest impact and will

draw upon project‐level data collected by the program.


legacy) ‐ Market Rate Multifamily

Performance

Final Impact

Evaluation





Market Rate

Market Update

1


market change, including but not limited to: more projects utilizing integrated design and

construction practices, increased use of advanced building practices, and reductions in

discrepancies between predicted and actual savings are planned.

Building Innovations ‐ Next Gen HVAC Market

Assessment

Update

Market 2018 TBD TBD Progress associated with this initiative will primarily be measured through periodic (e.g., annual

or semi‐annual) assessment of key indicators of programmatic and broader market success

including, but not limited to, change in the size of existing base of biomass HVAC installers,

designers, and engineers relative to size of those qualified under Renewable Heat New York,

change in sales of NYSERDA qualified biomass boilers compared to sales of all biomass boilers


Building Innovations ‐ Next Gen HVAC Impact

Evaluation

Impact TBD TBD TBD A broad demonstration project impact evaluation will include projects from this area and will

examine benefits of demonstration projects, rate of and success factors associated with

replication, and benefits of replication projects. Cost and energy savings will be quantified as

part of this study.





to change)

Planned End (final


change)


New Construction ‐ Residential Impact

Evaluation


measurement and verification will be conducted to verify energy savings. This verification will

be conducted according to the International Performance Measurement & Verification Protocol

(IPMVP) method(s) most appropriate given the improvements made. Depending on the extent

of replication identified in Market Evaluation, impact evaluation will quantify the level of

benefits, including energy savings.

Low‐to‐Moderate Income ‐ RetrofitNY Market Update

1

Market 2019 TBD TBD TBD

Commercial ‐ REV Campus Challenge Market Baseline Market 2017 TBD TBD Progress associated with this initiative will primarily be measured through a periodic (e.g.,

annual or semi‐annual) survey of REV Campus Challenge Members. Measurements include, but

are not limited to, achievement of clean energy milestones, climate action plan goals, and other

plans for implementation of clean energy measures.


and Solar Thermal

Impact

Evaluation

Impact TBD TBD TBD Impact evaluation will leverage data collected by community campaigns, through technical

assistance studies and the GSHP incentive program. The evaluation will involve field verification

of a sample of projects, and focus on renewable heating and cooling energy produced and fossil

fuel displaced.


Heat NY

Impact

Evaluation

Impact TBD TBD TBD Impact evaluation will be conducted to assess system operation and performance after at least

one heating season for a sample of projects. Impact evaluation will apply the IPMVP methods

most appropriate for the type of projects and expected level of energy impact and may involve

engineering analysis, billing analysis, site visits and metering.



Market Update

2

Market 2019 TBD TBD Key performance indicators measurements including awareness of RTEM (and Remote Energy

Monitoring), combined as Energy Management (EM) among owners, operators and providers,

size of the current EM market, use of EM by decision makers to assess operational risk, use of

EM to support broader energy efficiency goals, etc.

Resource Acquisition Transition ‐ Small Wind Final Impact

Evaluation

Impact TBD TBD TBD Evaluation M&V will be conducted for a sample of participating sites, according to the

International Performance Measurement & Verification Protocol (IPMVP) method(s) most

appropriate.

Multi‐Sector ‐ Technical Services ‐ Agriculture Impact

Evaluation


measurement and verification will be conducted to verify energy savings. This verification will

be conducted according to the International Performance Measurement & Verification Protocol

(IPMVP) method(s) most appropriate given the improvements made. Depending on the extent

of replication identified in Market Evaluation, impact evaluation will quantify the level of

benefits, including energy savings.

Multi‐Sector ‐ Technical Services ‐

Commercial

Market Baseline Market 2018 TBD TBD Key market baseline indicators include, but are not limited to, the number of qualified and active









to change)

Planned End (final


change)


Multi‐Sector ‐ Technical Services ‐ Industrial

(non‐traditional)






Multi‐Sector ‐ Technical Services ‐

Multifamily






Workforce Development Impact

Evaluation




NY Green Bank ‐ Multiple impact studies

related to multiple transactions that may

include, but are not limited to CHP,

Commercial & Not‐for‐Profit, K‐12 Sector,

Multifamily, Residential EE & Renewables,

Small Fuel Cell, Small Wind and Solar PV

Impact

Evaluation

Impact TBD ‐ various TBD ‐ various TBD ‐ various Impact evaluations will be assessed on a periodic basis and will, to the extent appropriate and

practicable, be combined with other NYSERDA impact evaluations and conducted according to


