1 / 67

CPUC Group B Research Plans

CPUC Group B Research Plans. December 11, 2018. With Subcontractors. Introduction to Sectors and Leads. Research Sectors. CPUC and Evaluation Leads by Sector. ETP STUDIES. Emerging Technologies Research Sector Area Overview. ETP-2 – ETP to Portfolio Evaluation Objectives and Activities.

takacs
Download Presentation

CPUC Group B Research Plans

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CPUC Group B Research Plans December 11, 2018

  2. With Subcontractors

  3. Introduction to Sectors and Leads

  4. Research Sectors

  5. CPUC and Evaluation Leads by Sector

  6. ETP STUDIES

  7. Emerging Technologies Research Sector Area Overview ETP Work Plan

  8. ETP-2 – ETP to Portfolio Evaluation Objectives and Activities Evaluate market uptake and savings that have moved from ETP into the PA EE Portfolio or into C&S Establish a framework for tracking the ETP-originated measures as deemed or custom Estimate resulting portfolio and/or C&S savings from these measures Develop report with historical evaluation results, and recommendations for database changes or other tracking mechanisms ETP Work Plan

  9. ETP-3 – ETP Handoff Study Objectives and Activities Provide a better understanding of the existing processes for passing technologies, approaches, and projects between technology development actors, EPIC, ETP, the IOU Incentive Portfolio, and C&S Make recommendations for the ETP, but also other groups, to allow process improvements in the broader California technology development ecosystem ETP Work Plan

  10. ETP-1 – ETP Database Dissemination Objectives Evaluate dissemination effectiveness of the ETP online databases, including the ETCC-housed ETP project database and the metrics-focused CPUC-led ETP project database Coordinate with the IOUs, the Data Contractor, and ED to facilitate decisions on website content and design to ensure the databases provide data security and program transparency Research questions include: Do the websites effectively disseminate information to relevant stakeholders? Is the level of data access appropriate for each type of stakeholder? Are there any opportunities to improve online database or visual content displayed on the websites? Timeline: Year 3 ETP Work Plan

  11. ETP-4 – TFP Pilot Objectives and Activities Evaluate the effectiveness of the TFPs to: Develop a framework for assessing effectiveness through the development of program theory and logic models Assess the effect of the pilot on technology transfers to IOU programs and the broader market Focus on selection, pilot execution and technology handoff Research questions include: How well does ETP choose and plan for TFP focused activities? Does ETP sufficiently evaluate aspects of technology that contribute to adoption/rejection of a technology within the IOU EE portfolio and opportunities for improvement? Do other coordination partners benefit from the pilot? Are there opportunities for ETP staff to enhance their TFP activities, particularly related to data collection to inform program design? Timeline: Year 3 ETP Work Plan

  12. ME&O STUDIES

  13. ME&O Research Sector Area Overview

  14. ME&O-1 – Cross-Cutting Marketing Effectiveness Study: Effectiveness Assessment Objectives Assess the effectiveness of the SW ME&O campaign in achieving its performance metrics and meeting its objectives Estimate the impact of exposure to SW and PA ME&O on energy management attitudes, behaviors, and energy usage

  15. ME&O-1 – Cross-Cutting Marketing Effectiveness Study: Effectiveness Assessment Objectives

  16. ME&O-1 – Cross-Cutting Marketing Effectiveness Study: Process Assessment Objectives and Activities Assess collaborative efforts of ME&O stakeholders Provide continuous feedback so that changes can be made in real-time

  17. ME&O 2 – Consensus Project Objectives and Activities Establish benchmarks related to ME&O metrics and success criteria in the energy efficiency industry Create a framework for the evaluation of ME&O efforts moving forward.

  18. ME&O-3 – Transition to Third Parties and CCAs Objectives What programs are being implemented by CCAs and third-party PAs? How are these programs being marketed to residential and small business consumers? How do the CCAs and third-party PAs coordinate with the IOUs and the statewide ME&O campaign in the implementation of their energy efficiency offerings? What are the implications of these changes in program delivery and marketing on the customer journey and experience? What lessons have been learned during the rollout of this process that can help improve the customer journey in the future?

  19. ME&O-3 – Transition to Third Parties and CAAs Activities

  20. WE&T STUDIES

  21. WE&T-1 – Installation Improvement Evaluation Study Objectives and Activities Assess the effectiveness of WE&T programs specifically among installation professionals; Assess the impact of each training workshop/session provided for relevant professions; Identify and assess the connection between training and improved installation practices; Provide recommendations on how to improve WE&T programs; and, Collect data to assess whether and to what extent WE&T programs drive energy savings.

  22. WE&T-2 – Research Approach and Timelines

  23. WE&T-2 – Partnerships with Training Institutions Impact Evaluation Objectives Define the term partnership, identify partnership types, and map existing and planned partnerships to partnership types; Determine the evaluability of partnerships; Understand the functioning and impact of partnerships with WE&T training and job placement organizations; Characterize how partnerships are being implemented; Determine and measure partnership effectiveness indicators (such as joint ownership and accountability for results, and effective communication and collaboration strategies); and, Assess the impacts (such as job placement and gross energy savings) of two WE&T partnerships as case studies.

  24. WE&T-2 – Research Approach and Timelines

  25. WE&T-3 – Career Connections Process Evaluation Objectives and Activities Assess evaluability and adaptability of the program Assess effectiveness toward program goals and cost-effectiveness Assess workforce outcomes for program participants Assess alignment with the identified Strategic Plan Goals

  26. WE&T-3 – Research Approach and Timelines

  27. WE&T-4 – Career and Workforce Readiness Process Evaluation Objectives and Activities Assess the evaluability and adaptability of the Career and Workforce Readiness (CWR) program; Track the CWR Program’s progress toward program goals and cost-effectiveness; Consider how the CWR program is doing with regard to workforce outcomes for program participants; and, Gage the CWR program’s alignment with the identified Strategic Plan goals and best practices outlined in the Survey of Inclusion Workforce Landscape.

  28. WE&T-4 – Research Approach and Timelines

  29. WE&T-5 – KSA Market Study Objectives and Activities Identify the KSAs needed for implementers, contractors, technicians, and contractor laborers in energy efficiency and whole building design within two key areas.

  30. WE&T-5 – Research Approach and Timelines

  31. FINANCE STUDIES

  32. Finance Sector Area Overview

  33. The Finance sector area is divided into three studies • Year 1: Evaluation of the Residential Energy Efficiency Loan (REEL) pilot • Impacts (gross savings and attribution) • Process (design and implementation) • Cost-effectiveness • Market assessment • Year 2: On-Bill Financing (OBF) Impact Evaluation • Current plan discusses options for evaluating the OBF program, especially the new OBF-only pathway • More detailed evaluation objectives and plans under development throughout 2019 • Year 3: Small Business and Multifamily Pilot Process Evaluation • Approach/objectives are heavily dependent on rollout timeline Today’s focus

  34. The goal of the REEL evaluation is to determine whether it has achieved the goals set forth by the CPUC • Core Objective: Evaluate the success of REEL according to the key metrics established in Resolution E-4900: • Scalable – can REEL reach a significant and growing number of Californians? • Leveraged– can REEL become partially or entirely self-supporting (i.e., without ratepayer funds) • Reaches underserved Californians – e.g., households that are hard to reach, are low-income, or have below-average credit scores • Produces energy savings – as shown through an analysis of meter/billing data

  35. The evaluation team will take a holistic approach to evaluating the pilot – impacts, process, and market assessment • Characterize participation in REEL as of the end of its two-year pilot period (in terms of loans, participants, partners) • Estimate gross energy savings through consumption analysis • Estimate theinfluencethatthe REEL loans had on customers’ decisions to undertake projects or participate in resource programs • Explore the costs versus benefits of REEL compared to other residential demand-side management investments • Collect feedback from stakeholders on REEL design and implementation (i.e., CAEATFA, program administrators, participating contractors and lenders) • Compare the REEL implementation model with other models • Explore how the marketplace has changed since the 2012 Decision to fund the EE Financing Pilots

  36. REEL Evaluation Activities (Q1 2019)

  37. REEL Evaluation Activities (Q2 2019)

  38. ZNE STUDIES

  39. Zero Net Energy Research Sector Area Overview

  40. ZNE-1 – ZNE Community Case Study (Newhall Ranch) This study investigates a range of questions related to the Newhall Ranch development– a community of 20,000 ZNE homes being built in Southern California. As the largest ZNE project in the US, the strategies employed to implement ZNE and electrification can inform the scaling of ZNE across the state. Study Objectives Document how the local utility (SCE) is planning for this community on its grid; Uncover how the developer is defining "Net Zero" and the subsequent strategy to meet both ZNE and carbon balance goals; Evaluate the cost-effectiveness of ZNE construction at the community scale versus single-home scale; Document how much renewable generation and storage will be behind and in front of the meter; and, Research policy barriers to ZNE and understand how incentive structures can be improved to make this and future ZNE community projects successful.

  41. ZNE-1 – ZNE Community Case Study (Newhall Ranch)

  42. ZNE-3 – IOU and CCA Cross-Cutting Program Evaluation and Program Facilitation . The primary focus of this evaluation is to assess the IOU-led cross-cutting residential and nonresidential new construction programs and the ability of these programs to yield ZNE and building electrification outcomes, as well as investigate the strengths and opportunities of CCAs and how they can contribute to ZNE and building electrification goals. Study Objectives Investigate whether the transition to third-party implementers for EE is impacting the effectiveness of ZNE and building electrification activites; Document how other utility IDER programs (e.g. for distributed generation and storage) are integrating with EE programs; Investigate the strengths and weaknesses of CCAs and examine how they can contribute to ZNE and building electrification goals; Measure the cost-effectiveness and the quality of IOU-led cross-cutting programs; Conduct up to five case studies on utility partnerships with CCAs; and, Ensure evaluation findings are received and incorporated into program design in real time through stakeholder engagement and facilitation.

  43. ZNE-3 – IOU and CCA Cross-Cutting Program Evaluation and Program Facilitation

  44. ZNE-3 – IOU and CCA Cross-Cutting Program Evaluation and Program Facilitation

  45. ZNE-5 – ZNE Retrofit Timelines and Costs This study will advance ZNE and building electrification goals in existing buildings by collecting critical information about the current retrofit landscape, quantifying cost premiums associated with extended timelines for retrofitting existing, occupied commercial and industrial facilities, and determining strategies to address tenant inconveniences. The study will include the following elements: Documenting ZNE project strategy and advanced planning opportunities and barriers; Understanding the challenge and opportunities associated with the timelines and costs for ZNE and electrification retrofits and the influence of these variables on project viability and market development; Effective communication strategies for educating key stakeholders about benefits and potential disruption of ZNE and electrification retrofits; Providing a foundation and assessing the potential of a theoretical model that accounts for tenant inconvenience, extended timelines and their effects on financial costs associated with ZNE and electrification retrofits in occupied buildings

  46. ZNE-5 – ZNE Retrofit Timelines and Costs

  47. LOCAL GOVERNMENT STUDIES

  48. LGP/REN/CCA Research Sector Area Overview • Deliverables 21 and 22 cover the Local Government Partnerships / Regional Energy Networks / Community Choice Aggregators Research Sector Area. • Each deliverable is comprised of annual studies over the three-year contract period for a total of six studies. • Year 1 studies are beginning now and delivery of the evaluation reports is set for September 2019. • Reports for Years 2 and 3 will occur at a similar cadence.

  49. Leverage opportunities across Group B Deliverables in Year 1

More Related