Back to History Current Version

Cold Climate Heat Pump Assistance Program

Last registered on June 04, 2025

Pre-Trial

Trial Information

General Information

Title
Cold Climate Heat Pump Assistance Program
RCT ID
AEARCTR-0016119
Initial registration date
May 30, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 04, 2025, 9:53 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
University of Calgary

Other Primary Investigator(s)

PI Affiliation
University of Ottawa
PI Affiliation
University of Calgary

Additional Trial Information

Status
On going
Start date
2025-05-19
End date
2027-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The purpose of this research is to evaluate the real-world performance of cold climate air source heat pumps for reducing emissions from residential space heating. It will focus on low- to modest-income households that currently heat with natural gas, a context where decarbonization is especially challenging. It will use a randomized controlled trial to evaluate heat pump performance and the effects of installation on energy consumption and affordability, greenhouse gas emissions, indoor air quality, and home comfort.
External Link(s)

Registration Citation

Citation
Myers, Erica, Nicholas Rivers and Blake Shaffer. 2025. "Cold Climate Heat Pump Assistance Program." AEA RCT Registry. June 04. https://doi.org/10.1257/rct.16119-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
We have two treatment arms

1. Direct installation of a hybrid natural gas furnace and cold climate air source heat pump (CCASHP) system
2. Fuel switching by direct installation of a CCASHP
Intervention Start Date
2025-06-30
Intervention End Date
2026-12-31

Primary Outcomes

Primary Outcomes (end points)
1) Annual Natural Gas Consumption (billing data), 2) Annual Electricity Consumption (smart meter data), 3) Indoor Temperature and Humidity (separately by summer and winter), 4) Measured indoor air quality (NOx, VOC, CO$_2$, and PM), 5) Indoor behavior (Survey section Energy use behavior and comfort questions 6, 7, 8, 9, 10, 11, 12, and 13 ), 6) Quality of heating system (Survey section Existing heating system questions 2-3 and their subparts), 7) Quality of cooling system (Survey section Existing cooling system questions 5 and its subparts), 8) Energy affordability (Survey sections: Energy use behavior and home comfort in the winter/summer, Energy Affordability and Health questions 14-16), 9) Energy health (Survey sections: Energy use behavior and home comfort in the winter/summer, Energy Affordability and Health questions 14-16)
Primary Outcomes (explanation)
A copy of the survey has been pre-filed and hidden. We will evaluate each primary outcome by constructing a mean effects index and we will also present estimates for each individual indicator within each outcome category.

Secondary Outcomes

Secondary Outcomes (end points)
1) Contractor installation quality as a function of number of installations, 2) Changes in electricity consumption by hour separately by season, 3) Comparing real-world performance of CCASHP to manufacturer rated performance, 4) Compare standard retrofit software modeled performance of average savings to realized average savings, 5) How does CCASHP performance diminish with outdoor air temperature, 6) Greenhouse gas emissions changes under the two treatments.
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Treatment Group A: Conversion of a natural gas furnace to a hybrid natural gas furnace and CCASHP system

Treatment group B: Fuel switching by direct installation of a CCASHP system

Control group A: Conversion of a natural gas furnace to a hybrid natural gas furnace and CCASHP system after a one-year monitoring period.

Control group B: Direct installation of a CCASHP system after a one-year monitoring period

The randomization will occur at the end of the Pre-inspection, Consent and Air Quality Monitoring installation visit, which occurs after the participant's eligibility is verified and they have expressed a desire to enroll in the program.

As part of this visit, the following will be done:
1) Customer fills out the baseline survey
2) Customer signs the participation agreement (if not already done online)
3) Customer activates the data sharing agreement with Green Button
4) Contractor installs air quality monitor
5) Contractor changes air filter

The target sample size is 200 customers, who will be randomized in blocks of four across the following treatment groups. Specifically, for every four customers who complete the Pre-Inspection, Consent, Air Quality Monitoring installation, and Baseline survey visit, one customer will be randomly assigned to each treatment group. This block randomization approach ensures balance in treatment assignment across installation timing.

If customers subsequently decide to no longer go forward with the heat pump installation, we will still be able to collect data on gas and electricity consumption and air quality, unless customers also opt out of data sharing

An endline survey will be performed in all groups around a year after the treatment groups in the block received installation.
Experimental Design Details
Not available
Randomization Method
Block randomization done by computer and pre-specified
Randomization Unit
Household
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1
Sample size: planned number of observations
200 households, for energy consumption outcomes, we will use up to 24 months of billing data pre and post.
Sample size (or number of clusters) by treatment arms
50 Treatment Group A, 50 Treatment Group B, 50 Control Group A, 50 Control Group B.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Using existing utility data the MDE for electricity consumption is 10%
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Ottawa Office of Research Ethics and Integrity
IRB Approval Date
2025-05-12
IRB Approval Number
H-05-25-11628