Willingness to pay for programmable heating thermostats: The effects of information and the role of incentives

Last registered on June 28, 2023

Pre-Trial

Trial Information

General Information

Title
Willingness to pay for programmable heating thermostats: The effects of information and the role of incentives
RCT ID
AEARCTR-0011637
Initial registration date
June 25, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 28, 2023, 4:38 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
RWI - Leibniz Institute for Economic Research

Other Primary Investigator(s)

Additional Trial Information

Status
On going
Start date
2023-05-26
End date
2023-07-02
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The aim of this incentivized survey experiment is to elicit households’ willingness to pay (WTP) for programmable heating thermostats. Digital technologies are seen as a promising way to mitigate climate change by reducing energy demand, especially by combining technology with behavioral interventions such as real-time feedback or social comparisons.
The heating sector of private households is an important lever to reduce GHG emissions. While energy retrofits (e.g. facade insulation) promise substantial energy savings, they are often very costly, not only in terms of pecuniary costs but also other costs, such as time, noise and dirt during construction. Moreover, insulation is often not attractive for landlords to conduct and can only in rare cases be conducted by tenants in multiple apartment buildings. In addition to saving energy, programmable heating thermostats are designed to increase consumer utility by reducing the amount of changes and adjustments required by users. Despite these seemingly attractive attributes, as of 2022, only 8% of households in Germany have installed programmable thermostats (Statista, 2022).
Given this low penetration of programmable thermostats among German households, I aim to understand households’ valuation for programmable thermostats by eliciting the WTP in an incentivized survey experiment. The goal of the experiment is twofold: First, I investigate whether the low of share of programmable thermostats among private households is a reflection of well-informed preferences or ignorance. To this end, I test the effect of two different types of information on the WTP. Second, I want to study the role of using a lottery to make the experiment incentive compatible and consequential (this has especially been discussed in the context of public goods, see e.g. Vossler et al., 2012; Carson et al., 2014) for elicited WTP values. As researchers are often financially restricted when it comes to ensuring that choices in an experiment are incentive compatible and consequential, using a lottery to select only a certain percentage of respondents seems as a good compromise. However, if elicited preferences/WTP values differed depending on the probability of being selected, this would be important to consider when comparing results from experiments with different winning probabilities in incentivized settings.
External Link(s)

Registration Citation

Citation
Kaestner, Kathrin. 2023. "Willingness to pay for programmable heating thermostats: The effects of information and the role of incentives." AEA RCT Registry. June 28. https://doi.org/10.1257/rct.11637-1.0
Experimental Details

Interventions

Intervention(s)
Participants will be randomly divided into a control or one of two treatments receiving additional information about programmable thermostats. All participants receive some general information about programmable thermostats. In one of the treatment groups, participants will additionally receive information about the energy and cost savings potential of programmable thermostats. In the other treatment group, participants will additionally receive information about the emissions reductions potential of programmable thermostats.
On the same level of intervention, all participants who do not opt out of the incentivized experiment will be randomly divided into a low or high winning probability group, where they will learn about their chance of being selected to actually receive one of their choices made in the experiment. These differences will also be made in the control group. Participants who opt out of the incentivized experiment will randomly be divided into a control or one of the two information provision groups without any winning probabilities.
Intervention Start Date
2023-05-26
Intervention End Date
2023-06-26

Primary Outcomes

Primary Outcomes (end points)
There are three main outcomes which I aim to estimate: (1) the average WTP, (2) the reduced form treatment effects of the two different information treatments on the average WTP, (3) as well as the reduced form effects of the winning probability on the average WTP. These outcomes will be observed and compared.
Primary Outcomes (explanation)
The WTP will be elicited with a multiple price list.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
With this study, I aim to investigate households’ WTP for programmable heating thermostats. In addition, I am interested in whether information on the potential cost savings for households or information on the potential emission reductions affects the WTP and whether this effect differs between the two types of information. Lastly, I also aim to study the role of the winning probability for the elicited WTP values. To this end, I designed a randomized, incentivized experiment with a lottery and integrate it in the questionnaire of the third survey wave of the GHHP.
Baseline data on household characteristics, demographic information, building characteristics, heating systems and energy efficiency of the building stem from the first, second or third survey wave of the GHHP, i.e. from 2021, 2022 or 2023. This information is usually only asked once, depending on the time participants enter into the GHHP. However, when participants move between two survey waves, they are asked to state their building characteristics again. Other information, like current energy cost, past and planned energy retrofit activities and socio-economic characteristics are asked to participants in each survey wave.

At the beginning of the experimental part, I first ask all respondents about their type of main thermostat that they use to control the heating temperature in the majority of their rooms. Here, households can for instance already state whether they own a programmable
thermostat. As all households, even households that have already installed programmable thermostats, will be asked about their WTP, this serves as an important control variable. Afterwards, all respondents will receive some basic background information about programmable heating thermostats to ensure that every respondent has some basic knowledge and understands what type of thermostat the subsequent questions refer to. Following a few questions about respondents' level of informativeness and beliefs about programmable thermostats, respondents will be informed that on the following survey pages, they have the chance to win a voucher or one programmable thermostat with the previously described characteristics. Here, respondents have the chance to opt out of this lottery.

Respondents who stay in the lottery will then be randomly divided into the six groups described in the intervention, whereas respondents who opt out will be randomly divided into three groups. Each group receives specific information (see Intervention) about programmable thermostats and will subsequently be presented with a multiple price list (MPL) consisting of ten choices, each between a voucher of a certain euro value and a programmable heating thermostat. At the outset of the experiment, I explain to participants who did not opt out of the lottery that if they are randomly drawn as part of the lottery with the respective winning probability, one of their ten choices between a voucher or a programmable thermostat will be randomly chosen and actually paid out such that participants have an incentive to state their true WTP.
Experimental Design Details
With this study, I aim to investigate households’ WTP for programmable heating thermostats. In addition, I am interested in whether information on the potential cost savings for households or information on the potential emission reductions affects the WTP and whether this effect differs between the two types of information. Lastly, I also aim to study the role of the winning probability for the elicited WTP values. To this end, I designed a randomized, incentivized experiment with a lottery and integrate it in the questionnaire of the third survey wave of the GHHP.
Baseline data on household characteristics, demographic information, building characteristics, heating systems and energy efficiency of the building stem from the first, second or third survey wave of the GHHP, i.e. from 2021, 2022 or 2023. This information is usually only asked once, depending on the time participants enter into the GHHP. However, when participants move between two survey waves, they are asked to state their building characteristics again. Other information, like current energy cost, past and planned energy retrofit activities and socio-economic characteristics are asked to participants in each survey wave.

At the beginning of the experimental part, I first ask all respondents about their type of main thermostat that they use to control the heating temperature in the majority of their rooms. Here, households can for instance already state whether they own a programmable
thermostat. As all households, even households that have already installed programmable thermostats, will be asked about their WTP, this serves as an important control variable. Afterwards, all respondents will receive some basic background information about programmable heating thermostats to ensure that every respondent has some basic knowledge and understands what type of thermostat the subsequent questions refer to. In this short text, participants will learn that the thermostats can be installed on all heating radiators by taking off the old one and either directly or with help of an adapter installing the new one on the radiator. In addition, respondents will learn that programmable thermostats can measure the room temperature and control the radiator valve and thus the room temperature automatically. They will also learn that they can set heating profiles (directly at the thermostat or via an app) and that the thermostat can automatically detect ventilation times and that users can still manually change the heating temperature if needed. Households who have not installed any programmable thermostats yet will then be asked whether they have heard about programmable thermostats before. To elicit respondents’ prior level on informativeness, they will also be asked how well-informed they feel about heating thermostats. Afterwards, I require respondents to state their belief about energy cost changes and about their expectation regarding potential emission reductions, both induced by the installment of programmable thermostats. Subsequently, respondents will be informed that on the following survey pages, they have the chance to win a voucher or one programmable thermostat with the previously described characteristics. Here, respondents have the chance to opt out of this lottery.

Respondents who stay in the lottery will then be randomly divided into the six groups described in the intervention, whereas respondents who opt out will be randomly divided into three groups.

Each group receives specific information about programmable thermostats (see Intervention) and will subsequently be presented with a multiple price list (MPL) consisting of ten choices, each between a voucher of a certain euro value and a programmable heating thermostat. At the outset of the experiment, I explain to participants who did not opt out of the lottery that if they are randomly drawn as part of the lottery with the respective winning probability, one of their ten choices between a voucher or a programmable thermostat will be randomly chosen and actually paid out such that participants have an incentive to state their true WTP.
Randomization Method
Randomization done by the programming by the survey institute programming the questionnaire and running the survey
Randomization Unit
The sample consists of households where the household head is invited to respond to the questionnaire. Hence, randomization will be done on the smallest unit of observation, i.e. on the household level
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
about 15,000 households
Sample size: planned number of observations
about 15,000 households
Sample size (or number of clusters) by treatment arms
about 1,600 expected households per each treatment group and each control group
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials