Determinants of plan choice and responsiveness of consumers to time-varying electricity prices

Last registered on September 10, 2021

Pre-Trial

Trial Information

General Information

Title
Determinants of plan choice and responsiveness of consumers to time-varying electricity prices
RCT ID
AEARCTR-0008211
Initial registration date
September 08, 2021

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
September 10, 2021, 11:59 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Primary Investigator

Affiliation
University of Queensland

Other Primary Investigator(s)

PI Affiliation
Pennsylvania State University
PI Affiliation
Georgia Institute of Technology
PI Affiliation
University of Pittsburgh

Additional Trial Information

Status
On going
Start date
2020-01-01
End date
2022-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Consumers consistently elect to stay with default options, even when these options are dominated by other choices. Several hypotheses for this bias exist including the presence of switching costs, unobservable heterogeneity, rational inattention, and present bias. We randomly assign two treatments to customers of a municipal electric utility in the United States to study default bias in plan choice and consumption patterns conditional on plan choice. The experiment is conducted within the context of a planned change to time-varying electricity prices for all utility customers. Within this context, we randomly assign customers to stay on the current rates or be moved to time-varying rates. In both cases, consumers can opt for the alternative. We also randomly assign customers to opt-out of receiving a “shadow bill” of time-varying rates or the option to opt in to a “shadow bill". We collect data on plan choice, electricity consumption, and survey data on household characteristics and behavioral parameters. Using the planned re-assignment of all customers to the new rate in 2021 we also investigate the dynamics of adjustment to long-run price changes.
External Link(s)

Registration Citation

Citation
Brent, Daniel et al. 2021. "Determinants of plan choice and responsiveness of consumers to time-varying electricity prices ." AEA RCT Registry. September 10. https://doi.org/10.1257/rct.8211-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Default assignment to an electricity rate structure or shadow bill information treatment with option to opt in/opt out.
Intervention Start Date
2021-05-25
Intervention End Date
2021-09-24

Primary Outcomes

Primary Outcomes (end points)
Program choice (decision to opt/in out of shadow bill and/or new rate)
Hourly electricity consumption at the household level
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
3,916 households serviced by Groton Electric Light Department were randomly assigned to one of five groups concerning a pilot program for a new dynamic pricing structure. Customers of the utility were informed via newsletter of the upcoming introduction of a new pricing rate that is “almost half our flat-rate 20 hours a day and more than triple our flat-rate from 4:00 pm and 8:00 pm.”
1. Control: 1016 households do not receive encouragement but can opt in to the new rate at any time.
2. Shadow Bill Opt-In: 508 households receive a direct mailing from the utility offering them the opportunity to receive a “shadow bill” of the new rate in the coming summer (2021)
3. Shadow Bill Opt-Out: 508 households receive a direct mailing from the utility informing them that they will receive a “shadow bill” of the new rate in the coming summer (2021) and offering them the opportunity to opt out of the “shadow bill”.
4. 4/40 Opt-In: 1900 households receive a direct mailing from the utility offering them the opportunity to opt-in to the new rates. Of these households, 940 are also told they will receive a “shadow bill” of the new rate in the coming summer but they may opt out of receiving the “shadow bill”.
5. 4/40 Opt-Out: 316 households receive a direct mailing from the utility informing them that they will be placed on the new rate structure in the coming summer (2021) and are offered the opportunity to opt out.

All customers of the utility were invited to participate in a customer survey collecting information on household characteristics and behavioral parameters including expectations, loss aversion, present bias and risk preferences.

We randomize along two dimensions: shadow bill and the new time of use (TOU) rate structure, henceforth 4/40 since it is $0.04 kwh off-peak and $0.40 kwh peak. Based on the agreement with our partner our experimental design cannot force any consumer to remain in a given treatment assignment. Therefore, we relied on the established default bias for our randomization. This assumes that the probability of remaining in a treatment assignment is higher for households that need to opt-out compared to households that need to opt-in.

Our first hypothesis is that consumers select rate plans that deliver electricity services at the lowest possible cost. We define the expected switching benefits E[SB] as the difference between the total costs (TC) on the uniform plan minus the total costs on the 4/40 plan conditional on electricity use staying constant. We define electricity use as e(t) to account for the full distribution of consumption over time.
E[SB] = E[TC(Uniform)|e = e(t)] - E[TC(4/40)|e = e(t)])
H1:δ=∂Prob(4/40)/∂E[SB] >0

Our next hypothesis studies the impact of information on plan choice. We expect consumers with access to shadow bills to have more information on the expected benefits from being on the 4/40 plan. Therefore, we analyze heterogeneous effects with respect to switching benefits based on access to the shadow bill. We expect the responsiveness to expected switching benefits to be a function of information provided in the shadow bill (δ(Shadow Bill)).
H2∶ (∂δ(Shadow Bill))/(∂Shadow Bill) > 0

The goal of the new plan is to decrease peak electricity use. Our first hypothesis on electricity use is that the real time rate decreases electricity use during the peak hours e(t|t = Peak). We will exploit the random assignment to default plans to estimate H3 below.
H3∶ e(t|t = Peak,4/40) < e(t|t = Peak,Uniform)

Next, we will examine heterogeneity in electricity use based on active or passive joiners. We hypothesize that consumers who actively opt into the 4/40 plan (T3) will reduce peak consumption by more than consumers who passively do not opt out (T4).
H4∶ e(t|t = Peak,4/40,active) < e(t|t = Peak,4/40,passive)

Next we will examine two hypotheses based on how the shadow bills affect peak electricity consumption. First, we hypothesize that some households that receive shadow bills, yet remain on the uniform rates will reduce peak consumption immediately. There may be two main mechanisms behind this short-run reduction despite not facing hire peak prices. First, consumers may use the opportunity to learn how to adapt to the new rates that will be universal next year. Second, consumers may understand that peak consumption is more costly to the community and reduce consumption out of good will. This leads to our next hypothesis.
H5∶ e(t|t = Peak,Uniform,Shadow Bill) < e(t|t = Peak,Uniform,No Shadow Bill)

For the subset of consumers who completed the survey we will analyze heterogeneity in our hypotheses along several dimensions:
Financial literacy on plan choice
Present bias on plan choice
Stated elasticity on plan choice and peak use
Work from home status
Experimental Design Details
Randomization Method
Randomization done in office by a computer. Randomization was stratified by quartile of the expected change in bills from a rate change given 2020 summer consumption.
Randomization Unit
Customer meter
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
3916
Sample size: planned number of observations
68,608,320 (3,916 households, 2 years of hourly data)
Sample size (or number of clusters) by treatment arms
1016 households in control, 508 households receive shadow bill opt in, 196 households receive shadow bill opt out, 1900 households receive real bill opt in, 316 households receive real bill opt out.
Assuming a survey response rate of 25% our sample size for survey characteristics will be 979 households.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
BEL Low and Negligible (LNR) Research Sub-committee at the University of Queensland.
IRB Approval Date
2021-04-08
IRB Approval Number
2021/HE000659

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials