Heterogeneity in probability perception and its effect on insurance decisions: How does partisanship affect our daily choices?

Last registered on December 09, 2024

Pre-Trial

Trial Information

General Information

Title
Heterogeneity in probability perception and its effect on insurance decisions: How does partisanship affect our daily choices?
RCT ID
AEARCTR-0014936
Initial registration date
December 04, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 09, 2024, 4:52 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
CUNY Graduate Center

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2024-12-05
End date
2026-08-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This paper analyzes the impact of decision-makers' heterogeneous perception of crime likelihood on their insurance decision. I assume that exogenous news about crime likelihood is digested differently for Republican and Democrat supporters, weighting information according to news source partisanship. Different probability weights result in distorted decision choices of suboptimal insurance deductibles. In addition, the paper tests if this notion can be corrected after the bias is explicitly revealed and if the correction would last.
External Link(s)

Registration Citation

Citation
Raab, Oliver. 2024. "Heterogeneity in probability perception and its effect on insurance decisions: How does partisanship affect our daily choices?." AEA RCT Registry. December 09. https://doi.org/10.1257/rct.14936-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Intervention (Hidden)
Study Procedure
Participants begin by reviewing and consenting to an informed consent form required to proceed with the research. On the next page, they complete a short "well-being survey," consisting of three questions about their current mood and general well-being (including whether they tend to be optimistic or pessimistic). Afterward, they encounter a welcome note, followed by an overview of the study and a detailed explanation of the rewards. Participants will also be briefed on the insurance terminology in the survey. Next, they are asked to complete an “example task”, earning $3 dedicated for use in the subsequent tasks. Upon completion, they move on to Stage 1 of the experiment.

Stage 1: Initial Exposure
Participants are introduced to a fictional neighborhood called "Maplewood Heights" in "Harborview City." Participants then watch three short videos, each approximately 50 seconds long, styled similarly to YouTube "shorts". These videos describe various aspects of "Maplewood Heights" and are labeled as content from Fox News, CNN News, or NeighborhoodSnoop. The order in which the videos are shown is randomized to prevent any bias based on viewing order. While all videos present similar data about the neighborhood, the crime rate might appear depicted with an upward or downward bias in one of three videos (always CNN or FOX). Participants are divided into five groups based on this bias: Republican Biased Upward, Democrat Biased Upward, Republican Biased Downward, Democrat Biased Downward, and Unbiased. After watching the videos, participants estimate the perceived crime rate in "Maplewood Heights" using a slider scale ranging from 0% to 10%. They then select the amount of money they would prefer with certainty to avoid a lottery scenario. Finally, participants choose an optimal insurance deductible based on the perceived crime rate. The responses from the biased groups are compared to those from the unbiased group.

Stage 2: Second Exposure with Bias Disclosure
In this stage, only participants from the treatment groups (all except the unbiased group) watch a second set of videos depicting the neighborhood a year later. Similarly, as in Stage 1, they view three short videos, which maintain the bias from the first stage but also include a disclaimer informing participants about the bias. After watching the videos, participants again estimate the crime rate, evaluate the insurance lottery, and choose an insurance deductible. These responses are compared to their responses from Stage 1.

Stage 3: Final Exposure without Bias Disclosure
In the final stage, only participants from the treatment groups (all except the unbiased group) view a third set of videos, once again describing the neighborhood a year later. These videos continue to reflect the bias from previous stages but without the disclaimer, the same as in Stage 1. Participants repeat the tasks of estimating the crime rate, valuing the insurance lottery, and selecting an insurance deductible. The responses in this stage are compared to those from Stage 2.
Intervention Start Date
2024-12-05
Intervention End Date
2026-08-31

Primary Outcomes

Primary Outcomes (end points)
1. Effect of the Biased Partisan News on Crime Perception and Insurance Decisions
2. Effect of the Correction Signal on Crime Perception and Insurance Decision
3. Effect of the Correction Signal Retention on Crime Perception and Insurance Decision
Primary Outcomes (explanation)



Effect of the Biased Partisan News on Crime Perception and Insurance Decisions:
Participants will report their perception of the crime rate in the hypothetical neighborhood after exposure to partisan news sources. They will then select deductible amounts in a hypothetical insurance task, allowing the study to assess how perceived crime rates influence their insurance decisions.
Effect of the Correction Signal on Crime Perception and Insurance Decision:
The study investigates whether providing participants with information about the bias in the news sources improves the accuracy of their perceived crime rates and encourages more optimal deductible choices.
Effect of the Correction Signal Retention on Crime Perception and Insurance Decision:
The study also explores whether the effects of the correction signal fade over time when information about the bias is no longer reinforced, leading to a potential return to biased perceptions and suboptimal decision-making.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Participants are recruited on prolific and are asked to respond to a survey. The survey has three stages. In Stage 1, participants watch three short videos about specific neighborhood with varying crime rate biases, estimate the crime rate, evaluate an insurance lottery, and select a deductible. In Stage 2, biased groups watch updated videos with a disclaimer revealing the bias, repeating the same tasks to compare with Stage 1. In Stage 3, biased groups view videos without the disclaimer, repeating the tasks to assess the lasting impact of the correction.
Experimental Design Details
Participants begin by consenting to an informed consent form and completing a brief well-being survey, followed by a welcome note, study overview, and explanation of insurance terminology. After an example task, they proceed to the experiment, which consists of three stages:
Stage 1: Initial Exposure
Participants watch three short, randomized videos about the fictional neighborhood "Maplewood Heights," styled like YouTube Shorts. Videos are labeled as Fox News, CNN News, or NeighborhoodSnoop and may show upward or downward crime biases based on group assignments. Participants estimate the crime rate, evaluate an insurance lottery, and select a deductible.
Stage 2: Second Exposure with Bias Disclosure
Treatment groups watch updated videos, including a disclaimer revealing the bias. They repeat the crime rate estimation, lottery evaluation, and deductible selection tasks, comparing results to Stage 1.
Stage 3: Final Exposure without Bias Disclosure
Treatment groups view another set of videos with the bias but without the disclaimer, repeating the same tasks for comparison with Stage 2.
Rationale:
Stage 1 compares biased groups (Republican/Democrat with upward or downward biases) to an unbiased group. In Stages 2 and 3, within-group comparisons assess the impact of bias disclosure and its subsequent removal. Only biased groups proceed through all stages, while the unbiased group participates in Stage 1.
Randomization Method
The randomization method will be done by the computer, specifically in qualtrics. Each participant will be randomly assigned to a different treatment group.
Randomization Unit
The randomization unit is an individual participant.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
The upper limit for participants is 150.
Sample size: planned number of observations
The upper limit for participants is 150.
Sample size (or number of clusters) by treatment arms
The upper limit for participants is 150. That would make at most 50 participants per each group.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
University Integrated Institutional Review Board
IRB Approval Date
2024-11-25
IRB Approval Number
2024-0686-GC

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials