What can we learn from survey experiments?

Last registered on August 14, 2024

Pre-Trial

Trial Information

General Information

Title
What can we learn from survey experiments?
RCT ID
AEARCTR-0014161
Initial registration date
August 10, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
August 14, 2024, 2:42 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
The University of Chicago

Other Primary Investigator(s)

PI Affiliation
Pompeu Fabra University

Additional Trial Information

Status
In development
Start date
2024-08-12
End date
2024-09-18
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
There is a growing interest in understanding how subjective beliefs shape behaviors. Survey experiments, which randomly vary exposure to information treatments, aim to provide causal evidence of this link, but the methodology used by existing studies might suffer from limitations to its external validity. This study employs a survey experiment to address this gap by comparing the effects of 'forced' versus 'self-selected' information exposure on beliefs and behavioral intentions. This study is concerned with understanding whether giving participants the option to choose information consumption (rather than being forced to consuming it) can enhance external validity and reduce social desirability bias. The study aims to (i) provide evidence on the willingness to consume belief-altering information when not coerced, (ii) offer methodological insights to enhance the validity of survey experiments, and (iii) explore how information consumption influences trust in institutions and overall societal welfare.
External Link(s)

Registration Citation

Citation
BRISCESE, GUGLIELMO and Maddalena Grignani. 2024. "What can we learn from survey experiments?." AEA RCT Registry. August 14. https://doi.org/10.1257/rct.14161-1.0
Experimental Details

Interventions

Intervention(s)
This study employs a survey experiment where respondents are randomly assigned to different information treatments.
Intervention Start Date
2024-08-13
Intervention End Date
2024-09-17

Primary Outcomes

Primary Outcomes (end points)
Information consumption, knowledge accuracy, and trust in institutions.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Survey respondents are automatically randomly assigned to a control or one of two treatment groups.
Experimental Design Details
Randomization Method
Automatic randomization done by survey software.
Randomization Unit
Individual respondent level.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
0
Sample size: planned number of observations
Approximately 1600 respondents.
Sample size (or number of clusters) by treatment arms
Approximately 500 respondents per randomized group.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
See attached pre-analysis plan.
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Chicago Ethics Committee
IRB Approval Date
2024-06-03
IRB Approval Number
IRB24-0970
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials