Learning Under Uncertainty

Last registered on October 07, 2024

Pre-Trial

Trial Information

General Information

Title
Learning Under Uncertainty
RCT ID
AEARCTR-0014409
Initial registration date
September 24, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 07, 2024, 6:57 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Primary Investigator

Affiliation
Purdue University

Other Primary Investigator(s)

PI Affiliation
University of Toledo

Additional Trial Information

Status
In development
Start date
2024-09-25
End date
2024-12-15
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Estimation of belief learning models relies on several assumptions regarding measurement errors. Whereas existing work has focused on classical measurement errors, the current project investigates the impact of a non-classical measurement error. In particular, we design an economics experiment to study the impact of rounding bias on belief updating.
External Link(s)

Registration Citation

Citation
Bland, James and Yaroslav Rosokha. 2024. "Learning Under Uncertainty." AEA RCT Registry. October 07. https://doi.org/10.1257/rct.14409-1.0
Experimental Details

Interventions

Intervention(s)
Following the literature on belief updating, we will utilize a typical setup with two urns and two colors of balls in each urn. In particular, the urns will be called red and blue. Each urn will contain varying numbers of red and blue balls, such that the blue urn contains more blue balls than the red urn. One of the urns is selected by a computer to be the 'chosen urn.' Subjects are truthfully informed about the probability with which each urn is selected. Then the computer makes random draws (with replacement) from the selected urn. After some number of draws, we elicit subjects' beliefs regarding which of the urns has been selected.
Intervention (Hidden)
In our planned experiment, the intervention consists of manipulating the prior probability of each urn being chosen, the composition of each urn, the realization of draws from the selected urn, and the number of draws after which beliefs are elicited. The urn compositions will be determined randomly by a computer ahead of the experiment. Based on the simulations, we rank scenarios presented to the participants as being more or less subject to the rounding bias and the direction of the bias. Specifically, for each set of scenarios (where a scenario includes the prior, the composition of each urn, the random draws, and the timing of decisions), we simulate decisions of agents that do not round and those that do. We then estimate the learning parameters for these 'non-rounders' and 'rounders' and determine the bias's direction and magnitude. The main hypothesis is that scenarios that are deemed to be susceptible to the positive rounding bias (based on our measure) will result in estimates that are different from scenarios that are susceptible to the negative rounding bias. In addition to the main focus on learning, we elicit measures of cognitive ability using progressive matrix reasoning tests from ICAR as well as a short version of the Big5 questionnaire. We hypothesize that higher cognitive ability will result in less frequent rounding and, as such, would be less subject to the influence of rounding bias on learning estimates. In addition, we intend to explore how the big 5 personality traits as well as personality types identified in Gerlach et al (2018) relate to the proclivity to round and (non) bayesian learning.
Intervention Start Date
2024-09-25
Intervention End Date
2024-12-15

Primary Outcomes

Primary Outcomes (end points)
The primary variable of interest is the elicited belief about which of two urns is being chosen and the estimates of the (non) bayesian learning parameters.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Participants will be presented with a series of scenarios where they report their beliefs about probabilistic outcomes.
Experimental Design Details
Each participant will see 12 scenarios. The first 9 will have a prior that is 'round' to 5 percentage points (e.g., 25, 30, 35 etc). The last 3 wil have priors that are not round (e.g., 31). Subjects will be matched in groups of 4 such that all four subjects in a group have the same sequence of priors across scenarios, but timing and draw realization are organized in a 2x2 factorial design. Specifically, 1 & 2 have the same draws but different timing of decisions (e.g., after 2nd and 5th signal vs after 1st and 8th signal). Same for 3&4 but with different draws. 1&3 have the same timing but different draws. 2&4 have the same timing but different draws. We do this because one of the IV estimators we plan to use will rely on signal strength.
Randomization Method
Randomization done by a computer.
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
120
Sample size: planned number of observations
120
Sample size (or number of clusters) by treatment arms
120
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
N/A
IRB

Institutional Review Boards (IRBs)

IRB Name
Purdue University IRB
IRB Approval Date
2024-07-18
IRB Approval Number
IRB-2023-1952
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials