Back to History Current Version

Information Treatments, Hypotheticals, and Event Studies: Comparative Estimates

Last registered on September 03, 2025

Pre-Trial

Trial Information

General Information

Title
Comparing vignettes with RCT: monetary policy and macro expectations
RCT ID
AEARCTR-0016642
Initial registration date
August 29, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
September 03, 2025, 8:54 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
University of Birmingham

Other Primary Investigator(s)

PI Affiliation
University of Texas at Austin
PI Affiliation
European Central Bank
PI Affiliation
University of Macau

Additional Trial Information

Status
In development
Start date
2025-08-29
End date
2026-09-30
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study investigates how individuals update macroeconomic expectations in response to counterfactual versus factual policy information. We implement a two-wave survey experiment surrounding a FOMC meeting. In Wave 1, conducted before the meeting, participants are randomly assigned to either a control group or to one of several hypothetical scenario treatments describing possible FOMC policy outcomes. Expectations about inflation, economic activity, household income, unemployment, and interest rates are elicited both before and after treatment. In Wave 2, conducted shortly after the meeting, we recontact some Wave 1 participants and recruit a new control group. Participants provide updated expectations prior to any intervention, capturing natural exposure to the Fed’s decision, and are then randomized to either receive or not receive explicit information about the actual FOMC outcome. This design enables within-person and between-group comparisons of belief updating across hypothetical and real-world contexts. The study contributes by providing the first direct evidence on how imagined policy scenarios compare to factual announcements in shaping public expectations, and by offering methodological guidance for the design of survey experiments on economic communication.
External Link(s)

Registration Citation

Citation
Binder, Carola et al. 2025. "Comparing vignettes with RCT: monetary policy and macro expectations." AEA RCT Registry. September 03. https://doi.org/10.1257/rct.16642-1.0
Experimental Details

Interventions

Intervention(s)
Participants complete a two-wave online survey surrounding a Federal Reserve policy meeting. In Wave 1, prior to the meeting, they are randomly assigned to either a control group or to one of several hypothetical policy-scenario treatments describing potential FOMC rate decisions. In Wave 2, shortly after the meeting, participants provide new forecasts and are randomly assigned to receive or not receive explicit information about the actual FOMC decision.
Intervention (Hidden)
The study employs a two-stage experimental design to compare how hypothetical and factual monetary policy information affect expectations.

Wave 1 (pre-FOMC): Participants are randomly assigned to a control group or to one of five hypothetical vignette treatments: a 0.50pp rate hike, a 0.25pp rate hike, no change, a 0.25pp rate cut, or a 0.50pp rate cut.

Wave 2 (post-FOMC): Conducted shortly after the actual Fed decision, Wave 2 recontacts Wave 1 respondents and recruits a fresh control group. They are then randomized into control (no new information) or treatment (explicit statement of the Fed’s actual decision) group.
Intervention Start Date
2025-09-10
Intervention End Date
2026-09-30

Primary Outcomes

Primary Outcomes (end points)
The key outcome variables measure how individuals update their macroeconomic expectations in response to treatment hypothetical versus factual policy information.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
This study uses a two-wave online survey experiment conducted around a Federal Reserve policy meeting. In Wave 1 (pre-meeting), participants are randomly assigned either to a control group or to a treatment group that receives a short vignette describing one of several possible policy outcomes. Economic expectations are elicited both before and after the scenario. In Wave 2 (post-meeting), participants provide new forecasts, capturing any natural updating from the actual policy decision, and are then randomly assigned to either receive no further information or to be explicitly told the Fed’s actual decision. This design allows comparisons between hypothetical and factual information treatments, as well as natural exposure to policy news.
Experimental Design Details
The study employs a two-wave survey experiment centered on the September FOMC meeting to compare how individuals update expectations in response to hypothetical versus factual monetary policy information.

In Wave 1, conducted before the FOMC meeting, participants are randomly assigned either to a control group or to one of several treatment groups that receive a short vignette describing a possible policy decision. The hypothetical scenarios vary across five possibilities: a 0.50 percentage point rate hike, a 0.25 percentage point hike, no change, a 0.25 percentage point cut, or a 0.50 percentage point cut. All participants provide baseline expectations before any intervention and then post-treatment expectations after the scenario. The elicited measures include point and probabilistic inflation forecasts at both short and long horizons, expectations for household income, unemployment, economic activity, and interest rates, as well as qualitative narratives explaining inflation beliefs.

Wave 2 is conducted shortly after the actual FOMC decision. It includes recontacted participants from Wave 1, both from the control and hypothetical scenario groups, as well as a new control group recruited after the meeting. Before any additional intervention, all Wave 2 participants provide updated forecasts, which allows measurement of natural updating that may have occurred as a result of public exposure to the Fed’s decision. Participants are then randomized into two groups: one that receives no further information, and another that is explicitly informed of the actual FOMC decision. After this information-provision stage, expectations are re-elicited using the same outcome measures as in Wave 1.

The design enables several comparisons. Within Wave 1, pre- versus post-treatment expectations identify the effect of counterfactual policy scenarios. Across waves, changes between Wave 1 baseline forecasts and Wave 2 baseline forecasts capture natural updating from real-world news exposure. Within Wave 2, pre- versus post-treatment responses allow estimation of the causal effect of factual information provision. Finally, by contrasting results across the two waves, the design directly compares the impact of hypothetical versus factual policy information on the formation of expectations.
Randomization Method
Randomization is conducted by computer within the online survey platform. The randomization is individual-level and implemented by the survey software to ensure allocation is unbiased and not observable to participants or researchers.
Randomization Unit
The unit of randomization is the individual survey respondent.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
Not applicable
Sample size: planned number of observations
In Wave 1, approximately 4,800 respondents in total. In Wave 2, approximately 2,100 respondents in total.
Sample size (or number of clusters) by treatment arms
Wave 1: ≈ 800 respondents per group.
Wave 2: ≈ 700 respondents per group.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Reading Research Ethics Committee
IRB Approval Date
2025-08-20
IRB Approval Number
N/A

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials