Experimental Design Details
The experiment is implemented in oTree and deployed via Railway. Participants are recruited through Prolific using prescreening filters for U.S. residency and current or past receipt of at least one safety-net program.
After completing an intake survey, participants are matched to a vignette from a pre-constructed bank of 56 scenarios varying by household type (single parent with one child, married couple with no children, married couple with one child, married couple with two children), state, income level, job sector, and benefit bundle (SNAP, Medicaid, CCDF, TANF, Section 8, EITC). Vignettes are stratified by type: 60% benefit cliff (Δ* < 0), 25% positive net resource change (Δ* > 0), and 15% near-zero change (|Δ*| ≈ 0). True resource changes (Δ*) are pre-computed using the Atlanta Fed Policy Rules Database (PRD) and stored in the vignette bank prior to data collection.
Randomization to the four arms (A: Dashboard / No recovery, B: Dashboard / Recovery, C: AI / No recovery, D: AI / Recovery) is implemented at the individual level using deterministic block randomization in blocks of 4, guaranteeing exact balance across arms. The AI assistant is powered by the Anthropic Claude API, called from the oTree backend. The dashboard is an embedded interactive visualization of PRD rules for the vignette household.
The econometric specification is a between-subject OLS regression of belief improvement on treatment indicators, with vignette fixed effects and controls for intake characteristics (household size, state, benefit receipt, financial stress). Heterogeneity analysis will examine whether treatment effects differ by prior experience with benefit cliffs, financial stress, and whether the vignette involves a cliff (Δ* < 0) vs. a non-cliff (Δ* ≥ 0).
Pre-specified robustness checks include: (1) winsorization of predicted changes at the 1st/99th percentiles, (2) ITT analysis using time-on-page logs to identify non-compliers, (3) bounds analysis for differential attrition by arm, and (4) separate analysis for cliff vs. non-cliff vignettes. Accuracy bonuses of $1.50 per stage are awarded when the participant's predicted monthly resource change falls within $150 of the true value.