Stigma and Social Safety Net Program Participation

Last registered on January 15, 2024

Pre-Trial

Trial Information

General Information

Title
Stigma and Social Safety Net Program Participation
RCT ID
AEARCTR-0011634
Initial registration date
August 22, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
August 24, 2023, 6:26 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 15, 2024, 4:53 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
Harvard Kennedy School

Other Primary Investigator(s)

PI Affiliation
Harvard Kennedy School
PI Affiliation
Harvard Kennedy School

Additional Trial Information

Status
In development
Start date
2023-09-18
End date
2024-06-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Stigma surrounding safety net programs may inhibit take-up among eligibles (Moffitt 1983; Currie 2006) and impose utility costs on individuals already receiving benefits (Kleven & Kopczuk; Anders & Rafkin 2022). In this project, we conduct a survey experiment to investigate the nature of stigma associated with the Supplemental Nutrition Assistance Program (SNAP or food stamps). We collect respondents’ attitudes about SNAP and perceived judgement of SNAP status among different social groups. We compare individuals’ perceptions about social judgments to the full distribution of respondents’ attitudes to see if perceptions are accurate, particularly for low-income respondents who may be eligible for SNAP. In addition, we test interventions that either reframe SNAP benefits as a tool for economic mobility or inform respondents that one household’s participation decision will not affect whether others can receive benefits. We will measure the effect of the interventions on indices of survey responses describing the degree of stigma perceived by potential recipients and stigmatizing attitudes held by the general population. We will also measure the effect of the intervention on a relevant action: filling out a SNAP eligibility screener. Our study will contribute to the literature on stigma and take-up of safety net programs, focusing on the application decision margin for a highly stigmatized program.
External Link(s)

Registration Citation

Citation
Heath, Alice, Michael Holcomb and Kelsey Pukelis. 2024. "Stigma and Social Safety Net Program Participation." AEA RCT Registry. January 15. https://doi.org/10.1257/rct.11634-3.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
There are three intervention groups and one control group. The control group will receive no intervention during the survey.
Intervention Start Date
2023-09-18
Intervention End Date
2024-01-18

Primary Outcomes

Primary Outcomes (end points)
Stigmatizing attitudes index, overall perceived stigma index, demonstrated interest in enrolling in SNAP, and second-order beliefs questions.
Primary Outcomes (explanation)
Stigmatizing attitudes index: The mean of answers to the following questions: Out of 100 individuals receiving SNAP, how many… (a) do you think should avoid telling other people that they receive SNAP; (b) would you judge negatively if you noticed them using SNAP in the grocery store; (c) would you look down on because they receive SNAP; (d) do you think are less motivated to work because they receive SNAP; and (e) do you think would be taking the place of someone who needs SNAP more than they do.

Overall perceived stigma index: The mean of answers to the questions in the self stigma and perceived external stigma indices. (See below.)

Demonstrated interest in enrolling in SNAP is measured by a dummy variable which equals 1 if the survey respondent clicked a link to take a quiz to check their household’s SNAP eligibility status, and 0 otherwise. This is meant to capture a real-world outcome: a first step towards applying for SNAP.

Second-order beliefs questions: Respondents are asked to estimate the average response of other survey respondents to the following two questions: (1) Out of 100 individuals receiving SNAP, how many do you think are less motivated to work because they receive SNAP? and (2) Out of 100 individuals receiving SNAP, how many would you judge negatively if you noticed them using SNAP in the grocery store?

Secondary Outcomes

Secondary Outcomes (end points)
Self stigma index, perceived external stigma index. Perceived overall stigma views and stigmatizing attitude individual questions. Also, measures for the first stage impacts of the interventions. Pending data access, outcomes of the eligibility screener. Support for SNAP spending (wave 2 only).
Secondary Outcomes (explanation)
Self stigma index: The mean of answers to the following questions (with slight variations on question wordings based on whether the respondent received SNAP before): (a) I would rather support myself than use SNAP. (b) Applying for SNAP made me think less of myself. (c) When I participate in SNAP, I avoid telling other people about it.

Perceived external stigma index: The mean of answers to the following questions (with slight variations on question wordings based on past receipt of SNAP): (a) Most people look down on me because I applied for SNAP. (b) If someone found out I applied for SNAP, they would think I lack work ethic. (c) Because I enrolled in SNAP, other people think I am taking the place of someone who needs benefits more than me.

Individual questions in the perceived overall stigma and stigmatizing attitudes indices listed above. We will use methods to correct for multiple hypothesis testing.

First-stage outcomes for misperception intervention: (1) Enrolling in SNAP makes me feel like I am taking the place of someone who needs benefits more than I do. (2) Because I enrolled in SNAP, other people think I am taking the place of someone who needs benefits more than me. (3) Out of 100 individuals receiving SNAP, how many… do you think would be taking the place of someone who needs SNAP more than they do.

First-stage outcomes for vignette interventions: Out of 100 individuals receiving SNAP, how many…(1) do you think are adult men; (2) adult women; and (3) children. Summary measures of text responses to the question: "Please briefly describe what you think of when you think of a typical household participating in SNAP."

First-stage outcomes for work vignette interventions: (1) Participating in SNAP makes me less motivated to work. (2) If someone found out I applied for SNAP, they would think I lack work ethic. (3) Out of 100 individuals receiving SNAP, how many…do you think are less motivated to work because they receive SNAP?

Outcomes of the eligibility screener may include: completed the screener, found eligible or found ineligible, started an application and submitted an application.

Support for SNAP spending: Asks respondent whether she prefers current levels of spending on SNAP, more, or less spending.

Experimental Design

Experimental Design
Our sample includes survey respondents from Prolific. The survey respondents will answer a series of questions at baseline. Demographic questions asked at baseline include household size, state of residence, and prior SNAP participation status. We also collect respondents’ general preferences for redistribution and a survey module designed to capture an individual's propensity to give socially desirable answers. At baseline, we also collect respondents’ perceptions about features of the SNAP program and recipient population. Key factual questions are incentivized to encourage respondents to report their best guess.

The respondents will then be randomly assigned into one of the four main treatment arms, stratified by prior SNAP participation status. There are four blocks or strata: current SNAP recipient, past SNAP recipient, never a SNAP recipient, or missing SNAP status. Conditional on the prior SNAP participation group, respondents are randomly assigned into one of the four treatment arms with equal probability. Respondents in each treatment group are shown only one piece of information described in the interventions section above; those in the control group are shown no information.

Then, survey respondents will answer the remaining survey questions. Questions provided after the intervention include the outcome questions described above and additional demographic questions.

Experimental Design Details
Not available
Randomization Method
Randomization will be done automatically by the Qualtrics online survey platform.
Randomization Unit
Individual survey respondents
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1200 individual survey respondents
Sample size: planned number of observations
1200 individual survey respondents
Sample size (or number of clusters) by treatment arms
300 control, 300 work vignette (150 work male, 150 work female), 300 family vignette (150 family male, 150 family female), 300 misperception correction
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
Harvard University-Area Committee on the Use of Human Subjects
IRB Approval Date
2023-09-15
IRB Approval Number
IRB23-0600
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information