Impact Evaluation of Text Message Reminders on SNAP Enrollment

Last registered on November 15, 2024

Pre-Trial

Trial Information

General Information

Title
Impact Evaluation of Text Message Reminders on SNAP Enrollment
RCT ID
AEARCTR-0014677
Initial registration date
October 28, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
November 15, 2024, 12:58 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
Baylor University

Other Primary Investigator(s)

PI Affiliation
University of Notre Dame

Additional Trial Information

Status
In development
Start date
2024-10-29
End date
2026-10-28
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The Wilson Sheehan Lab for Economic Opportunities (LEO) at the University of Notre Dame, in partnership with the North Texas Food Bank (NTFB), is evaluating the effectiveness of automated text message reminders on increasing enrollment rates in the Supplemental Nutrition Assistance Program (SNAP). This study seeks to address the barriers that individuals face during the SNAP application process, particularly the challenge of submitting required documentation to finalize their enrollment.

The study will employ a randomized controlled trial (RCT) design to assess the impact of text message reminders on increasing the rate of successful SNAP enrollment. Participants will be randomly assigned to either a treatment group, which will receive three text message reminders encouraging the completion of their application, or a control group, which will receive standard NTFB services without additional reminders. These text messages are strategically timed and available in multiple languages to accommodate participants’ preferences.

The research will explore the effects of this intervention on SNAP enrollment rates, with additional analyses of subgroups based on demographics such as age, household size, and prior use of NTFB services. With a target enrollment of 16,000 participants, this study aims to generate causal evidence on the efficacy of low-cost, scalable interventions to improve access to critical assistance. The findings will contribute to broader efforts to reduce food insecurity and enhance health outcomes through increased participation in SNAP.
External Link(s)

Registration Citation

Citation
Evans, William and Craig Gundersen. 2024. "Impact Evaluation of Text Message Reminders on SNAP Enrollment." AEA RCT Registry. November 15. https://doi.org/10.1257/rct.14677-1.0
Experimental Details

Interventions

Intervention(s)
The intervention we study is operated by NTFB, which assists individuals in applying for SNAP. The intervention consists of a series of three automated text message reminders, strategically timed to encourage participants to complete their enrollment process by submitting any outstanding documentation through the Texas Health and Human Services portal. The intervention begins once a participant initiates their application through NTFB’s assistance program. Participants in the treatment group will receive text message reminders sent at 48 hours, 72 hours, and five days after their initial application assistance appointment. These messages remind participants to log into the SNAP portal and finalize their application by submitting any required documents.

The reminders are delivered via Textedly and are available in English, Spanish, and Vietnamese to match participants’ language preferences. The messages aim to reduce barriers such as missed deadlines, confusion about required documents, or other administrative challenges that can prevent individuals from completing their applications. Participants in the control group will continue to receive standard assistance from NTFB, without the additional automated reminders. All other individuals not included in the study will follow NTFB’s usual intake process for SNAP assistance.

The goal of this intervention is to increase enrollment rates by providing timely, low-cost reminders that help participants overcome common administrative hurdles in the application process. By encouraging participants to complete their applications, this intervention aims to improve access to SNAP for eligible individuals who may otherwise face delays in enrollment or not enroll at all in SNAP.
Intervention Start Date
2024-10-29
Intervention End Date
2025-10-28

Primary Outcomes

Primary Outcomes (end points)
Enrollment in SNAP.
Primary Outcomes (explanation)
Outcomes of SNAP enrollment will be constructed using administrative data from Texas Health and Human Services at 1, 2, 3, and 6 months following randomization to measure successful enrollment. The primary outcome will be a binary indicator capturing whether the participant completes their SNAP enrollment within each of the specified follow-up periods.

Secondary Outcomes

Secondary Outcomes (end points)
Not applicable.
Secondary Outcomes (explanation)
No secondary outcomes will be analyzed as part of this study; the focus is solely on the primary outcome of SNAP enrollment.

Experimental Design

Experimental Design
Using a randomized controlled trial design, LEO and NTFB aim to answer the following research questions: (1) Do automated text message reminders increase the rate at which individuals enroll in SNAP? (2) Are there differential effects of these reminders based on demographic characteristics of the participants, such as age, household size, receipt of earning income, or previous interactions with NTFB? Study enrollment will begin in October 2024 and continue through October 2025.

Participants will be eligible for the study if they have applied for SNAP through NTFB and provided consent to receive text message reminders. Once eligibility is confirmed, participants will be randomized into either a treatment group, which will receive three automated text message reminders, or a control group, which will not receive any additional reminders beyond the standard support provided by NTFB. Randomization will occur weekly, and participants will be assigned to the treatment or control group with a 50/50 probability. The randomization will be conducted using a digital tool to ensure an equitable and consistent assignment process.

NTFB will collect participant information during the SNAP application process and send the list of randomized participants to the LEO research team. The research team will then track outcomes using administrative data from Texas Health and Human Services to measure the impact of the intervention on SNAP enrollment rates at 1, 2, 3, and 6 months following randomization.

This study aims to rigorously evaluate the effectiveness of the automated reminders in increasing SNAP enrollment rates. The results of this RCT will help NTFB refine their strategies for supporting applicants and potentially expand the use of similar interventions to improve program take-up. Additionally, the findings will contribute to broader efforts to enhance SNAP enrollment across the United States, offering valuable insights for policymakers and service providers.
Experimental Design Details
Not available
Randomization Method
Computer-based randomization.
Randomization Unit
Unit of randomization: household
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
16,000 households
Sample size: planned number of observations
16,000 households
Sample size (or number of clusters) by treatment arms
Control: 8,000 households; Treatment: 8,000 households
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
The study aims to enroll a total of 16,000 households over a one-year period, with 8,000 participants randomly assigned to the treatment group and 8,000 to the control group. Throughout the enrollment period, interim outcomes will be tracked to monitor the progress of the study. The primary outcome is enrollment in SNAP, and the study is powered to detect a minimum detectable effect size (MDE) of 2.09 percentage points. This corresponds to a 3.8% increase in SNAP enrollment rates from the estimated baseline enrollment rate of 55% in the control group. With this sample size and expected treatment effects, the study is well-positioned to identify even modest changes in SNAP enrollment rates attributable to the intervention. The large sample size allows for sufficient statistical power to detect significant differences in outcomes between the treatment and control groups, ensuring that the findings provide robust evidence on the effectiveness of the text message reminders.
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number
Analysis Plan

Analysis Plan Documents

Pre-Analysis Plan: Impact Evaluation of Text Message Reminders on SNAP Enrollment

MD5: 56b6b5d7e2e682389cff56b92b3c3abe

SHA1: c14a5718fed79391a48979e022eea200b0336d2b

Uploaded At: October 28, 2024