Behavioral Interventions to Advance Self Sufficiency – Next Generation (BIAS-NG), Wayne County Head Start Attendance

Last registered on April 02, 2024

Pre-Trial

Trial Information

General Information

Title
Behavioral Interventions to Advance Self Sufficiency – Next Generation (BIAS-NG), Wayne County Head Start Attendance
RCT ID
AEARCTR-0013272
Initial registration date
March 29, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
April 02, 2024, 11:21 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
MDRC

Other Primary Investigator(s)

PI Affiliation
Harvard University

Additional Trial Information

Status
On going
Start date
2024-01-22
End date
2027-09-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The Behavioral Interventions to Advance Self-Sufficiency-Next Generation (BIAS-NG) project is supported by the Office of Planning, Research, and Evaluation in the Administration for Children and Families, U.S. Department of Health and Human Services. BIAS-NG aims to make human services programs work better for the people receiving services by reshaping program processes using lessons from behavioral science, an interdisciplinary field that incorporates psychology, economics, and other social sciences to provide insight into how people process information, make decisions, and take action. BIAS-NG partners with state and local agencies to identify a challenge to address, investigate its possible causes, design an intervention informed by behavioral science to address the causes, and test the efficacy and cost efficiency of the intervention relative to status-quo service delivery. For this study, BIAS-NG worked with two Early Head Start/ Head Start programs in Wayne County, Michigan, to use behavioral insights to design and test a proactive messaging strategy intended to improve daily child attendance.

Based on conversations with program staff and participating families and analyses of program administrative data, the BIAS-NG research team focused efforts on understanding challenges to consistent daily child attendance. The BIAS-NG team found that the vast majority of children in both programs were chronically absent—defined as missing 10% or more of school days—across three academic years. In the 2022-23 school year, average daily attendance was 76% in one program and was 65% in the other. Low attendances rates mean that Head Start participants may miss out on important opportunities and resources that can impact child and family outcomes. Beyond absences likely resulting in missed learning opportunities for children, absences also create administrative burden and instructional challenges for program staff.

The research team conducted interviews with program staff and participating families to identify potentially malleable behavioral barriers to consistent attendance, rather than focusing on tough to move structural barriers (e.g., transportation) or unavoidable causes of absences (e.g., illness). Identified behavioral barriers included families not receiving the right proactive information for attendance at the right time given programs’ focus on reactive attendance communications (once a child misses a substantial proportion of school) as opposed to proactive ones. Diagnosis activities also suggested that many families felt a limited sense of connection to program staff and other families in the program. Stronger bonds with staff and between families might encourage families to come to school to see people they have connections with and may also increase access to school (e.g., transportation vouchers) and non-school (e.g., a carpool) resources to support attendance.

In response to these behavioral barriers, the research team developed an intervention involving sending families positive, proactive messages via text and email aimed at improving child attendance. The messages are described further in the Intervention section. The positive, proactive attendance messaging intervention is intended to promote more consistent daily attendance by (a) underscoring the importance of attendance for child development, (b) helping families feel more connected to the program, and (c) highlighting supports available to help families get to the program. The messages are hypothesized to positively impact child attendance, as measured by number of days attended, average daily attendance, and chronic absenteeism rates.

To evaluate the impact of the messages, families in the two Head Start programs were randomized to either an intervention group receiving approximately three messages per week over 15 weeks or to a control group receiving no additional supports. Analyses after the intervention will consider whether randomization to the intervention group improved children’s attendance outcomes during the intervention and in the month following the conclusion of the intervention. Exploratory analyses will consider whether impacts vary by individual, classroom, or center characteristics. In addition to the impact study, BIAS-NG is conducting accompanying implementation and cost analyses to document how the intervention was delivered and at what cost. 
External Link(s)

Registration Citation

Citation
Anzelone, Caitlin and Lawrence Katz. 2024. "Behavioral Interventions to Advance Self Sufficiency – Next Generation (BIAS-NG), Wayne County Head Start Attendance ." AEA RCT Registry. April 02. https://doi.org/10.1257/rct.13272-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
BIAS-NG’s positive, proactive attendance messaging intervention is intended to promote more consistent daily attendance in two center-based Early Head Start and Head Start (EHS/HS) programs by underscoring the importance of attendance for child development, helping families feel more connected to the program, and highlighting supports available to help families get to the program. The two EHS/HS programs offer full-day programming to children ages birth to five focused on promoting healthy development in a range of areas (e.g., cognitive, social-emotional, health). The intervention includes approximately three messages per week over 15 weeks that are sent via text and email to children’s primary caregivers. The messages employ behavioral strategies such as planning prompts that can support families in building routines that help them juggle multiple steps and competing priorities, messaging that encourage family-to-family connections designed to build social capital, and personalization from a designated staff member to build trust and connections with program staff. This approach builds on several studies showing the positive impacts of sending families regular text messages about the importance of attendance and about their specific child’s attendance behaviors.
Intervention Start Date
2024-01-22
Intervention End Date
2024-05-02

Primary Outcomes

Primary Outcomes (end points)
Three child attendance outcomes:
• Number of days of school child attended during intervention period
• Average daily attendance rate during the intervention period
• A binary indicator of whether the child was chronically absent during the intervention period (missing greater than 10% of school days)
Primary Outcomes (explanation)
We will generate the above attendance outcomes using administrative data collected by the Head Start programs reflecting whether a child was present or absent each day. Number of days of school attended reflects the sum of days a child is listed as present. Average daily attendance rate reflects the sum of days a child is listed as present divided by the sum of days present and absent. Finally, the chronic absenteeism indicator will be constructed from average daily attendance rate, such that the variable takes on a value of one when the attendance rate is less than 90%. Students who are enrolled for fewer than 10 days will not receive a value for this measure.

Secondary Outcomes

Secondary Outcomes (end points)
Average daily attendance rates will be computed for each month of the intervention (i.e., February, March, and April), as well as the month after the intervention (i.e., May)
Secondary Outcomes (explanation)
In line with prior evaluations of attendance interventions (i.e., Kalil et al., 2021; Sommer et al., 2017), we will examine effects of random assignment to the intervention on the four monthly average attendance rates. Disaggregating attendance rates by month will allow us to understand whether impacts of the intervention were immediately observed (in February) or whether they emerged only after families had received several weeks of messages (in March or April). Examining impacts on attendance after the conclusion of the intervention in May will illuminate whether the effects of the intervention endure after messages conclude. A finding of continued impact could suggest that the intervention resulted in sustained behavioral changes.

Experimental Design

Experimental Design
The impact evaluation uses a randomized controlled trial design. Participating families have an equal (50/50) chance of being assigned to the intervention or control groups.

All families enrolled in center-based early education programs at either agency who (1) have a mobile phone number on record and (2) have opted in at the start of the school year to receive messaging from the program were randomized to either the intervention group or control groups. Randomization was at the family level rather than child level given that some families have multiple children enrolled in the programs, meaning that child level randomization could result in some caregivers being assigned to both the intervention and control groups.
Randomization was stratified by center to ensure an equal balance of intervention and control group members within each center. This method also ensured that each program has balanced randomization groups. The random assignment process followed these steps:
• Step 1: Obtain Administrative Data and Determine Eligible Sample Programs created a dataset of all families presently enrolled. This file included ChildPlus ID, ChildPlus Family ID, program name, center of enrollment, number of enrolled children in family, date of birth, phone number, and whether they’ve opted in/out to receive ChildPlus messages.
• Step 2: Randomize Families After receiving the data of enrolled participants, the research team randomized families using the MDRC random assignment web tool. New files, containing the original participant data (i.e., the administrative data generated and shared in step 1) and the newly generated random assignment group indicator, were shared back with programs.
• Step 3: Program Intervention Group into ChildPlus Research team staff worked with program staff to create a field in ChildPlus indicating if a family is in the intervention group.
• Step 4: Send Messages Using Random Assignment Families assigned to the intervention group receive the intervention messaging campaigns while those assigned to the control group receive status quo messaging.
Experimental Design Details
Not available
Randomization Method
MDRC random assignment web tool
Randomization Unit
Families were the unit of randomization.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
1,260 families
Sample size: planned number of observations
1,464 children
Sample size (or number of clusters) by treatment arms
Intervention group: 633, Control group: 627
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
The below estimates use a two-tailed test with a significance level of 10% and assume 80% power with a sample of 1,260 families and equal distribution of families between the intervention and control groups. The smallest true effect size we could detect from the intervention is: An effect of 0.14 SD on the number of days of school child attended during intervention period An effect of 0.14 SD on the average daily attendance rate during the intervention period An effect of 0.14 SD on chronic absenteeism rates
IRB

Institutional Review Boards (IRBs)

IRB Name
MDRC IRB
IRB Approval Date
2024-01-03
IRB Approval Number
MDRC IRB 858493-31
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information