Stay the Course: Evaluating an Intervention to Promote Community College Persistence and Graduation Rates

Last registered on October 19, 2023

Pre-Trial

Trial Information

General Information

Title
Stay the Course: Evaluating an Intervention to Promote Community College Persistence and Graduation Rates
RCT ID
AEARCTR-0000223
Initial registration date
February 27, 2014

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
February 27, 2014, 10:14 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
October 19, 2023, 11:51 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Primary Investigator

Affiliation
University of Notre Dame

Other Primary Investigator(s)

PI Affiliation
University of Notre Dame
PI Affiliation
University of Maryland

Additional Trial Information

Status
Completed
Start date
2013-08-19
End date
2018-08-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study evaluates a community college intervention program, Stay the Course, that is designed to address the “life barriers” – as distinct from specific academic barriers – that challenge many economically-disadvantaged students. The goal of the study is to determine whether an intervention of this type is effective at increasing community college persistence and graduation rates. The key components of intervention are coaching/mentoring services and emergency financial assistance. The program is being run by a community service provider in agreement with a large community college in Fort Worth, TX. We will use administrative records to track student academic outcomes for at least three years post random assignment. The main outcomes of interest are total credit hours completed, re-enrollment rates, and degrees or certificates obtained. Demographic data obtained from student records will be used to investigate how treatment effects vary across student subgroups.
External Link(s)

Registration Citation

Citation
Evans, William, Melissa Kearney and James Sullivan. 2023. "Stay the Course: Evaluating an Intervention to Promote Community College Persistence and Graduation Rates." AEA RCT Registry. October 19. https://doi.org/10.1257/rct.223-2.1
Former Citation
Evans, William, Melissa Kearney and James Sullivan. 2023. "Stay the Course: Evaluating an Intervention to Promote Community College Persistence and Graduation Rates." AEA RCT Registry. October 19. https://www.socialscienceregistry.org/trials/223/history/197379
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Study subjects are randomly selected to receive services through a program called Stay the Course. This program is designed to help income students succeed in a community college setting. Stay the Course has two key components: full-service, wrap-around case management and access to emergency financial assistance. In the case management component, a trained social service provider from outside the college works individually with a student to address their personal challenges and create a holistic, long-term plan for educational success. This service helps students to navigate the community college system and absorb shocks in their personal life that threaten their ability to complete a degree. Emergency Financial Assistance provides students with resources to cover emergency non-academic expenses or income shortfalls that could negatively impact their persistence in college.
Intervention (Hidden)
Comprehensive Coaching and Mentoring

The coaching and mentoring component of Stay the Course addresses the social and institutional barriers, as well as unexpected life obstacles, that students encounter in a community college setting. As a student enter the program, he or she has an introductory meeting with a member of the Stay the Course team. This person is called a service "Navigator". During this meeting, the Navigator conducts a client assessment and discusses with the client his or her areas of needs, as well as the student’s strengths and weaknesses. The student and Navigator then cooperatively develop a comprehensive service plan that specifies how the student and Navigator will work together to address identified barriers so the student is able to accomplish his or her educational goal. Navigators also work to develop a personal relationship with each of their students. Navigators counsel clients on everyday life obstacles, such as problems with child-care arrangements, transportation, or work schedules, and help students make the necessary arrangements such that their life is set up to accommodate class attendance and studying.
Navigators assist students navigate the community college system by ensuring students register for the necessary and appropriate classes. Depending on student need, Navigators may also assist students connect to other campus resources, such as the tutoring or career centers. The coaching and mentoring services provided by the Stay the Course Team are more comprehensive than those typically available at community colleges. In particular, they focus on helping students with out of school issues which they encounter. Each Navigator works with approximately 35 students, so each student receives a significant amount of personal time and attention from program staff.

Emergency Financial Assistance

The second component to Stay the Course, Emergency Financial Assistance (EFA), provides short-term resources to students for non-academic expenses or income shortfalls that could negatively impact a student’s persistence in college. EFA is not meant to constitute an academic grant or scholarship. Rather, it provides the buffer resources that a low-income student needs (and lacks) in order to stay in school. Receipt of EFA requires a student to successfully demonstrate that a) they have an imminent financial need, and b) that not meeting this need will be detrimental to the student’s academic progress. Additional factors that determine whether the event qualifies for assistance include the extent to which the event is foreseeable, controllable, and temporary. Examples of qualified costs include a car repair, a bus pass, or emergency medical care. Eligibility for EFA will be restricted to those who have a cumulative GPA of a 2.0 at Tarrant County College or higher (unless they are in their first semester at TCC) and are enrolled in at least 6 credits the semester in which they apply. An individual student can apply to receive up to $500 per semester, capped at a total of $1,500 over a three year period.
Intervention Start Date
2013-08-26
Intervention End Date
2016-05-31

Primary Outcomes

Primary Outcomes (end points)
credit hours completed, GPA, degree completion, transfers to four year college, time to completion
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We identified our study sample as a group of students enrolled at a particular community college campus. The college determined which students met the eligibility criteria as determined by the research team, which totaled 1,169 students. Eligible students were randomly assigned to one of three study groups; students in treatment arm 1 receive case management and access to emergency financial assistance, students in treatment arm 2 are eligible strictly for the emergency financial assistance, and students in the control group receive no services from Stay the Course. The central hypothesis we will test is whether the services provided through this intervention, which directly addresses personal, non-academic and social-institutional barriers, will increase community college persistence and completion rates. Outcomes will be tracked through administrative records for up to six years from time of random assignment.
Experimental Design Details
Randomization Method
Randomization conducted by researcher using a computer program.
Randomization Unit
Individual Student
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1 school
Sample size: planned number of observations
1169 Students
Sample size (or number of clusters) by treatment arms
430 students assigned to treatment arm 1
300 students assigned to treatment arm 2
439 students assigned to control
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Setting the p-value at 0.05 and the power of the test at 80 percent, we should be able to detect an 8.9 percentage point rise in the one-semester persistence rate and a 10.8 percentage point increase in the one-year persistence rate.
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Notre Dame IRB
IRB Approval Date
2013-08-12
IRB Approval Number
13-06-1103

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Abstract
Community college completion rates are low, especially among low-income students.
The existing policy and research attention has primarily focused on academic and financial
challenges, but there is ample reason to think that non-academic obstacles
might be key drivers of dropout rates for low-income students. This study focuses on
the role of “life barriers” and investigates the effectiveness of intensive case-management
services for low-income community college students.We evaluate the impact of the Stay
the Course (STC) intensive case-management program through a multi-armed randomized
controlled trial evaluation conducted between 2013 and 2016 in Fort Worth,
Texas. Analysis of administrative records indicates that STC significantly increased
persistence and degree completion for women; estimates for the full sample are imprecise.
The statistically significant estimates for women imply that STC tripled associate’s
degree receipt by 31.5 percentage points. We find no difference in outcomes
between students in an emergency financial assistance (EFA) only treatment arm and
the control group. Given program costs of $4,343 per person, the implied cost per
additional associate’s degree is $27,140. This study complements existing literature on
financial and informational interventions designed to increase completion rates and is
most closely related to the smaller literature examining coaching and mentoring interventions.
Citation
Evans, W. N., Kearney, M. S., Perry, B. C., and Sullivan, J. X. 2019. Increasing community college completion rates among low-income students: Evidence from a randomized controlled trial evaluation of a case management intervention. Journal of Policy Analysis and Management, Vol. 39, No. 4, 930–965 (2020)

Reports & Other Materials