Evaluation of Roads to Success

Last registered on January 23, 2014
View Trial History

Pre-Trial

Trial Information

General Information

Title
Evaluation of Roads to Success
RCT ID
AEARCTR-0000191
First published
January 23, 2014, 7:52 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Country
United States of America
Region

Primary Investigator

Name
Duncan Chaplin
Affiliation
Mathematica Policy Research
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Martha Bleeker
PI Affiliation
Mathematica Policy Research
Contact Investigator

Additional Trial Information

Status
Completed
Start date
2006-05-23
End date
2010-03-31
Keywords
Education
Additional Keywords
JEL code(s)
Secondary IDs
Abstract
Roads to Success (RTS) is a school and career planning program designed to be implemented for 45 minutes per week in grades 7 through 12. Researchers at Mathematica Policy Research used a random assignment design to estimate the impacts of receiving RTS in grades 7 and 8. Mathematica collected baseline test score data from the end of grade 6 (spring 2007), conducted a student baseline survey at the beginning of grade 7 (fall 2007), and conducted a student follow-up survey at the end of grade 8 (spring 2009). The study explores the short-term impacts of the RTS program on learning and study habits, negative behaviors, early career exploration plans, and career self-efficacy.
External Link(s)
FINAL REPORT: Roads to Success: Estimated Impacts of an Education and Career Planning Program

Registration Citation

Citation
Bleeker, Martha and Duncan Chaplin. 2014. "Evaluation of Roads to Success." AEA RCT Registry. January 23. https://doi.org/10.1257/rct.191-1.0
Former Citation
Bleeker, Martha and Duncan Chaplin. 2014. "Evaluation of Roads to Success." AEA RCT Registry. January 23. https://www.socialscienceregistry.org/trials/191/history/936
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Roads to Success (RTS) is a school and career planning program designed to be implemented for 45 minutes per week in grades 7 through 12.
Our design report can be found here.
http://www.mathematica-mpr.com/publications/PDFs/education/rigorouseval09.pdf
Our impact report can be found here.
http://www.mathematica-mpr.com/publications/PDFs/education/roadstosuccess.pdf
Intervention Start Date
2007-08-15
Intervention End Date
2009-06-05

Primary Outcomes

Primary Outcomes (end points)
learning and study habits, negative behaviors, early career exploration plans, career self-efficacy
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
In fall 2006, Mathematica randomly assigned 25 schools to one of two treatment conditions. Thirteen of the schools were randomly assigned to deliver the RTS intervention to all grade 7 students during the 2007–2008 school year. These schools continued to deliver the RTS intervention to the same set of students in 2008–2009, when the students were in grade 8. The other 12 schools were randomly assigned to the control group and did not offer RTS to grade 7 students during the 2007–2008 school year or to grade 8 students in 2008–2009.
Experimental Design Details
Randomization Method
Randomization done in office by a computer
Randomization Unit
Schools
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
We grouped the 25 schools into blocks of two or three schools each before random assignment.
Sample size: planned number of observations
25 schools (with about 2000 students, total)
Sample size (or number of clusters) by treatment arms
25 schools (13 Treatment and 12 Control); 2000 students (1000 Treatment and 1000 Control)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

Analysis Plan

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
June 05, 2009, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
September 30, 2009, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
25 schools (13 Treatment, 12 Control)
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
2156 students
Final Sample Size (or Number of Clusters) by Treatment Arms
25 schools (13 Treatment, 12 Control)
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials