Evaluation of the Teach For America Investing in Innovation Scale-Up

Last registered on January 19, 2024

Pre-Trial

Trial Information

General Information

Title
Evaluation of the Teach For America Investing in Innovation Scale-Up
RCT ID
AEARCTR-0000184
Initial registration date
December 28, 2013

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 28, 2013, 4:20 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 19, 2024, 4:31 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
Mathematica Policy Research

Other Primary Investigator(s)

PI Affiliation
Mathematica Policy Research

Additional Trial Information

Status
Completed
Start date
2012-08-01
End date
2014-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This evaluation will examine TFA’s efforts to scale up their program under an Investing in Innovation (i3) grant from the U.S. Department of Education (ED). Under the scale-up initiative, TFA plans to increase the size of its teacher corps by more than 80 percent by September 2014, placing 28,000 TFA teachers in high-need classrooms. The evaluation will include an implementation analysis of the scale-up efforts as well as an analysis of the impact of the scaled-up program on student achievement at the elementary school level. The impact analysis will be based on an experimental design, under which students in a given school and grade will be randomly assigned to a class taught by a TFA teacher or a class taught by a non-TFA teacher. Information on program implementation will be collected from interviews with TFA staff and TFA-collected data on both successful and unsuccessful applicants to its program. Data on student achievement for the impact analysis will be obtained from a study-administered assessment for students in grades kindergarten through 2 and from state or district records for students in grades 3 through 5. We will also survey teachers in the impact analysis sample on their backgrounds, attitudes, and classroom practices.
External Link(s)

Registration Citation

Citation
Clark, Melissa and Eric Isenberg. 2024. "Evaluation of the Teach For America Investing in Innovation Scale-Up." AEA RCT Registry. January 19. https://doi.org/10.1257/rct.184-2.0
Former Citation
Clark, Melissa and Eric Isenberg. 2024. "Evaluation of the Teach For America Investing in Innovation Scale-Up." AEA RCT Registry. January 19. https://www.socialscienceregistry.org/trials/184/history/209100
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Teach For America (TFA) is a program that strives to reduce educational inequities through the provision of high–quality teachers to low–income schools. The program recruits and trains college graduates with strong academic backgrounds and leadership capabilities to commit to teach for two years in public schools in low–income communities. These teachers, called corps members, typically have no formal training in education but receive an intensive five–week training from TFA before beginning their first teaching job. They also receive ongoing support from TFA throughout their two–year commitment.

In 2010, TFA launched a major expansion effort, funded in part by a five–year Investing in Innovation (i3) Scale–Up grant of $50 million from the U.S. Department of Education’s (ED’s) Office of Innovation and Improvement (OII). This was one of four i3 scale–up grants, which were awarded to fund expansion of programs with rigorous evidence of prior effectiveness in improving student achievement. Through the i3 scale–up project, TFA plans to increase the size of its teacher corps by more than 80 percent by September 2014, with the goal of placing 13,500 first– and second–year corps members in classrooms by the 2014–2015 school year, expanding from 39 to 52 to 54 regions across the country, and accounting for more than 20 percent of new hires in high–poverty schools in these regions.

TFA has contracted with Mathematica Policy Research to conduct a rigorous evaluation of the i3 scale–up project’s effectiveness. This evaluation will include an analysis of the scale–up’s implementation as well as an analysis of the impact of elementary school TFA teachers recruited in the first and second years of the scale–up.
Intervention Start Date
2012-08-01
Intervention End Date
2013-05-31

Primary Outcomes

Primary Outcomes (end points)
Student reading and math test scores
Primary Outcomes (explanation)
Students in grades pre-kindergarten-2: Study-administered Woodcock-Johnson III Normative Update (NU) Tests of Achievement: Letter-Word Identification (grades prekindergarten–2), Passage Comprehension (grades kindergarten–2) subtests, Applied Problems (grades prekindergarten–2) and Calculation (grades 1–2) subtests.

Students in grades 3-5: Spring 2013 state reading and math assessment scores from district records

All scores converted to z-scores using control group means and standard deviations.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Random assignment of students to class taught by TFA teacher or class taught by teacher from some other teacher preparation program in the same grade and school.
Experimental Design Details
Randomization Method
Randomization conducted by researchers using computer program.
Randomization Unit
Students
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
4,466 students
Sample size: planned number of observations
4,466 students
Sample size (or number of clusters) by treatment arms
2,233 students assigned to TFA teachers, 2,233 assigned to teachers from other programs.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
0.10 standard deviations of test scores
IRB

Institutional Review Boards (IRBs)

IRB Name
New England IRB
IRB Approval Date
2012-07-13
IRB Approval Number
12-192

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
June 15, 2013, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
June 15, 2013, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
156 classrooms
Was attrition correlated with treatment status?
Final Sample Size: Total Number of Observations
1,182 students with math test scores
2,123 students with reading test scores
Final Sample Size (or Number of Clusters) by Treatment Arms
66 TFA classrooms, 90 comparison classrooms
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Abstract
In 2010, Teach For America (TFA) launched a major expansion effort, funded in part by a five-year Investing in Innovation scale-up grant from the U.S. Department of Education. To examine the effectiveness of TFA elementary school teachers in the second year of the scale-up, we recruited thirty-six schools from ten states and randomly assigned students in participating schools to a class taught by a TFA teacher or a class taught by a comparison teacher. We then gathered data on student achievement and surveyed teachers on their educational background, preparation for teaching, and teaching experience. The TFA teachers in the study schools had substantially less teaching experience than comparison teachers but were more likely to have graduated from a selective college. Overall, TFA and comparison teachers in the study were similarly effective in teaching both reading and math. TFA teachers in early elementary classrooms (grades 2 and below), however, were more effective than comparison teachers: TFA teachers in prekindergarten through grade 2 had a positive, statistically significant effect of 0.12 standard deviations on students’ reading achievement, and TFA teachers in grades 1 and 2 had a positive, marginally significant effect of 0.16 standard deviations on student math achievement.
Citation
Melissa A. Clark & Eric Isenberg, 2020. "Do Teach For America Corps Members Still Improve Student Achievement? Evidence from a Randomized Controlled Trial of Teach For America's Scale-Up Effort," Education Finance and Policy, MIT Press, vol. 15(4), pages 736-760, Fall.

Reports & Other Materials