x

We are happy to announce that all trial registrations will now be issued DOIs (digital object identifiers). For more information, see here.
Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts
Last registered on February 24, 2015

Pre-Trial

Trial Information
General Information
Title
Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts
RCT ID
AEARCTR-0000639
Initial registration date
February 24, 2015
Last updated
February 24, 2015 1:56 PM EST
Location(s)
Region
Primary Investigator
Affiliation
Mathematica Policy Research
Other Primary Investigator(s)
PI Affiliation
Mathematica Policy Research
Additional Trial Information
Status
Completed
Start date
2005-03-01
End date
2012-01-31
Secondary IDs
Abstract
The National Study of CMO Effectiveness is a longitudinal research effort designed to measure how nonprofit charter school management organizations (CMOs) affect student achievement and to examine the internal structures, practices, and policy contexts that may influence these outcomes. The study examines CMO impacts on student achievement in middle school, high school graduation, and postsecondary enrolment using quasi-experimental methods for a large sample of schools. In a smaller sample of oversubscribed schools, we obtain experimental CMO impacts in elementary, middle and high schools using lottery data.
External Link(s)
Registration Citation
Citation
Gill, Brian and Joshua Haimson. 2015. "Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts." AEA RCT Registry. February 24. https://doi.org/10.1257/rct.639-1.0.
Former Citation
Gill, Brian, Brian Gill and Joshua Haimson. 2015. "Charter-School Management Organizations: Diverse Strategies and Diverse Student Impacts." AEA RCT Registry. February 24. https://www.socialscienceregistry.org/trials/639/history/3653.
Experimental Details
Interventions
Intervention(s)
The intervention is the offer to attend an oversubscribed charter-school management organization (CMO) school. CMOs establish and operate multiple charter schools, representing one prominent attempt to bring high performance to scale. Many CMOs were created in order to replicate educational approaches that appeared to be effective, particularly among disadvantaged students.
Intervention Start Date
2005-03-01
Intervention End Date
2009-06-01
Primary Outcomes
Primary Outcomes (end points)
For middle and high schools, the outcomes are math and reading test scores one year after baseline. For elementary schools, the outcomes are math and reading test scores four years after baseline.
Primary Outcomes (explanation)
Secondary Outcomes
Secondary Outcomes (end points)
Secondary Outcomes (explanation)
Experimental Design
Experimental Design
CMO schools with more applicants than available seats often admit students using a random lottery. Records from these lotteries can be used to conduct a randomized experiment as students who participated are offered CMO admission completely by chance. Experimental treatment and control status was determined by whether the student received an admission offer at the time of the lottery.

Experimental sites had to meet each of the following criteria to be included in the analysis:
1. Low student attrition. Specifically, the overall and differential attrition rates must be lower than the What Works Clearinghouse maximum thresholds (liberal attrition standard);
2. Valid randomization. If we did not observe the lottery and consequently were unsure of the randomization validity, any difference between treatment and control average baseline test scores must be less than 0.25 standard deviations and demographicdifferences must be less than 25 percentage points
3. Higher treatment group CMO enrollment. The difference in CMO school enrollment between treatment and control groups must be at least 20 percent.
Experimental Design Details
Randomization Method
Randomization conducted by individual schools.
Randomization Unit
The unit of randomization is the student.
Was the treatment clustered?
Yes
Experiment Characteristics
Sample size: planned number of clusters
16 schools across 7 sites, where sites are groups of schools that shared applicants. Grouping schools into sites was necessary as treatment was defined as receiving an offer to any CMO school.
Sample size: planned number of observations
Elementary schools: 64 treatment students, 54 control students; Middle schools: 331 treatment students, 551 control students; High schools: 214 treatment students, 214 control students
Sample size (or number of clusters) by treatment arms
16 schools across 7 sites (both treatment and control)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB
INSTITUTIONAL REVIEW BOARDS (IRBs)
IRB Name
P/PV Institutional Review Board
IRB Approval Date
2008-08-26
IRB Approval Number
08-NIRB-054
Post-Trial
Post Trial Information
Study Withdrawal
Intervention
Is the intervention completed?
No
Is data collection complete?
Yes
Data Collection Completion Date
Final Sample Size: Number of Clusters (Unit of Randomization)
Was attrition correlated with treatment status?
Final Sample Size: Total Number of Observations
Final Sample Size (or Number of Clusters) by Treatment Arms
Data Publication
Data Publication
Is public data available?
No
Program Files
Program Files