Effects of Teacher vs. Non-Teacher Early Learning Interventionists on Students’ Reading Proficiency

Last registered on June 28, 2023

Pre-Trial

Trial Information

General Information

Title
Effects of Teacher vs. Non-Teacher Early Learning Interventionists on Students’ Reading Proficiency
RCT ID
AEARCTR-0011645
Initial registration date
June 24, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 28, 2023, 4:36 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Primary Investigator

Affiliation
Texas A&M University

Other Primary Investigator(s)

PI Affiliation
Stanford University

Additional Trial Information

Status
On going
Start date
2022-08-16
End date
2023-06-30
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The study design is a randomized control trial that compares the reading proficiency outcomes of students who receive Chapter One’s 1:1 tutoring support from a certified teacher Early Learning Interventionists (“ELIs”) to students who receive tutoring support from a non-teacher ELIs. Chapter One’s certified teacher ELIs undergo rigorous training program on phonics and literacy instruction. The tutoring began in August 2022 in 7 schools and 54 kindergarten, first, and second grade classrooms that constitute the study sites. As part of the tutoring program, Chapter One’s Reading Foundation Stage (RFS) and Oral Reading Fluency (ORF) assessments are administered by ELIs at the beginning, middle, and end of school year to all 1,129 tutored students in the participating classrooms. Approximately half of the students in each classroom are randomly assigned to receive tutoring from a certified teacher ELIs (treatment group, N=583) and approximately half of the students were assigned to receive tutoring from a non-teacher ELIs (control group, N=546).

External Link(s)

Registration Citation

Citation
Cortes, Kalena and Susanna Loeb. 2023. "Effects of Teacher vs. Non-Teacher Early Learning Interventionists on Students’ Reading Proficiency." AEA RCT Registry. June 28. https://doi.org/10.1257/rct.11645-1.0
Experimental Details

Interventions

Intervention(s)
The Intervention: The study design is a randomized control trial (RCT) that compares the reading proficiency outcomes of students who receive Chapter One’s 1:1 tutoring support from a certified teacher Early Learning Interventionists (“ELIs”) to students who receive tutoring support from a non-teacher ELIs. Chapter One’s certified teacher ELIs undergo rigorous training program on phonics and literacy instruction.

The tutoring began in August 2022 in 7 schools and 54 kindergarten, first, and second grade classrooms that constitute the study sites. As part of the tutoring program, Chapter One’s Reading Foundation Stage (RFS) and Oral Reading Fluency (ORF) assessments are administered by ELIs at the beginning, middle, and end of school year to all 1,129 tutored students in the participating classrooms. Approximately half of the students in each classroom are randomly assigned to receive tutoring from a certified teacher ELIs (treatment group, N=583) and approximately half of the students were assigned to receive tutoring from a non-teacher ELIs (control group, N=546).

The RCT is undertaken to determine the effects, if any, of tutoring by certified teacher ELIs compared to non-teacher ELIs on students’ reading proficiency. Two hypotheses will be tested,

(1) Null hypothesis: Students reading proficiency on assessments is equal between the two groups, one tutored by certified teacher ELIs and one tutored by non-teacher ELIs.

(2) Alternative Hypothesis: Students that receive tutoring by certified teacher ELIs will make greater gains on reading proficiency assessments than students tutored by non-teacher ELIs.

Random assignment to treatment and control groups will create baseline equivalence of the two groups or no systematic differences at baseline, thereby reducing bias. To strengthen internal validity, members of the two groups will be similar in age, grade level, enrollment in classrooms, and performance level in literacy.

Research Question: The general purpose of the research is to determine the effects, if any, of tutoring by certified teacher ELIs vs. non-teacher ELIs on students’ reading proficiency. Thus, this RCT study aims to address the following research question: What is the effect, if any, of tutoring by certified teacher ELIs compared to non-teacher ELIs on students reading proficiency?

Randomization: To assign students to one of the experimental conditions, we will employ a student-level randomized control trial design. Specifically, within each classroom (N=54), we randomly assigned half of the students to the treatment group (received tutoring support from a certified teacher ELIs) and half of the students to the control group (received tutoring support from a non-teacher ELIs). The total randomization sample consist of 1129 students enrolled in kindergarten, first, and second grade classrooms: 583 students in the treated group and 546 students in the control group.
Intervention (Hidden)
Intervention Start Date
2022-08-16
Intervention End Date
2023-06-30

Primary Outcomes

Primary Outcomes (end points)
Grades (kindergarten, 1, 2): end-of-year reading/literacy outcomes
Primary Outcomes (explanation)
Reading/literacy outcomes: test scores, reading foundation stage assessment, oral fluency assessment

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
To assign students to one of the experimental conditions, we will employ a student-level randomized control trial design. Specifically, within each classroom (N=54), we randomly assigned half of the students to the treatment group (received tutoring support from a certified teacher ELIs) and half of the students to the control group (received tutoring support from a non-teacher ELIs). The total randomization sample consist of 1129 students enrolled in kindergarten, first, and second grade classrooms: 583 students in the treated group and 546 students in the control group.
Experimental Design Details
Randomization Method
Computer randomization
Randomization Unit
Student-level randomization within each classroom
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1129 students
Sample size: planned number of observations
1129 students
Sample size (or number of clusters) by treatment arms
583 students in the treated group;
546 students in the control group.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
MDES: 0.137 (standard deviation)
IRB

Institutional Review Boards (IRBs)

IRB Name
Stanford University
IRB Approval Date
2023-05-16
IRB Approval Number
68027
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials