Back to History Current Version

Integrating Educational Technology with Structured Pedagogy to Improve Learning Outcomes for Every Student

Last registered on June 10, 2025
View Trial History

Pre-Trial

Trial Information

General Information

Title
Integrating Educational Technology with Structured Pedagogy to Improve Learning Outcomes for Every Student
RCT ID
AEARCTR-0014627
Initial registration date
November 26, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 03, 2024, 1:29 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
June 10, 2025, 2:36 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country
Ghana
Region
Cape Coast

Primary Investigator

Name
Erik Andersen
Affiliation
University of Washington
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Jason Kerwin
PI Affiliation
University of Washington
Contact Investigator
PI Name
Simon Graffy
PI Affiliation
Inspiring Teachers
Contact Investigator
PI Name
Monica Lambon-Quayefio
PI Affiliation
University of Ghana
Contact Investigator

Additional Trial Information

Status
On going
Start date
2024-09-16
End date
2025-07-04
Keywords
Education
Additional Keywords
JEL code(s)
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
We are studying Inspiring Teacher's Tools for Foundational Learning Improvement (TFLI). TFLI uses best practices from early-grade reading instruction in a structured pedagogy format, in which teachers are given teacher guides with semi-scripted, high-quality lesson plans that tell them exactly how to teach their classes. These plans are linked to workbooks, training and support from Inspiring Teachers’ employees, who are expert teachers and teacher trainers. This basic approach has been proven to be highly effective in many other interventions and contexts across Africa. TFLI adds a digital layer to this structured pedagogy approach, with teachers accessing program material and training videos via the Smart Coach smartphone app. The app will also collect high-frequency data on student outcomes, which Inspiring Teachers can use to modify the intervention on the fly, capturing the best aspects of teaching at the right level (TaRL) interventions as well.
In this study we aim to use Inspiring Teachers’ TFLI approach to explore how support for assessment-informed targeted instruction can be built into structured pedagogy and how technology can be used to support that process to enable cost-effective and data driven teacher and school support. Using grade 1 students in primary schools in Cape Coast, Ghana, as our study context, we seek to determine how TFLI affects learning outcomes.
External Link(s)

Registration Citation

Citation
Andersen, Erik et al. 2025. "Integrating Educational Technology with Structured Pedagogy to Improve Learning Outcomes for Every Student." AEA RCT Registry. June 10. https://doi.org/10.1257/rct.14627-4.0
Sponsors & Partners
Experimental Details

Interventions

Intervention(s)
The intervention to be implemented is “Tools for Foundational Learning Improvement” (TFLI). TFLI is a structured pedagogy program which uses a “science of reading” approach, combined with assessment-informed targeted instruction for early-grade reading. In addition to paper materials, training, and coaching, the program provides a companion app with video explainers and tools for running 1-1 literacy assessments, tracking student progress and managing coaching. This app (SmartCoach) adds a digital layer to the program, enabling high-frequency data collection on program delivery and student learning outcomes. This enables data-driven adaptive program management and is intended to cultivate a more purposeful learning centered approach to program delivery.
Intervention (Hidden)
Intervention Start Date
2024-09-16
Intervention End Date
2025-07-04

Primary Outcomes

Primary Outcomes (end points)
English EGRA score (in SDs)
- Score is the weighted average of the subtest scores, where the weights are the first
principal component of the control-group data across all English EGRA components we tested in this wave of data collection, for every student in the relevant cohort (BS1 students in the 2024-25 school year). We will standardize each subtest score by the control-group mean and SD before running PCA. See the PAP for more details on how the scores are measured.
Primary Outcomes (explanation)
See PAP.

Secondary Outcomes

Secondary Outcomes (end points)
Besides EGRA scores, we will also study the following outcomes from data collected during the school visits:
a. Other questions from the student survey. Specifically, we plan to analyze how the intervention affects students’ perceived class ranks, career, and academic aspirations. We will also test if the intervention affects whether students practice reading and writing outside of school.
b. Quality of teaching instruction, as measured via classroom observation.
c. The distributional effects of the intervention using quantile regression, distributional regression, and K–S Tests.
d. Effects on individual subtests of the EGRA (including distributional effects)
We will also do three other secondary analyses. First, we will study the effect of the type of enumerator (SISO vs. outside contractor) on tests scores and estimated treatment effects.
Second, we will validate the data collected by enumerators. This will be validated by audio recording the EGRA evaluations and re-scoring them using an AI tool.
Third, the treatment effects of the intervention will also be expressed as Equivalent Years of Schooling (EYS). Since we have no baseline test scores, we will explore other ways of measuring typical progress on the EGRA each year.
Finally, we will look at treatment effect heterogeneity analyses by student gender, teacher gender and teacher-student gender match. We may also do other exploratory analyses of the data; this list is not comprehensive.
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We will randomly assign a total of 80 schools to two study arms, with 40 schools in the control group and 40 schools in the treatment group. Schools in the treatment group will receive the structured pedagogy program over the 2024/2025 academic year. For this academic year, the focus is only on grade 1 students. There will be no baseline data. Within the intervention period, we will collect student lists for every school at the beginning of the 2024-25 school year. We will run a separate analysis studying whether the type of enumerator who collects the data affects measured test scores. Specifically, we have two groups of enumerators: 1) school improvement support officers (SISOs) who work for the Ghanaian government, and contractors hired directly by our organization and whose only connection to the education sector is this project. Each group will have approximately 10 members. We will randomly assign an equal number of SISOs and contractors to each school and randomize at the student level which enumerator collects each student’s data.
Experimental Design Details
Randomization Method
Randomization was done in the office by computer. Specifically, the randomization was run in R using the randomizr package.
Randomization Unit
The treatment is randomized at the school level. The type of data collector (i.e. SISO or contractor) is randomized at the individual level.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
80 schools
Sample size: planned number of observations
80 schools (2400 pupils in total)
Sample size (or number of clusters) by treatment arms
40 schools in treatment, 40 schools in control
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
See the power calculations document under "Supporting Documents"
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Ghana Ethics Committee for the Humanities
IRB Approval Date
2024-07-04
IRB Approval Number
ECH 278/23-24
IRB Name
Heartland IRB
IRB Approval Date
2024-06-24
IRB Approval Number
062424-573
IRB Name
University of Washington Human Subjects Division
IRB Approval Date
2024-09-03
IRB Approval Number
STUDY00021036
Analysis Plan

Analysis Plan Documents

Endline 2024-2025 Analysis Plan

MD5: 8b5fefeda57619e851d9e6c1343680ef

SHA1: 46c3b33b9c86735b32985400b3c9617f4a319394

Uploaded At: June 10, 2025

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials