x

Please fill out this short user survey of only 3 questions in order to help us improve the site. We appreciate your feedback!
Tech for Teacher Support: A study of technology take-up and effectiveness to scale-up Targeted Instruction (TI) in Pakistan
Last registered on April 09, 2021

Pre-Trial

Trial Information
General Information
Title
Tech for Teacher Support: A study of technology take-up and effectiveness to scale-up Targeted Instruction (TI) in Pakistan
RCT ID
AEARCTR-0007469
Initial registration date
April 08, 2021
Last updated
April 09, 2021 2:47 PM EDT
Location(s)
Region
Primary Investigator
Affiliation
UC Berkeley
Other Primary Investigator(s)
PI Affiliation
World Bank
PI Affiliation
Pomona College
Additional Trial Information
Status
In development
Start date
2021-07-01
End date
2022-07-01
Secondary IDs
Abstract
The education system in Pakistan is characterized by low average learning and high learning inequality, both of which have been aggravated by COVID-19 related school closures. In other contexts, targeted instruction programs that tailor teaching content to students' actual learning levels have proven effective in raising learning, however these programs have often required costly additional teaching resources. To better scale targeted instruction, we test whether a low cost technology support tool can assist teachers in implementing the program without extra human inputs. We also explore whether the benefit of this technology is heterogeneous across teachers, and whether teachers who can benefit most from the tool self-select into using it immediately or after a trial period.
External Link(s)
Registration Citation
Citation
Andrabi, Tahir, Juan Baron and Isabel Macdonald. 2021. "Tech for Teacher Support: A study of technology take-up and effectiveness to scale-up Targeted Instruction (TI) in Pakistan ." AEA RCT Registry. April 09. https://doi.org/10.1257/rct.7469-1.0.
Experimental Details
Interventions
Intervention(s)
The intervention evaluates a mobile application to support teachers in implementing a targeted instruction program.
Intervention Start Date
2021-07-01
Intervention End Date
2022-07-01
Primary Outcomes
Primary Outcomes (end points)
Teacher take up of technology and student test scores in math, Urdu, and English
Primary Outcomes (explanation)
Secondary Outcomes
Secondary Outcomes (end points)
Teacher and school leader satisfaction; app usage post text messages
Secondary Outcomes (explanation)
Experimental Design
Experimental Design
T1: Mandatory technology - teachers are required to use the technology throughout the intervention
T2: Optional technology - teachers can elect whether to use the technology or administer targeted instruction manually (paper-based system)
T3: Mandatory, then optional technology - teachers must use the technology for an initial trial period, then can decide whether to continue
T4: No technology - teachers implement targeted instruction manually (paper-based system)
T5: Pure control - no targeted instruction program

For groups T1-T3, we will also vary the content of text messages sent to remind teachers to use the tool.
Experimental Design Details
Not available
Randomization Method
Randomization done in office by a computer
Randomization Unit
School level randomization
Was the treatment clustered?
Yes
Experiment Characteristics
Sample size: planned number of clusters
1,250 schools
Sample size: planned number of observations
5,000 teachers (4/schooll) 75,000 students (60/school)
Sample size (or number of clusters) by treatment arms
250 schools mandatory technology
250 schools optional technology
250 schools mandatory, then optional technology
250 schools no technology
250 schools pure control (no targeted instruction)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Technology take up: Unit: teachers with intra-cluster correlation by school of 0.8 Attrition: 10% SD: 1 Baseline mean: 0.35 MDE: 0.13 at power 80% power, 0.15 at 90% power Student test scores: Unit: students with intra-cluster correlation by school of 0.8 Attrition: 10% SD: 1 Baseline mean: 0 (standardized scores) MDE: Subject dependent: 0.116 (Urdu), 0.136 (English), 0.117 (Math) at 80% power. 0.134 (Urdu) , 0.158 (English), 0.136 (Math) at 90% power.
IRB
INSTITUTIONAL REVIEW BOARDS (IRBs)
IRB Name
Pomona College
IRB Approval Date
2020-11-18
IRB Approval Number
00004400