Back to History

Fields Changed

Registration

Field Before After
Trial Status in_development completed
Abstract We conduct an adaptive experiment to select one out of six treatment arms of biweekly phone calls to parents that deliver reading exercises for first graders. The experiment is carried out in two waves - start to midterm, and midterm to endterm - during term 3 of the first grade in a sample of 108 private primary schools in Kenya. The method uses Bayesian econometrics to estimate average treatment effects and exploration sampling (Kasy and Sautmann, 2021) to assign parents to treatment arms in each wave. The objective is to identify the treatment arm with the highest average "correct words per minute" (cwpm) score. The application is a test of six formats for interactive phone calls to parents of first-graders in 108 primary schools in Kenya that encourage reading at home through short exercises. Each experimental wave carries out biweekly calls during one half of term 3 of the Kenyan school year and uses the exploration sampling algorithm in wave 2 of the experiment to identify the call with the highest rate of call engagement, that is, the listener starts the reading exercises.
Last Published June 12, 2021 06:49 AM April 09, 2022 11:21 AM
Experimental Design (Public) We carry out an adaptive experiment with 6 treatment arms and a control group to identify the treatment arm that in expectation leads to the greatest improvements in reading fluency, through engaging parents in reading regularly with their children at home. In the first wave of the experiment, student IDs are randomly assigned to each arm and the control; in the second wave, we calculate the probability that each treatment arm is optimal using Bayesian estimation and then use Exploration Sampling (Kasy and Sautmann, 2021) to assign the wave-2 sample to these arms. We carry out an adaptive experiment with 6 treatment arms and a control group to identify the treatment arm that in expectation leads to the greatest parental engagement and therefore improvements in reading fluency, through engaging parents in reading regularly with their children at home. In the first wave of the experiment, student IDs are randomly assigned to each arm and the control; in the second wave, we calculate the probability that each treatment arm is optimal using Bayesian estimation and then use Exploration Sampling (Kasy and Sautmann, 2021) to assign the wave-2 sample to these arms.
Additional Keyword(s) adaptive sampling, methodology
Public analysis plan No Yes
Public locations No Yes
Building on Existing Work No
Back to top

Partners

Field Before After
Partner Name New Globe
Partner Type private_company
Partner Website (URL) https://newglobe.education/
Public Yes
Back to top