How effective are computer-based teacher training programs? Evidence from a randomized controlled trial in El Salvador

The intervention is an in-service teacher training program implemented by the NGO Consciente. It targets voluntarily participating primary school teachers that teach basic math to students of grades 3 to 6.

The teacher training program has two elements: 1) Self-studying using computer-assisted learning software, and 2) participation in four workshops where the material covered in the self-study modules is recapped and discussed together with expert teachers.

Importantly, both the self-studying and the attendance in workshops are incentivized, meaning that the participants get compensated for each computer-assisted learning module they successfully complete as well as for their attendance in the monthly workshops.

2019-04-11

2019-08-23

Math skills of primary school teachers measured via pencil and paper assessments covering the local curriculum of grades 2 -- 6.

Starting point are all primary schools in Morazan, excluding the 50 smallest schools with only one or two teachers covering grades 3--6. The NGO sent out invitations to all eligible teachers in these schools, who were asked to register via telephone, internet or filling out a registration form.

Based on these registrations the applicants were invited to an information meeting in March 2019, where an unannounced baseline math assessment was conducted. Some of the applicants took exactly the same assessment during a representative survey in September 2018 (about 6 months before), and therefore only completed the registration and received additional information about the program.

Based on the baseline assessments, the worst performing applicant of every school was selected; applicants were informed that participation in the March-meeting did not guarantee admission to the program, but the pre-selection criteria were not communicated to them. Following this procedure 175 teachers from 175 different schools across Morazan remained in the sample.

Stratifying on baseline scores and teacher gender, the 175 teachers were randomly assigned to the either the control or treatment group. This gives 87 teachers that participate in the program and 88 teachers constituting the control group.

Randomization done in the office using Stata (Version 14.0/SE).

We randomize on the teacher level stratifying on their gender and baseline score. However, the pre-selection based on the baseline score leaves only one teacher per school in the sample.

No

175 teachers (and schools)

88 teachers (and schools) in the control group, 87 teachers (and schools) in the treatment group.

88 teachers (and schools) in the control group, 87 teachers (and schools) in the treatment group.

MDE = 0.2--0.27 standard deviations. Calculations based on formula by Bloom (2007) and the following parameter values: power=80%; alpha (level of significance)=0.1; R-squared : 0.5--0.7; P (share of control units)=0.5; n (total observations)=175