x

NEW UPDATE: Completed trials may now upload and register supplementary documents (e.g. null results reports, populated pre-analysis plans, or post-trial results reports) in the Post Trial section under Reports, Papers, & Other Materials.
Evaluation of Peru's Acompañamiento Pedagogico Multigrado (APM) Teacher Coaching Program for Multigrade Schools
Last registered on April 24, 2020

Pre-Trial

Trial Information
General Information
Title
Evaluation of Peru's Acompañamiento Pedagogico Multigrado (APM) Teacher Coaching Program for Multigrade Schools
RCT ID
AEARCTR-0005637
Initial registration date
April 22, 2020
Last updated
April 24, 2020 3:06 PM EDT
Location(s)
Region
Primary Investigator
Affiliation
University of Minnesota
Other Primary Investigator(s)
PI Affiliation
University of Minnesota
PI Affiliation
Universidad del Pacifico
Additional Trial Information
Status
Completed
Start date
2016-01-15
End date
2018-11-30
Secondary IDs
Abstract
We evaluate the effect of a large-scale teacher coaching program offered in a context of high teacher turnover on a broad range of pedagogical skills. Previous studies have found that small coaching programs can improve the teaching of reading and of science in a developing country setting. However, scale can compromise quality and turnover can erode compliance. It is also unclear whether teachers’ general pedagogical skills can be improved through coaching. We evaluate a teacher coaching program currently serving more than 6,000 rural public schools in Peru. We exploit the random assignment of a program expansion that occurred in 2016. We examine the impact of the program on teachers' pedagogical skills after two years, and on student performance on standardized tests.
External Link(s)
Registration Citation
Citation
Castro, Juan, Paul Glewwe and Ricardo Montero. 2020. "Evaluation of Peru's Acompañamiento Pedagogico Multigrado (APM) Teacher Coaching Program for Multigrade Schools." AEA RCT Registry. April 24. https://doi.org/10.1257/rct.5637-1.0.
Sponsors & Partners

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information
Experimental Details
Interventions
Intervention(s)
The local education authority (UGEL), following guidelines established by the Ministry of Education, hires coaches to visit teachers in schools targeted by the program. The work of the coaches is divided into several stages. First, they meet with the school principal and gather information about the educational context. Then, in the same visit, the coaches attend a class session of the teacher and collect information on his or her performance in the classroom to make an initial diagnostic. Based on this diagnostic, the coach identifies the competencies that the teacher must strengthen and, together with the teacher, develops a plan of improvement. After this, the coach periodically observes class sessions carried out by the teacher at regular intervals during the year. In total, nine visits are made each year. After each classroom observation, the coach and the teacher meet to discuss the progress made with respect to the improvement plan. The coach makes monthly and quarterly reports that are sent to the UGEL and to the school principal on progress and on areas for future improvement of the teacher. At the end of the year, the coach provides a final feedback session for the teacher and collects his or her impressions of the process. Finally, the coach makes a final report for each teacher on the actions, achievements, and areas that require additional effort, with reference to the initial improvement plan.
Intervention Start Date
2016-02-01
Intervention End Date
2018-11-30
Primary Outcomes
Primary Outcomes (end points)
Eight dimensions of teacher pedagogical skills: lesson planning, managing class time, encouraging students’ critical thinking, encouraging student participation, providing oral feedback to students, providing written feedback to students, encouraging respectful classroom relations, and managing students’ behavior. This was measured by independent classroom observers who graded from 1 (ineffective) to 4 (highly effective). In addition, student learning was another outcome of interest; this is measured in terms of students' performance on the Grade 2 and Grade 4 National Student Evaluation (ECE) exams.
Primary Outcomes (explanation)
Secondary Outcomes
Secondary Outcomes (end points)
Secondary Outcomes (explanation)
Experimental Design
Experimental Design
At the beginning of the 2016 school year, a randomization mechanism was used for the expansion of the monolingual multigrade version of the program (Acompañamiento Pedagogico Multigrado, in Spanish, or APM). All schools that had one or two years of treatment by the end of 2015 continued to participate in APM. Monolingual multigrade schools that had not received the program yet and had low scores in the Peruvian second grade national student evaluation were randomized into treatment and control groups. Out of 6,207 eligible schools, 3,795 schools were randomly assigned to the treatment group and started receiving APM at the beginning of the 2016 school year (the Peruvian school year runs from February to November), while the remaining 2,412 schools were sorted into the control group and did not participate in any coaching program for the following years. This randomization was stratified at the region level, which is the highest level of political division in Peru, with a total of 26 regions in the country. A random sub-sample of 364 schools stratified at the region level was selected for this study (to collect data on teachers' pedagogical practices). In particular, 182 schools were randomly selected from the 3,795 treated schools, and 182 schools were randomly selected from the 2,421 control schools. Observations of teachers’ pedagogical practices were carried out in these 364 schools at the end of the 2017 school year. In addition, an effort was made to follow the teachers who worked in these 364 schools in 2016 and moved to other schools in 2017, so that observations were carried out in their new schools.
Experimental Design Details
Randomization Method
The randomization was done at the Ministry of Education on a computer. It was stratified at the region (department) level.
Randomization Unit
School
Was the treatment clustered?
Yes
Experiment Characteristics
Sample size: planned number of clusters
364 schools
Sample size: planned number of observations
About 600 teachers.
Sample size (or number of clusters) by treatment arms
The sample consists of 182 schools that received teacher coaching, and the other 182 that were the control group.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Power calculations were done for the outcome of teacher pedagogical practices, which has an index from 0 to 1. The sample size was chosen to detect and MDE of 0.11, with 80% power. The 0.11 target was based on the estimated impact of another intervention (Jornada Escolar Completa) designed to change teachers' pedagogical practices.
IRB
INSTITUTIONAL REVIEW BOARDS (IRBs)
IRB Name
IRB Approval Date
IRB Approval Number
Post-Trial
Post Trial Information
Study Withdrawal
Intervention
Is the intervention completed?
Yes
Intervention Completion Date
November 30, 2018, 12:00 AM +00:00
Is data collection complete?
Yes
Data Collection Completion Date
November 30, 2018, 12:00 AM +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
340 schools
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
455 teachers
Final Sample Size (or Number of Clusters) by Treatment Arms
219 teachers in treatment schools, and 236 teachers in control schools.
Data Publication
Data Publication
Is public data available?
No

This section is unavailable to the public. Use the button below to request access to this information.

Request Information
Program Files
Program Files
No
Reports, Papers & Other Materials
Relevant Paper(s)
REPORTS & OTHER MATERIALS