How Can We Encourage Teachers to Improve the Skills of Low-Achieving Students? Experimental Evidence from Bangladesh

Last registered on December 26, 2022

Pre-Trial

Trial Information

General Information

Title
How Can We Encourage Teachers to Improve the Skills of Low-Achieving Students? Experimental Evidence from Bangladesh
RCT ID
AEARCTR-0010203
Initial registration date
October 12, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 17, 2022, 5:28 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
December 26, 2022, 12:33 AM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
New York University

Other Primary Investigator(s)

PI Affiliation
University of Oxford
PI Affiliation
World Bank
PI Affiliation
New York University
PI Affiliation
World Bank

Additional Trial Information

Status
On going
Start date
2022-05-01
End date
2023-01-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Researchers have argued that teachers in developing countries do not devote enough attention to low-achieving students primarily because they face incentives to focus on their high-achieving peers. Building on recent evidence from South Asia showing that primary- and middle-school teachers in South Asia overestimate their students' performance, this randomized evaluation aims to measure the impact of providing teachers with accurate information on their student's academic skills. The study has two treatment groups and one control group. Each group consists of 156 schools, totaling 468 schools. The schools in the treatment groups, 312 in total, will be handed over a report card immediately after baseline and midline data collection. Specifically, the business-as-usual control group will not receive any interventions; the external feedback group (T1) will receive two formative assessments administered by the research team and reports summarizing their results at baseline and midline, along with training for teachers on how to interpret the assessment results; and the internal feedback group (T2), will receive two formative assessments administered by teachers at baseline and midline, training for teachers on how to administer and interpret the written assessments and on how to administer one-on-one oral assessments to the three lowest-ranked students in the written assessments who are identified in the report cards. The study measures the impact on students' learning levels, teachers' instructional strategies, and the accuracy of teachers' beliefs at the endline.
External Link(s)

Registration Citation

Citation
Angrist, Noam et al. 2022. "How Can We Encourage Teachers to Improve the Skills of Low-Achieving Students? Experimental Evidence from Bangladesh." AEA RCT Registry. December 26. https://doi.org/10.1257/rct.10203-1.1
Experimental Details

Interventions

Intervention(s)
The external feedback group (T1) will receive two formative assessments administered by the research team and reports summarizing their results at baseline and midline, along with training for teachers on how to interpret the assessment results. The internal feedback group (T2) will receive two formative assessments administered by teachers at baseline and midline, training for teachers on how to administer and interpret the written assessments and how to administer one-on-one oral assessments to the three lowest-ranked students in the written assessments. These students are identified in the report cards.
Intervention Start Date
2022-06-15
Intervention End Date
2022-12-15

Primary Outcomes

Primary Outcomes (end points)
We will evaluate the impact of the two interventions on: (a) Students' learning levels in math and reading; (b) teachers' instructional strategies; (c) Teachers' knowledge of student skill levels
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Our evaluation of these interventions will be conducted in a representative sample of 468 schools in six districts selected from the eight divisions in Bangladesh. Schools in these districts will be assigned to one of the three experimental groups, one for each treatment group listed above or the control group that operates business as usual. Each group consists of 156 schools. Comparisons of outcomes for these groups will provide policy-relevant evidence on the efficacy of each individual program. The random selection of districts is stratified by their average performance on 2019 National Assessments (NASS) so as to draw three districts that have above-median aggregate NASS scores and three districts that have below-median aggregate NASS scores. Within each of the selected districts, 39 public-private-partnership schools (PPP) are selected at random after excluding Madrasas, non-PPP schools, and schools that have either very small or very large (< 5th percentile or > 75th percentile) class sizes. The 39 schools in each of the sample districts are grouped randomly into each experimental arm with 13 schools each. Within each sample school, one grade six section is selected at random, and 20 students are further identified at random for participation in the data collection for the RCT. The teacher responsible for teaching math for the selected grade six class is identified as the sample teacher who will receive the intervention (report cards).
Experimental Design Details
Randomization Method
Randomization was done using the statistical analysis software STATA.
Randomization Unit
The unit of randomization is the school.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
468 schools
Sample size: planned number of observations
468 teachers and 9360 students
Sample size (or number of clusters) by treatment arms
Control: 156 schools
External feedback: 156 schools
Internal feedback: 156 schools
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Institute of Health Economics (University of Dhaka)
IRB Approval Date
2022-04-25
IRB Approval Number
FWA00026031

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials