Student Performance, Peer Effects, and Friend Networks: Evidence from a Randomized Peer Intervention

Last registered on January 06, 2022

Pre-Trial

Trial Information

General Information

Title
Student Performance, Peer Effects, and Friend Networks: Evidence from a Randomized Peer Intervention
RCT ID
AEARCTR-0006127
Initial registration date
July 07, 2020

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 08, 2020, 5:05 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 06, 2022, 9:09 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
Shandong University

Other Primary Investigator(s)

PI Affiliation
PI Affiliation

Additional Trial Information

Status
Completed
Start date
2015-06-15
End date
2016-03-20
Secondary IDs
Bureau of Longhui County in Hunan Province
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study analyzes experimental data from a carefully designed seating arrangement in elementary schools in China to estimate the effects of a complete mixed-seating classroom and incentivized study help. We randomly set up two-thirds of classes as complete mixed-seating classrooms in which low- and high-ability students are divided into two tracks according to the median score of a previous examination. Students in the lower and upper tracks are randomly paired as deskmates and sat together for 20 weeks. A tournament-type incentive based on the improved score of lower-track students is set among upper-track students in half of the mixed-seating classes. We find that lower-track students assigned with incentivized upper-track students gained 0.24 standard deviations in their mathematics scores. In comparison, students in the complete mixed-seating classroom without incentives showed minimal change in their scores. We provide evidence that the positive treatment effect can be attributed to the deskmate-level peer effects, which are shown to be associated with network structure changes: the incentivized complete mixed-seating classes promote social ties between deskmates and separate links among lower-track students.
External Link(s)

Registration Citation

Citation
wu, jia, Chunchao Wang and Junsen Zhang. 2022. "Student Performance, Peer Effects, and Friend Networks: Evidence from a Randomized Peer Intervention." AEA RCT Registry. January 06. https://doi.org/10.1257/rct.6127-1.2000000000000002
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
In collaboration with the Longhui Educational Bureau, we selected four primary schools to participate in our experiment in the first semester of 2015 (September 2015–February 2016). The experiment lasted for 20 weeks. The four schools were not selected randomly. We required each selected school to have at least three classes in each grade from Grades 3–5 because two types of treatment were introduced, and randomization was implemented at the school-by-grade level. All selected schools are commuter public schools. At the beginning of the first semester, we randomly selected three classes from each grade in each school as our target classes. A total of 36 classes were selected. We randomly chose two classes in each grade in each school as the treated classes (a total of 24 treated classes). These classes were assigned as the complete mixed-seating classrooms, in which low- and high-ability students were randomly paired as deskmates. From the 24 complete mixed-seating classes, half were assigned the MSR strategy and the other half were the pure MS classes. The remaining 12 classes (one class each from Grades 3–5 of the four schools) were the control classes. Our initial sample includes 695 students in the MS classes, 672 students in the MSR classes, and 667 students in the control classes.
At the beginning of the semester, the seats of students in each of the selected 24 treated classes were reassigned to form the complete mixed-seating environment. The basic rules for assigning seats were as follows. First, students in a class were divided into two tracks according to the median score of their average performance on the Chinese and mathematics in the previous end-of-term exam. If a student’s average score on the two courses was higher than the median score of the class, then he/she will be assigned to the upper track. Otherwise, he/she will be assigned to the lower track. Second, students in a class were sorted from the shortest to the tallest within each track and then categorized into tertiles. Specifically, the top 30%, the middle 40%, and the bottom 30% height groups were generated for the upper- and lower-track students. We considered student height in our setting to prevent tall students seated near the blackboard from blocking the view of the short students seated behind them. Finally, we implemented a random sequence of pairing students. We started by assigning lower- and upper-track students in the short-height groups. We randomly selected one student from the upper track and one student from the lower track as deskmates, and the pair was assigned a desk in the front left area of the classroom. Then, we randomly selected the next pair of students, one from each of the two tracks, and assigned them with a desk next to the prior pair of students. Figure 1 illustrates the desk arrangement in a typical classroom. The order of the seating arrangement in the physical space of the classroom for each pair was from left to right and from front to back. After the seats of students in the short-height group were assigned, we assigned seats for students in the middle-height group. Finally, we assigned seats for students in the tall-height group. In case a class had an odd number of students, we picked the tallest student in the lower track and assigned this single student to a desk in the last row of the classroom. In our design, taller students mostly sat behind shorter students.
Next, one of the two treated classes in each grade in each school was chosen to be the MSR treated class, leaving the 12 classes as pure MS classes. Thus, we had 12 MSR and 12 pure MS classes. In the 12 MSR classes, we offered monetary awards and praise certificates as incentives for the 30 upper-track students in the middle and the end of the semester. Award targets were set on the basis of the learning progress of the grade quantiles of the average scores that their low-ability deskmates achieved. Specifically, an upper-track student was offered 100 CNY if his/her deskmate’s improved score ranked in the top 10% in the midterm or final exams among lower-track students in the class. Given that the average class size is 50, a 10% award rate implies that 2.5 students in an MSR class can receive rewards for each exam (in total, 12×2.5=30 upper-track students are offered rewards in each exam). Midterm and final exams were conducted during the experiment. Therefore, an upper-track student may receive a packaged benefit of 200 CNY in total (or approximately 30 USD when using the nominal exchange rate to transfer). This amount can be considered a financial incentive for upper-track students to help their low-ability deskmates on study. The reward plan was announced in the MSR classes after the completion of the seating arrangement, but no students in the MS and control classes were informed about the reward plan. The total expense of our program is 6,000 RMB (or 900USD)
Intervention Start Date
2015-09-01
Intervention End Date
2016-02-13

Primary Outcomes

Primary Outcomes (end points)
Chinese and Math test scores, Friend networks
Primary Outcomes (explanation)
Chinese and math test scores are measured by the final term examination.
A friend network is measured by asking students to nominate their best friends.

Secondary Outcomes

Secondary Outcomes (end points)
Non-cognitive abilities
Secondary Outcomes (explanation)
Non-cognitive abilities are measured by Big-Five.

Experimental Design

Experimental Design
In collaboration with the Longhui Educational Bureau, we selected four primary schools to participate in our experiment in the first semester of 2015 (September 2015–February 2016). The experiment lasted for 20 weeks. The four schools were not selected randomly. We required each selected school to have at least three classes in each grade from Grades 3–5 because two types of treatment were introduced, and randomization was implemented at the school-by-grade level. All selected schools are commuter public schools. At the beginning of the first semester, we randomly selected three classes from each grade in each school as our target classes. A total of 36 classes were selected. We randomly chose two classes in each grade in each school as the treated classes (a total of 24 treated classes). These classes were assigned as the complete mixed-seating classrooms, in which low- and high-ability students were randomly paired as deskmates. From the 24 complete mixed-seating classes, half were assigned the MSR strategy and the other half were the pure MS classes. The remaining 12 classes (one class each from Grades 3–5 of the four schools) were the control classes. Our initial sample includes 695 students in the MS classes, 672 students in the MSR classes, and 667 students in the control classes.
At the beginning of the semester, the seats of students in each of the selected 24 treated classes were reassigned to form the complete mixed-seating environment. The basic rules for assigning seats were as follows. First, students in a class were divided into two tracks according to the median score of their average performance on the Chinese and mathematics in the previous end-of-term exam. If a student’s average score on the two courses was higher than the median score of the class, then he/she will be assigned to the upper track. Otherwise, he/she will be assigned to the lower track. Second, students in a class were sorted from the shortest to the tallest within each track and then categorized into tertiles. Specifically, the top 30%, the middle 40%, and the bottom 30% height groups were generated for the upper- and lower-track students. We considered student height in our setting to prevent tall students seated near the blackboard from blocking the view of the short students seated behind them. Finally, we implemented a random sequence of pairing students. We started by assigning lower- and upper-track students in the short-height groups. We randomly selected one student from the upper track and one student from the lower track as deskmates, and the pair was assigned a desk in the front left area of the classroom. Then, we randomly selected the next pair of students, one from each of the two tracks, and assigned them with a desk next to the prior pair of students. Figure 1 illustrates the desk arrangement in a typical classroom. The order of the seating arrangement in the physical space of the classroom for each pair was from left to right and from front to back. After the seats of students in the short-height group were assigned, we assigned seats for students in the middle-height group. Finally, we assigned seats for students in the tall-height group. In case a class had an odd number of students, we picked the tallest student in the lower track and assigned this single student to a desk in the last row of the classroom. In our design, taller students mostly sat behind shorter students.
Next, one of the two treated classes in each grade in each school was chosen to be the MSR treated class, leaving the 12 classes as pure MS classes. Thus, we had 12 MSR and 12 pure MS classes. In the 12 MSR classes, we offered monetary awards and praise certificates as incentives for the 30 upper-track students in the middle and the end of the semester. Award targets were set on the basis of the learning progress of the grade quantiles of the average scores that their low-ability deskmates achieved. Specifically, an upper-track student was offered 100 CNY if his/her deskmate’s improved score ranked in the top 10% in the midterm or final exams among lower-track students in the class. Given that the average class size is 50, a 10% award rate implies that 2.5 students in an MSR class can receive rewards for each exam (in total, 12×2.5=30 upper-track students are offered rewards in each exam). Midterm and final exams were conducted during the experiment. Therefore, an upper-track student may receive a packaged benefit of 200 CNY in total (or approximately 30 USD when using the nominal exchange rate to transfer). This amount can be considered a financial incentive for upper-track students to help their low-ability deskmates on study. The reward plan was announced in the MSR classes after the completion of the seating arrangement, but no students in the MS and control classes were informed about the reward plan. The total expense of our program is 6,000 RMB (or 900USD)
Experimental Design Details
Randomization Method
randomization done by lottery
Randomization Unit
Classroom
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
36 classes
Sample size: planned number of observations
1802 students
Sample size (or number of clusters) by treatment arms
574 students in the control class, 634 students in the MS classes and 594 students in the MSR classes
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials