Evaluation of learning recovery program from COVID-19 for students in Samut Sakhon, Thailand: A randomized controlled Trial

Last registered on March 19, 2023
View Trial History

Pre-Trial

Trial Information

General Information

Title
Evaluation of learning recovery program from COVID-19 for students in Samut Sakhon, Thailand: A randomized controlled Trial
RCT ID
AEARCTR-0009185
Initial registration date
June 08, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 15, 2022, 10:08 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
March 19, 2023, 6:31 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country
Thailand
Region

Primary Investigator

Name
Suparee Boonmanunt
Affiliation
Faculty of Medicine Ramathibodi Hospital, Mahidol University
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Wasinee Jantorn
PI Affiliation
Research Institute for Policy Evaluation and Design, University of Thai Chamber of Commerce
Contact Investigator
PI Name
Weerachart Kilenthong
PI Affiliation
Research Institute for Policy Evaluation and Design, University of Thai Chamber of Commerce
Contact Investigator
PI Name
Nada Wasi
PI Affiliation
Puey Ungphakorn Institute for Economic Research
Contact Investigator

Additional Trial Information

Status
In development
Start date
2022-06-13
End date
2024-03-31
Keywords
Education
Additional Keywords
Learning loss, learning recovery, RCT
JEL code(s)
I25 Education and Economic Development; I15 Health and Economic Development
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This project investigates the effects of a learning recovery program from COVID-19 for students in Samut Sakhon, Thailand using randomized controlled trial. The intervention is an online curriculum for teachers, students and parents designed by Starfish Country Home School Foundation.
Sixty schools will be randomly assigned to control and treatment by matched pair design making 30 schools in each group.
Schools in the treatment group will receive the learning recovery program while schools in the control group will not. The program will last for 2 semesters (or 1 academic year). The evaluation team will collect a baseline survey around the beginning of the first semester and an endline survey around the end of second semester.
Primary outcomes are post-intervention students' cognitive skills measure by standardized test scores in math, English and Thai; socio-emotional skills measured by Behavior Problems Index (NLSY79 Child) and Strengths and Difficulties Questionnaire (SDQ). Secondary outcomes are IRT scores, binary outcomes indicating whether post-intervention score has passed the baseline median score for each subject, classroom quality and program adoption.
External Link(s)

Registration Citation

Citation
Boonmanunt, Suparee et al. 2023. "Evaluation of learning recovery program from COVID-19 for students in Samut Sakhon, Thailand: A randomized controlled Trial." AEA RCT Registry. March 19. https://doi.org/10.1257/rct.9185-1.1
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Starfish country home school foundation will provide online teaching/learning materials for teachers, students, and parents or community volunteers.
For teachers, the program will provide learning materials regarding knowledge, teaching techniques, and online technology/tools. Also, it will provide online lessons in a micro-learning format for teachers and examples for knowledge sheets and work sheets. In addition, there will be an online workshop for using these materials and online coaching monthly.
For students, the program will provide online lessons for students in a micro-learning format and learning box for development of mathematic skills.
For parents or community volunteers, the program will provide online lessons for parents in a micro-learning format.
Intervention Start Date
2022-06-13
Intervention End Date
2023-03-31

Primary Outcomes

Primary Outcomes (end points)
Cognitive ability of students measured by post-intervention standardized test scores in math, English and Thai.
Non-cognitive ability of students measured by Behavior Problems Index (NLSY79 Child) and Strengths and Difficulties Questionnaire (SDQ)
Primary Outcomes (explanation)
Cognitive skills:
• Standardized score by level from raw score for math, Thai and English
• Standardized score for total sample (all levels together) for math, Thai and English
• The test comprises of 60% from previous level and 40% from current level.

Socio-emotional skills: SDQ questionnaires answered by children (grade 9 or older), parents, teachers, separately, measured by Behavior Problems Index (NLSY79 Child) and Strengths and Difficulties Questionnaire (SDQ)

Secondary Outcomes

Secondary Outcomes (end points)
Cognitive skills:
• IRT score by level from raw score for math, Thai and English
• IRT score for total sample (all levels together) for math, Thai and English
• A binary outcome indicating whether post-intervention score has passed the baseline median score for each subject by level
• A binary outcome indicating whether post-intervention score has passed the baseline median score for each subject for total sample (all levels together)

Classroom quality:
• Classroom quality assessment measured by Stallings Classroom Snapshot
• Program adoption by teacher assessed by a survey for teachers and students
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Sixty schools in Samut Sakhon, Thailand, will be randomly assigned to the treatment and control groups by matched pair design. The pairs are matched by (1) average ONET score of the school, (2) type of school whether it belongs to municipality, private, or government, and (3) whether a school has only primary level, only secondary level or both levels. It will be 30 schools in each group.
Schools in the treatment group will receive the learning recovery program while schools in the control group will not.
The program will last for 2 semesters (or 1 academic year). The evaluation team will collect a baseline survey around the beginning of the first semester and an endline survey around the end of second semester.
Experimental Design Details
Randomization Method
After 30 pairs were matched, the randomization was done in office by a computer.
Randomization Unit
School
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
60 schools
Sample size: planned number of observations
2700 students (45 students per school)
Sample size (or number of clusters) by treatment arms
30 schools control and 30 schools learning recovery program
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
The minimum detectable effect size for each skill of students is 0.25 SD (with power 0.8).
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
The University of the Thai Chamber of Commerce Human Research Ethics Committee
IRB Approval Date
2021-12-21
IRB Approval Number
UTCCEC/Expedited009/2564
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials