Back to History Current Version

Scaling up virtual learning of online learning in high schools

Last registered on January 20, 2021

Pre-Trial

Trial Information

General Information

Title
Scaling up virtual learning of online learning in high schools
RCT ID
AEARCTR-0005982
Initial registration date
June 09, 2020

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 10, 2020, 10:44 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 20, 2021, 12:57 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
World Bank

Other Primary Investigator(s)

PI Affiliation
University of Kassel

Additional Trial Information

Status
On going
Start date
2020-05-18
End date
2021-03-31
Secondary IDs
Abstract
We have an ongoing evaluation that tests the impacts of a training program that uses online learning for 15-17 years old high school students, with a focus on teaching entrepreneurial skills and a scientific mindset. That program was taught using computers in schools, during school time, until schools were closed with the COVID-19 pandemic, after which students continued to finish the material from their homes. With the COVID-19 pandemic closing schools, school systems have been looking for content and ways to engage students. We therefore are testing the impact of launching this material to another region of the country. We are interested in two key questions:
1) How can we best encourage take-up and usage of online learning materials among high school students during the COVID-19 school closures? This will be tested by comparing the impact of different nudges, reminders, and other interventions to encourage take-up and usage..
2) What is the impact of this program on learning outcomes? This will involve comparing impacts for students who are assigned to the personal initiative and negotiations classes to those who receive other courses. We will then also compare the learning gains from this virtual learning to those from students in our first experiment, who did most of the learning under teacher supervision in schools.
External Link(s)

Registration Citation

Citation
Asanov, Igor and David McKenzie. 2021. "Scaling up virtual learning of online learning in high schools." AEA RCT Registry. January 20. https://doi.org/10.1257/rct.5982-1.3
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The intervention is provided in two phases according to the educational regimes in Ecuador: Highlands Educational Regime (Students Finish the program in Summer 2020) and Coastal Educational Regime (Students Finish the program in Winter 2020). We have two types of interventions: the training interventions, and then interventions to enhance the take-up of training.


Highlands Educational Regime (Students Finish the program in Summer 2020) includes:
Training interventions.
Schools are randomly assigned to one of the following four treatment groups:
1) Personal initiative + Negotiations training + Role Model videos
2) Personal initiative + Negotiations training + Placebo videos
3) Spanish + Statistics + Role Model videos
4) Spanish + Statistics + Placebo videos

Interventions to enhance the take-up of training.
We are testing different interventions to encourage take-up and usage of the online platform on different levels: Students and teachers. These include on student level:
i) control group
ii) lottery reminder to students - students earn a ticket for a lottery prize for each completed module
iii) Encouragement to students to find a peer in the house to plan and study together
iv) Encouragement to students for those who complete their work
These include on teachers level:
I)control
ii) Role model testimonials/motivational videos to teachers from teachers and students who have already completed the course
iii) Reminder about monitoring and deadline to teachers


Coastal Educational Regime (Students Finish the program in Winter 2020) that includes:
Training interventions.
Schools are randomly assigned to one of the following 6 treatment groups:
1) Personal initiative + Negotiations training + Role Model videos
2) Personal initiative + Negotiations training + Placebo videos
3) Spanish + Statistics + Role Model videos
4) Spanish + Statistics + Placebo videos
3) Spanish + English + Role Model videos
4) Spanish + English + Placebo videos

Interventions to enhance the take-up of training.
We are testing different interventions to encourage take-up and usage of the online platform on the school level:
i) Control
ii)Monitoring (information)
iii)Monitoring (information) + lottery reminder to students - students earn a ticket for a lottery prize for each completed module and performance on platform.
iv)Monitoring (information) + Encouragement to team-up with peers remotely.

Intervention Start Date
2020-05-18
Intervention End Date
2020-12-31

Primary Outcomes

Primary Outcomes (end points)
We have two sets of outcomes: take-up outcomes, and learning outcomes.

Take-up outcomes:
1) Proportion of students who complete at least one module
2) Number of modules completed by students
3) Total days spent active on platform

Learning outcomes:
Test scores of learning based on Spanish and English literacy, knowledge of statistics, science, negotiations and personal initiative.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Course type is randomized at the school level to one of the following in the Highlands Educational Regime:
1) Personal initiative + Negotiations training + Role Model videos
2) Personal initiative + Negotiations training + Placebo videos
3) Spanish + Statistics + Role Model videos
4) Spanish + Statistics + Placebo videos

Take-up interventions are randomized at the individual level or class/teacher level, depending on the intervention.


Course type is randomized at the school level to one of the following in the Coastal Educational Regime:
1) Personal initiative + Negotiations training + Role Model videos
2) Personal initiative + Negotiations training + Placebo videos
3) Spanish + Statistics + Role Model videos
4) Spanish + Statistics + Placebo videos
3) Spanish + English + Role Model videos
4) Spanish + English + Placebo videos

Take-up interventions are cross-randomized on the school level.

Experimental Design Details
Randomization Method
Randomization done in office by computer or on the online platform
Randomization Unit
School for main interventions
Class for some take-up interventions
Student for individual interventions
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
Highlands Educational Regime (Students Finish the program in Summer 2020) includes:
416 schools
532 classes
Approximately 24,000 potential students

Coastal Educational Regime (Students Finish the program in Winter 2020) that includes:
598 schools
795 classes
Approximately 28,000 potential students



Sample size: planned number of observations
We will only observe outcomes for students who log in once to the platform - which we anticipate to be over 10,000 students in Highlands Educational Regime and over 11, 000 in Coastal Educational Regime
Sample size (or number of clusters) by treatment arms
Highlands Educational Regime (Students Finish the program in Summer 2020) includes:

104 schools in each treatment group
127 to 136 classes in each treatment group

Coastal Educational Regime (Students Finish the program in Winter 2020) that includes:

1) 149 schools Personal initiative + Negotiations training + Role Model videos (~200 classes)
2) 149 schools Personal initiative + Negotiations training + Placebo videos (~200 classes)
3) 75 schools: Spanish + Statistics + Role Model videos (~100 classes)
4) 75 schools: Spanish + Statistics + Placebo videos (~100 classes)
3) 75 schools: Spanish + English + Role Model videos (~100 classes)
4) 75 schools: Spanish + English + Placebo videos (~100 classes)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Innovations for Poverty Action - IRB
IRB Approval Date
2020-05-18
IRB Approval Number
15629
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials