Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR

Last registered on July 25, 2022

Pre-Trial

Trial Information

General Information

Title
Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR
RCT ID
AEARCTR-0009640
Initial registration date
July 15, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 21, 2022, 11:33 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
July 25, 2022, 4:27 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Primary Investigator

Affiliation
Asian Development Bank Institute

Other Primary Investigator(s)

PI Affiliation
Abdul Latif Jameel Poverty Action Lab Southeast Asia
PI Affiliation
Asian Development Bank Institute
PI Affiliation
Abdul Latif Jameel Poverty Action Lab Southeast Asia
PI Affiliation
University of Arkansas, National Bureau of Economic Research, Abdul Latif Jameel Poverty Action Lab

Additional Trial Information

Status
On going
Start date
2022-07-18
End date
2023-08-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study is a randomized evaluation on the impact of implementing a high-tech and high-touch intervention in public junior high schools in Indonesia. In the high-tech intervention, randomly selected seventh-grade students from 150 selected schools will use a computer-adaptive learning (CAL) software to practice and strengthen their foundational mathematics skills. In the high-touch intervention, seventh-grade math teachers will receive a series of trainings to improve the students’ higher order thinking skills. The intervention will be implemented over one school year. The study will evaluate the impact of the intervention on student learning outcomes.
External Link(s)

Registration Citation

Citation
Gaduh, Arya et al. 2022. "Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR ." AEA RCT Registry. July 25. https://doi.org/10.1257/rct.9640
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
A total of 150 schools will be randomly assigned to either a control group or one of the two versions of the high-tech high-touch interventions: the high-tech only (HTO) intervention, in which seventh-grade students will get access to a computer-adaptive learning (CAL) software to practice and strengthen their foundational mathematical skills; or the high-tech high-touch (HTHT) intervention, in which in addition to the access to the CAL software, a minimum of 2 teachers in each school responsible for teaching the seventh-grade students will participate in a series of teacher training programs to increase their competence of delivering a learning experience that enhances the students’ higher-order skills.
Intervention Start Date
2022-08-01
Intervention End Date
2023-03-31

Primary Outcomes

Primary Outcomes (end points)
Student: literacy and numeracy; non-cognitive skills such as motivation, interest in mathematics
Primary Outcomes (explanation)
Literacy and numeracy: Students will be assessed on grade 1 - 7 materials. The items will test both the students’ foundational skills (50%) and higher-order thinking skills (50%).

Secondary Outcomes

Secondary Outcomes (end points)
Teacher: teaching practice, motivation, skills
Secondary Outcomes (explanation)
Teaching practice, motivation, and skills: Teachers will be assessed on mathematical content, pedagogical knowledge, and teaching efficacy. The mathematical and pedagogical knowledge will cover grade 7-9 materials and teaching strategies for higher-order skills and efficacy in conducting a tech-integrated and high-touch learning experience for students.

Experimental Design

Experimental Design
In this project, selected schools will be randomly assigned to a control group or either one of the high-tech high-touch intervention treatment arms:

High-Tech Only (HTO) Treatment Arm: students in the assigned schools will only receive our high-tech intervention, which is access to use a computer-adaptive learning software (CAL) to practice and strengthen their foundational mathematical skills for one academic year.

High-Tech High-Touch (HTHT) Treatment Arm: Like the schools in the HTO treatment, students in the assigned schools will receive the high-tech intervention. In addition, mathematics teachers responsible for teaching the students receiving the high-tech treatment will also participate in a series of teacher training programs aimed at improving their skills in delivering a learning experience that builds the students’ higher-order skills.
Experimental Design Details
Not available
Randomization Method
Stratified randomization done by a computer software.
Randomization Unit
School
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
150 schools
Sample size: planned number of observations
At maximum 18,000 seventh-grade students, at minimum 300 seventh-grade math teachers
Sample size (or number of clusters) by treatment arms
50 control schools, 50 high-tech only (HTO) intervention, 50 high-tech high-touch (HTHT) intervention. In each school, 60 students and 2 teachers will be surveyed.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Minimum Detectable Effect of the primary outcomes for each treatment arm (relative to control): 0.13SD
IRB

Institutional Review Boards (IRBs)

IRB Name
Ethical Commission, Atma Jaya Research Institute
IRB Approval Date
2022-07-01
IRB Approval Number
N/A