Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR

Last registered on January 04, 2024
View Trial History

Pre-Trial

Trial Information

General Information

Title
Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR
RCT ID
AEARCTR-0009640
Initial registration date
July 15, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 21, 2022, 11:33 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 04, 2024, 3:49 AM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country
Indonesia
Region
Semarang, Kendal, Tegal in Central Java; East, Central, and West Jakarta in Special Capital Region of Jakarta

Primary Investigator

Name
Daniel Suryadarma
Affiliation
Asian Development Bank Institute
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Milda Irhamni
PI Affiliation
Contact Investigator
PI Name
Takiko Igarashi
PI Affiliation
Asian Development Bank Institute
Contact Investigator
PI Name
Gumilang Aryo Sahadewo
PI Affiliation
Universitas Gadjah Mada, Abdul Latif Jameel Poverty Action Lab Southeast Asia
Contact Investigator
PI Name
Arya Gaduh
PI Affiliation
University of Arkansas, National Bureau of Economic Research, Abdul Latif Jameel Poverty Action Lab
Contact Investigator

Additional Trial Information

Status
Completed
Start date
2022-07-18
End date
2023-12-31
Keywords
Education, Labor
Additional Keywords
educational technology, higher-order teaching skills, differentiated learning, computer assisted learning, high-tech high-touch
JEL code(s)
I21, I24, I25
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study is a randomized evaluation on the impact of implementing a high-tech and high-touch intervention in public junior high schools in Indonesia. In the high-tech intervention, randomly selected seventh-grade students from 150 selected schools will use a computer-adaptive learning (CAL) software to practice and strengthen their foundational mathematics skills. In the high-touch intervention, seventh-grade math teachers will receive a series of trainings to improve the students’ higher order thinking skills. The intervention will be implemented over one school year. The study will evaluate the impact of the intervention on student learning outcomes.
External Link(s)

Registration Citation

Citation
Gaduh, Arya et al. 2024. "Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR ." AEA RCT Registry. January 04. https://doi.org/10.1257/rct.9640-6.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
A total of 150 schools will be randomly assigned to either a control group or one of the two versions of the high-tech high-touch interventions: the high-tech only (HTO) intervention, in which seventh-grade students will get access to a computer-adaptive learning (CAL) software to practice and strengthen their foundational mathematical skills; or the high-tech high-touch (HTHT) intervention, in which in addition to the access to the CAL software, a minimum of 2 teachers in each school responsible for teaching the seventh-grade students will participate in a series of teacher training programs to increase their competence of delivering a learning experience that enhances the students’ higher-order skills.
Intervention Start Date
2022-08-01
Intervention End Date
2023-03-31

Primary Outcomes

Primary Outcomes (end points)
Student: literacy and numeracy; non-cognitive skills such as motivation, interest in mathematics
Primary Outcomes (explanation)
Literacy and numeracy: Students will be assessed on grade 1 - 7 materials. The items will test both the students’ foundational skills (50%) and higher-order thinking skills (50%).

Secondary Outcomes

Secondary Outcomes (end points)
Teacher: teaching practice, motivation, skills
Secondary Outcomes (explanation)
Teaching practice, motivation, and skills: Teachers will be assessed on mathematical content, pedagogical knowledge, and teaching efficacy. The mathematical and pedagogical knowledge will cover grade 7-9 materials and teaching strategies for higher-order skills and efficacy in conducting a tech-integrated and high-touch learning experience for students.

Experimental Design

Experimental Design
In this project, selected schools will be randomly assigned to a control group or either one of the high-tech high-touch intervention treatment arms:

High-Tech Only (HTO) Treatment Arm: students in the assigned schools will only receive our high-tech intervention, which is access to use a computer-adaptive learning software (CAL) to practice and strengthen their foundational mathematical skills for one academic year.

High-Tech High-Touch (HTHT) Treatment Arm: Like the schools in the HTO treatment, students in the assigned schools will receive the high-tech intervention. In addition, mathematics teachers responsible for teaching the students receiving the high-tech treatment will also participate in a series of teacher training programs aimed at improving their skills in delivering a learning experience that builds the students’ higher-order skills.
Experimental Design Details
Randomization Method
Stratified randomization done by a computer software.
Randomization Unit
School
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
150 schools
Sample size: planned number of observations
At maximum 18,000 seventh-grade students, at minimum 300 seventh-grade math teachers
Sample size (or number of clusters) by treatment arms
50 control schools, 50 high-tech only (HTO) intervention, 50 high-tech high-touch (HTHT) intervention. In each school, 60 students and 2 teachers will be surveyed.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Minimum Detectable Effect of the primary outcomes for each treatment arm (relative to control): 0.13SD
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
Ethical Commission, Atma Jaya Research Institute
IRB Approval Date
2022-07-01
IRB Approval Number
N/A
IRB Name
Komite Etik Penelitian LPEM FEB UI
IRB Approval Date
2023-01-06
IRB Approval Number
002/UN2.F6.D2.LPM/PPM.KEP/2023
Analysis Plan

Analysis Plan Documents

HTHT - 30.09.2022 - Pre-Analysis Plan_Baseline and Implementation

MD5: 056343d422744899609bba3eaa7f310e

SHA1: 849d13ebe2c2a6510151d0214a3febea783e503d

Uploaded At: October 02, 2022

HTHT - 23.02.2023 - Pre-Analysis Plan_Endline

MD5: 826cfee64e9d26ce5400b7805ec8c48f

SHA1: a55a4f7f942c9837d37f8265ae9bee06c51b02b9

Uploaded At: February 23, 2023

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
May 31, 2023, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
June 13, 2023, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
149 schools
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
149 principals or school staff, 324 teachers, 13,284 students.
Final Sample Size (or Number of Clusters) by Treatment Arms
49 schools control, 50 schools HTO, 50 schools HTHT
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials