Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR

Last registered on September 30, 2022

View Trial History

Pre-Trial

Trial Information

General Information

Title

Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR

RCT ID

AEARCTR-0009640

Initial registration date

July 15, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published

July 21, 2022, 11:33 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated

September 30, 2022, 6:29 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country

Indonesia

Region

Semarang, Kendal, Tegal in Central Java; East, Central, and West Jakarta in Special Capital Region of Jakarta

Primary Investigator

Name

Daniel Suryadarma

Affiliation

Asian Development Bank Institute

Contact Primary Investigator

Other Primary Investigator(s)

PI Name

Milda Irhamni

PI Affiliation

Contact Investigator

PI Name

Takiko Igarashi

PI Affiliation

Asian Development Bank Institute

Contact Investigator

PI Name

Gumilang Aryo Sahadewo

PI Affiliation

Abdul Latif Jameel Poverty Action Lab Southeast Asia

Contact Investigator

PI Name

Arya Gaduh

PI Affiliation

University of Arkansas, National Bureau of Economic Research, Abdul Latif Jameel Poverty Action Lab

Contact Investigator

Additional Trial Information

Status

On going

Start date

2022-07-18

End date

2023-08-31

Keywords

Education, Labor

Additional Keywords

educational technology, higher-order teaching skills, differentiated learning, computer assisted learning, high-tech high-touch

JEL code(s)

I21, I24, I25

Secondary IDs

Prior work

This trial does not extend or rely on any prior RCTs.

Abstract

This study is a randomized evaluation on the impact of implementing a high-tech and high-touch intervention in public junior high schools in Indonesia. In the high-tech intervention, randomly selected seventh-grade students from 150 selected schools will use a computer-adaptive learning (CAL) software to practice and strengthen their foundational mathematics skills. In the high-touch intervention, seventh-grade math teachers will receive a series of trainings to improve the students’ higher order thinking skills. The intervention will be implemented over one school year. The study will evaluate the impact of the intervention on student learning outcomes.

External Link(s)

Registration Citation

Citation

Gaduh, Arya et al. 2022. "Closing the Indonesian Students’ Mathematics Gap: The High-Tech High-Touch Pilot (HTHT) – Program MENGEJAR ." AEA RCT Registry. September 30. https://doi.org/10.1257/rct.9640-2.0

Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Experimental Details

Interventions

Intervention(s)

A total of 150 schools will be randomly assigned to either a control group or one of the two versions of the high-tech high-touch interventions: the high-tech only (HTO) intervention, in which seventh-grade students will get access to a computer-adaptive learning (CAL) software to practice and strengthen their foundational mathematical skills; or the high-tech high-touch (HTHT) intervention, in which in addition to the access to the CAL software, a minimum of 2 teachers in each school responsible for teaching the seventh-grade students will participate in a series of teacher training programs to increase their competence of delivering a learning experience that enhances the students’ higher-order skills.

Intervention (Hidden)

Intervention Start Date

2022-08-01

Intervention End Date

2023-03-31

Primary Outcomes

Primary Outcomes (end points)

Student: literacy and numeracy; non-cognitive skills such as motivation, interest in mathematics

Primary Outcomes (explanation)

Literacy and numeracy: Students will be assessed on grade 1 - 7 materials. The items will test both the students’ foundational skills (50%) and higher-order thinking skills (50%).

Secondary Outcomes

Secondary Outcomes (end points)

Teacher: teaching practice, motivation, skills

Secondary Outcomes (explanation)

Teaching practice, motivation, and skills: Teachers will be assessed on mathematical content, pedagogical knowledge, and teaching efficacy. The mathematical and pedagogical knowledge will cover grade 7-9 materials and teaching strategies for higher-order skills and efficacy in conducting a tech-integrated and high-touch learning experience for students.

Experimental Design

In this project, selected schools will be randomly assigned to a control group or either one of the high-tech high-touch intervention treatment arms:

High-Tech Only (HTO) Treatment Arm: students in the assigned schools will only receive our high-tech intervention, which is access to use a computer-adaptive learning software (CAL) to practice and strengthen their foundational mathematical skills for one academic year.

High-Tech High-Touch (HTHT) Treatment Arm: Like the schools in the HTO treatment, students in the assigned schools will receive the high-tech intervention. In addition, mathematics teachers responsible for teaching the students receiving the high-tech treatment will also participate in a series of teacher training programs aimed at improving their skills in delivering a learning experience that builds the students’ higher-order skills.

Experimental Design Details

Randomization Method

Stratified randomization done by a computer software.

Randomization Unit

School

Was the treatment clustered?

Yes

Experiment Characteristics

Sample size: planned number of clusters

150 schools

Sample size: planned number of observations

At maximum 18,000 seventh-grade students, at minimum 300 seventh-grade math teachers

Sample size (or number of clusters) by treatment arms

50 control schools, 50 high-tech only (HTO) intervention, 50 high-tech high-touch (HTHT) intervention. In each school, 60 students and 2 teachers will be surveyed.

Minimum detectable effect size for main outcomes (accounting for sample design and clustering)

Minimum Detectable Effect of the primary outcomes for each treatment arm (relative to control): 0.13SD

Supporting Documents and Materials

IRB