Back to History

Fields Changed

Registration

Field Before After
Last Published July 06, 2023 01:58 AM September 16, 2023 06:44 AM
Experimental Design (Public) This study uses an RCT to assess whether there is a causal link between the program and changes in outcomes. The evaluation of this employs a three-arm clustered RCT design (two treatment groups and one control group). Randomization is done in 2 stages: We first pick 208 schools from a pre-existing list provided by our partner organizations. We then randomly distribute these 208 schools into the three study arms: T1 (self-help), T2 (assisted), and C (control). T1 (self-help) and T2 (assisted) will have 69 schools each and Control will have 70 schools. From each school, we will randomly select 15 students on average to participate in the program. We will ensure that about half of the students are female when we randomly select the students to be treated from each treatment school. The intervention contains three study arms: a) T1: Self-help group (69 schools, 1058 students) –will only be provided with information on how to access IVR-based lessons and how this program could result in improved educational outcomes (such as higher marks on the SSC exams). Participants will receive regular text messages from the IVR system. b) T2: Assisted group (69 schools, 1022 students) – Will receive the same information as students in T1. Additional treatment will be provided in the form of biweekly phone calls from a tutor. Participants will also receive regular text messages from the IVR system. c) T3: Control (70 schools, 1050 students) - This group of students will not be receiving any intervention. This study uses an RCT to assess whether there is a causal link between the program and changes in outcomes. The evaluation of this employs a three-arm clustered RCT design (two treatment groups and one control group). Randomization is done in 2 stages: We first pick 208 schools from a pre-existing list provided by our partner organizations. We then randomly distribute these 208 schools into the three study arms: T1 (self-help), T2 (assisted), and C (control). T1 (self-help) and T2 (assisted) will have 69 schools each and Control will have 70 schools. From each school, we will randomly select 15 students on average to participate in the program. We will ensure that about half of the students are female when we randomly select the students to be treated from each treatment school. The intervention contains three study arms: a) T1: Self-help group (69 schools, 1058 students selected to receive treatment) –will only be provided with information on how to access IVR-based lessons and how this program could result in improved educational outcomes (such as higher marks on the SSC exams). Participants will receive regular text messages from the IVR system. b) T2: Assisted group (69 schools, 1022 students selected to receive treatment) – Will receive the same information as students in T1. Additional treatment will be provided in the form of biweekly phone calls from a tutor. Participants will also receive regular text messages from the IVR system. c) T3: Control (70 schools, 3201 students) - This group of students will not be receiving any intervention.
Sample size (or number of clusters) by treatment arms T1: Self-help group: 69 schools (units of randomization), 1058 students (units of observation) T2: Assisted group: 69 schools (units of randomization), 1022 students (units of observation) Control: 70 schools (units of randomization), 1050 students (units of observation) T1: Self-help group: 69 schools (units of randomization), 1058 students selected for treatment (units of observation) T2: Assisted group: 69 schools (units of randomization), 1022 students selected for treatment (units of observation) Control: 70 schools (units of randomization), 3201 students (units of observation)
Power calculation: Minimum Detectable Effect Size for Main Outcomes We consider a 0.24 SD effect size, alpha levels of 0.05, and a 0.2 inter-cluster correlation (ICC) to achieve 80% statistical power. We consider a 0.24 SD effect size, alpha levels of 0.05, and a 0.2 intra-cluster correlation (ICC) to achieve 80% statistical power.
Back to top