Evaluation of real time and actionable parent notifications delivered through Eedi’s parent app

Last registered on September 14, 2022

Pre-Trial

Trial Information

General Information

Title
Evaluation of real time and actionable parent notifications delivered through Eedi’s parent app
RCT ID
AEARCTR-0005009
Initial registration date
November 11, 2019

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
November 12, 2019, 11:31 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
September 14, 2022, 4:36 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Primary Investigator

Affiliation
CLOO

Other Primary Investigator(s)

PI Affiliation
CLOO
PI Affiliation
Eedi

Additional Trial Information

Status
Completed
Start date
2019-10-01
End date
2020-04-03
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
We aim to test whether giving parents access to information on their children’s learning progress through an education app, as well as personalized, specific, and informative notifications and actionable recommendations improves pupils’ effort in working through problems and misconceptions, ultimately improving their achievement in maths. This project will allow us to test the effect of parents’ having access to the parent app, independently from the children's access to the Eedi homework platform (which is currently being evaluated in an Education Endowment Foundation project). This evaluation will be achieved through a two-arm cluster randomized controlled trial: classes are randomized into treatment or control, and parents of pupils in treatment classes receive access to Eedi's parent app. We will test math achievement as measured through Eedi's quiz results as our main outcome, and will also assess student effort measures as secondary outcomes. And implementation process evaluation will be conducted to assess fidelity and compliance as well as to better understand participants’ lived experiences of the app notifications and subsequent interactions between pupils and their parents.
External Link(s)

Registration Citation

Citation
Brazao, Vasco, Bibi Groot and Iris Hulls. 2022. "Evaluation of real time and actionable parent notifications delivered through Eedi’s parent app." AEA RCT Registry. September 14. https://doi.org/10.1257/rct.5009-2.0
Experimental Details

Interventions

Intervention(s)
Intervention Start Date
2019-10-01
Intervention End Date
2020-02-28

Primary Outcomes

Primary Outcomes (end points)
Score on the last 100 Eedi questions completed before intervention end date.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Two-arm clustered randomized controlled trial, where classrooms in a given grade are randomly assigned to control or treatment.
Experimental Design Details
Randomization Method
Blocked randomization. For each school and year (7 or 8), 50% of classes randomized into treatment, remaining into control. Randomization conducted with R code.
Randomization Unit
The unit of randomization is the class, blocked by school and year.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
80 (10 schools with 8 classes each)
Sample size: planned number of observations
1600 pupils (80 classes with 20 students each)
Sample size (or number of clusters) by treatment arms
All schools receive treatment in control. 50% of classes within a year group within each school receive treatment.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
February 29, 2020, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
Final Sample Size: Number of Clusters (Unit of Randomization)
79 classes in 9 schools
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
1,851 pupils
Final Sample Size (or Number of Clusters) by Treatment Arms
38 classes control, 41 classes treatment
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials

Description
Quantitative and Qualitative Results Report
Citation
Brazao, Vasco, Bibi Groot and Iris Hulls. 2022. "Evaluation of real time and actionable parent notifications delivered through Eedi’s parent app." AEA RCT Registry. September 14. 2022. "Registration Entry Title: Quantitative and Qualitative Results Report." AEA RCT Registry. September 14 https://doi.org/10.1257/rct.5009-2.0
File
Final report_Solving together fund_Eedi CLOO_May 2020.pdf

MD5: b55f8e3be0423262d3449e9b4d20bcd9

SHA1: faf5e50a7c6f9f9be3ebc702eb1f49c31eca18f7

Uploaded At: September 14, 2022