The impact of educational television on Children's Developmental Outcomes

Last registered on March 19, 2024

Pre-Trial

Trial Information

General Information

Title
The impact of educational television on Children's Developmental Outcomes
RCT ID
AEARCTR-0013106
Initial registration date
March 13, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 19, 2024, 5:09 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
Cornell University

Other Primary Investigator(s)

PI Affiliation
Busara Center for Behavioral Economics
PI Affiliation
Oxford University
PI Affiliation
University of Nairobi
PI Affiliation
National University of Singapore
PI Affiliation
Busara Center for Behavioral Economics

Additional Trial Information

Status
On going
Start date
2023-04-01
End date
2024-05-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Educational television has shown promise for bridging educational gaps in classrooms in developing countries. However, there is less evidence on its effectiveness in a home viewing setting when the show is transmitted free over-the-air, an approach of interest to policymakers because of its scalability and low cost. We are conducting a comprehensive evaluation of the effects of watching a new educational television program at home. The new show is broadcasted on a free over-the-air television channel in Kenya. Besides instructional content, a key innovation of the show is its objective to change children's mindsets about reading, gender attitudes and socio-emotional learning. We recruited 4,300 children in 346 public schools. We employ a randomized SMS-based encouragement design, sending bi-weekly reminders encouraging parents to have their children watch episodes of a new educational show at home.
External Link(s)

Registration Citation

Citation
Baier, Jasmin et al. 2024. "The impact of educational television on Children's Developmental Outcomes." AEA RCT Registry. March 19. https://doi.org/10.1257/rct.13106-1.0
Experimental Details

Interventions

Intervention(s)
Intervention Start Date
2023-06-24
Intervention End Date
2024-03-27

Primary Outcomes

Primary Outcomes (end points)
- Literacy Outcomes: Reading Fluency Score, Comprehension Score
- Gender Attitudes: Gender stereotype knowledge and flexibility score, Gender roles, In- and Out-group attitudes
- Socio-emotional lerning: Confidence and Curiosity Score
Primary Outcomes (explanation)
Literacy Outcomes: employs the Early Grade Reading Assessment Tool (USAID, 2016).
- Reading Fluency Score aggregates scores for letter identification, non-word reading, and oral fluency.
- Comprehension Score aggregates scores for oral and listening comprehension.

Gender Attitudes:
- Gender stereotype knowledge and flexibility score: Following a mapping of which stereotypes are considered “male” or “female” in the literature, responses are coded with “1” if they follow the stereotype, and “0” otherwise. These items are then aggregated into one score denoting the number of gender stereotypes that the child subscribes to. A higher score means that the child has strong gender stereotype knowledge and low stereotype flexibility.
- Gender roles: An aggregate score measuring belief in traditional gender roles. The score aggregates individual questions about different behaviors and traits typically associated with either “male” or “female.” Each child is asked both how likely they are to perform each behavior and how often they actually perform the behavior. Based on each child’s gender and their responses, a final score is constructed denoting the strength of their gender role beliefs. A higher score represents stronger beliefs in traditional gender roles.
- In- and Out-group attitudes: An aggregate score measuring attitudes toward oth- ers with the same and different genders. The score aggregates individual questions about activities with both the in- and out-group. Each child is asked both how willing they are to perform each behavior and how often they actually perform the behavior. Based on each child’s gender and their responses, a final score is con- structed denoting the strength of in-group and out-group attitudes. A higher score represents strong preference for in-groups while a lower score represents flexibility between in- and out-groups.

Socio-Emotional Learning:
- Confidence and Curiosity: We use measures of confidence and curiosity as a proxy for self-efficacy using the RTI confidence and curiosity scale, which has been vali- dated in both our East African context and our age group (Jukes et al., 2021). The score is the simple sum of all items, where relevant items are reverse coded so that a higher final score reflects higher confidence and curiosity. Our main outcome here, defined as the “SEL Score” pools the scores for Confidence and Curiosity.

Secondary Outcomes

Secondary Outcomes (end points)
Evaluate sub-categories of the different main outcomes. We will also explore mechanisms (see pre-analysis plan attached)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We are conducting a school-level cluster randomized controlled trial. Our sampling strategy consisted of 3 stages: (1) identify eligible counties and sub-counties, obtain a random draw; (2) identify eligible schools within randomly selected sub-counties and obtain a random draw; (3) obtained final sample of children within eligible schools.

Schools were randomly assigned to a pure control or treatment condition where they received encouragement to watch the show. For this randomization we employ a “multivariate stratified quadruple matching” technique. Traditionally, pair-wise matching was believed to be the most ideal approach to maximize balance and power in field experiments following Bruhn and McKenzie (2009). However, more recent work suggests a more conservative approach of using quadruplets or larger groups (McKenzie, 2022). We follow this approach by employing quadruplets given our clustered design and moderate number of units within each cluster.

To adopt this approach, we find groups of four clusters, based on a list of baseline characteristics, and randomly assign two into the treatment group, and two into the control group. Quadruplets were matched based on clusters with the lowest Mahalanobis distance cal- culated using these characteristics.
Experimental Design Details
Not available
Randomization Method
Randomization done in office by computer
Randomization Unit
School level
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
346 schools
Sample size: planned number of observations
4,373 children
Sample size (or number of clusters) by treatment arms
Treatment: 173 schools (2,198 children)
Control: 173 schools (2,175 children)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Maseno University Ethics Review Committee
IRB Approval Date
2023-03-17
IRB Approval Number
MUSERC/01202/23
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information