Play to Learn - Mass Media Impact Evaluation - Colombia

Last registered on August 03, 2022

Pre-Trial

Trial Information

General Information

Title
Play to Learn - Mass Media Impact Evaluation - Colombia
RCT ID
AEARCTR-0009826
Initial registration date
July 29, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
August 03, 2022, 2:33 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Global TIES for Children New York University

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2022-08-01
End date
2023-03-10
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Forced displacement is affecting an increasing number of people across the globe (UNHCR Global Trends 2020). War, conflict and persecution, environmental disasters or economic hardship continues to uproot people around the world and displace them from their homes. This phenomenon is also affecting children, who as a result will often experience severe stress related to their family's displacement, family conflict, difficulties with education, and social exclusion and discrimination. Such events greatly affect children’s early development and can have long lasting impacts in their cognitive and social development.

Play to Learn (PtL) Watch, Play Learn video blocks created by Sesame’s Workshop focus on developing socio-emotional learning and math skills among young children, with a focus on those affected by conflict and displacement.

Colombia is the second largest host of internationally displaced people in the world, with more than 1.7 million Venezuelans in the country and has one of the highest numbers of internally displaced people (European Civil Protection and Humanitarian Aid Operations, 2019). Access to social services for these families, including education, is limited, all of which has been exacerbated by COVID-19. Sesame Workshop along with New York University Global Ties for Children and Innovations for Poverty action will measure the impact of Watch, Play Learn video blocks targeting four-year-old children through a randomized experiment in Colombia. The sample will consist of Venezuelan migrants living in Colombia and Colombian nationals in those communities with high concentration of Venezuelan migrants.
External Link(s)

Registration Citation

Citation
Yoshikawa, Hirokazu. 2022. "Play to Learn - Mass Media Impact Evaluation - Colombia ." AEA RCT Registry. August 03. https://doi.org/10.1257/rct.9826-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The intervention will consist of sending Play to Learn (PtL) Watch, Play Learn video blocks that focus on developing socio-emotional learning and math skills for internally and forcibly displaced four year-old children. Contents and methodology have the potential to address the acute lack of education opportunities among children living in vulnerable contexts like migration or forced displacement.
Intervention Start Date
2022-09-19
Intervention End Date
2023-01-31

Primary Outcomes

Primary Outcomes (end points)
Emotion recognition by 4-year-old children
Emotion identification by 4-year-old children
Self-regulation strategies of 4-year-old children
Early mathematics skills
Primary Outcomes (explanation)
Emotion recognition by 4-year-old children: Children will be able to identify and name emotions
Emotion identification by 4-year-old children: Children will be able to identify specific emotions
Self-regulation strategies of 4-year-old children: Children will be able to identify others’ and own feelings in the context of common social situations
Early mathematics skills: Children will be able to demonstrate increased levels of a composite of early mathematic skills, including of (i) counting - verbal number production of 1 to 10 Items, verbal counting, what comes next,, (ii) shape discrimination - nonverbal identification and sorting, (iii) Position and location of things in relation to other objects; (iv) measurement terms (height, width)

Secondary Outcomes

Secondary Outcomes (end points)
Whether effects of the intervention on primary outcomes are moderated by home environment (perceived refugee environment index). caregiver characteristics (caregiver’s education level, mental health, , thnic/immigrant origin), or child gender and age
Secondary Outcomes (explanation)
Spatial relation (hiding, left/right) questions that extend beyond the primary spatial relations outcomes (inside/outside, between, over/under)
Counting/cardinality are a spillover of the primary outcomes

Experimental Design

Experimental Design
The project will be designed as a randomized experiment to measure the impact of Watch, Play Learn video blocks targeting four-year-old children. The RCT intervention will last 19 weeks and will be conducted in Barranquilla and Soledad.

The sample will consist of 1,000 households that will be randomly assigned to a treatment (500 households) and a control group (500 households). Households will be Venezuelan migrants living in Colombia and Colombian nationals living in 16 pre-identified with a high concentration of Venezuelan migrant population.

The recruitment and baseline data collection will be conducted in-person and the neighborhood leaders will be informing all the community about the recruitment activity based on WhatsApp messages previously designed by the research team (see marketing section below).

If the caregiver and the child are eligible and accepted to be part of the study, we will proceed with the baseline questionnaires. The caregiver’s survey will inquire about caregivers’ basic information on household and income; education; socioeconomic status as well as mental health status. Meanwhile, the child’s survey will assess children's SEL and mathematics-skills A baseline cost survey will also be conducted which will try to gauge utilization of resources by caregivers which are relevant to the study context (such as mobile phone, money spent on internet, etc. ) and the time spent and resources employed by them to engage with their children through different academic or non-academic activities.
The unit of observation will be at the household level. Thus, after recruitment and baseline we will randomize households into treatment and control groups to have equal sample sizes. The study is powered to detect a minimum effect of 0.175 sd.

During the 19 week intervention we will monitor metrics related to content access and usage using the deployment platform of video delivery.

We will conduct an endline data collection after the intervention is completed. This data collection will be in-person and the team will contact both caregivers and children that participated in the baseline. Topics of the endline will be similar to those in baseline including additional questions to conduct a cost effectiveness analysis.
Experimental Design Details
The project will start with a pilot testing baseline measurement instruments and users’ experiences with contents. The pilot will be followed by a full RCT.
Recruitment and Baseline
For the recruitment and baseline data collection, we will set up stations in different strategic points of the pre-identified neighborhoods for caregivers to approach and register for the study. Community leaders within the neighborhoods will help advertise the activities. If at the moment of registration the household is eligible to participate in the study, the data collection team will set up appointments to interview both caregivers and children. Only those households who complete both surveys will receive the incentives which are a kit for the child and a 15,000 COP gift card for the caregiver.

The stations will be carefully designed in order to provide an enabling environment for children to concentrate on the evaluation instruments and for enumerators to be able to interact with children and caregivers in a productive manner. We will aim to have open large spaces with individual tables for each child where they feel secure and can focus on the tasks presented by the enumerators. The stations will also have space for the caregivers so they can be present at all times.

The stations will be rotated whenever the registration rates decrease, we expect to rotate registration points every three days, and we expect to have two teams working simultaneously. The neighborhood leaders will be informing all the community about the recruitment activity based on WhatsApp messages previously designed by the research team (see marketing section below).

There will be three stages of interaction during the recruitment and baseline:


Screening. We will collect the initial information of the caregivers who are 18 years or older to assess whether they are eligible to participate in the study; we will inquire about nationality, access to a smartphone and to the internet. The screening short survey will have an approximate duration of ten minutes.
Consent. We will have a two-stage consent. First, before the screening, briefly explaining the consent and then asking the screening questions. Next, if the person is eligible, they will receive the rest of consent information. During the consent, we will ask about the interest to participate in the program; this consent implies both the consent to receive the materials and participate in the program if they are selected, and consent to provide information in the baseline survey. During consent, caregivers will need to provide assent on behalf of the child.
Baseline data collection. If the caregiver and the child are eligible and accepted to be part of the study, we will proceed with the baseline questionnaires. The caregiver’s survey will inquire about caregivers’ basic information on household and income; education, socioeconomic status as well as mental health status. Survey application will last around 30-40 minutes. Meanwhile, the child’s survey will ask about children's SEL and mathematics-skills related behavior, activities, and outcomes. Survey application will last around 45 minutes.

Endline
For the endline data collection, we will again set up stations in different strategic points of the neighborhoods for caregivers and children to approach. The stations will again be carefully designed in order to provide an enabling environment for children to concentrate on the evaluation instruments and for the enumerators to be able to interact with the children and caregivers in a productive manner. Any learnings from the recruitment and baseline data collection will be considered for the design of the endline stations.

There will be three stages of interaction during the endline:


Consent. We will ask participants for their consent to participate in the endline survey. Caregivers will need to provide assent on behalf of the child.
Endline data collection. If the caregiver and the child accept to participate in the endline survey, we will proceed with the questionnaires. Any learnings from the recruitment and baseline data collection will be considered for the questionnaire's design.

Target population
Venezuelan migrants and Colombian nationals living in vulnerable neighborhoods with high concentrations of Venezuelan migrants.
For the pilot, the population will be in one neighborhood of Santa Marta that has a high concentration of Venezuelan migrants
For the RCT, the population will be up to 16 neighborhoods of Barranquilla and Soledad that have a high concentration of Venezuelan migrants. The final number of neighborhoods, which depends on the success of securing the sample size of 1,000 households, will not affect the RCT design as the randomization is conducted at the household level.
Randomization Method
Randomization will be done using the randtreat Stata command after the baseline phase.
Randomization Unit
Treatment will be randomized at the household level.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
N/A
Sample size: planned number of observations
2,000 observations (1,000 caregivers and 1,000 children)
Sample size (or number of clusters) by treatment arms
Treatment group: 500 caregivers and children aged 4
Control group: 500 caregivers and children aged 4.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Total sample size = 1000 households, accounting for 35% attrition at level 1 that is individual household level, MDES=0.175
IRB

Institutional Review Boards (IRBs)

IRB Name
Innovations for Poverty Action Institutional Review Board (IRB)
IRB Approval Date
2022-04-19
IRB Approval Number
16256
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials