Chat2Learn: Comparing Static vs. AI-Enhanced Text-Based Conversational Prompts

Last registered on February 05, 2025
View Trial History

Pre-Trial

Trial Information

General Information

Title
Chat2Learn: Comparing Static vs. AI-Enhanced Text-Based Conversational Prompts
RCT ID
AEARCTR-0015280
Initial registration date
January 30, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
February 05, 2025, 8:11 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Name
Daniela Bresciani
Affiliation
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Ariel Kalil
PI Affiliation
University of Chicago
PI Name
Susan Mayer
PI Affiliation
University of Chicago

Additional Trial Information

Status
In development
Start date
2025-03-03
End date
2025-12-19
Keywords
Behavior
Additional Keywords
JEL code(s)
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Previous research has shown that Chat2Learn (C2L), a text-message based program delivering conversational prompts for parents to use with their children, can positively impact children's vocabulary. This study evaluates two different modalities of C2L, both delivered via text message. In the first modality, the static version, parents only receive predetermined prompts. In the second, the AI modality, parents receive the same prompts along with unlimited AI-generated responses. We will conduct a randomized controlled trial with approximately 1,000 parents of children aged 3 to 6 across the United States. Parents will be randomly assigned to either the static or AI modality of C2L. The study will assess which modality generates more engagement from parents, as measured by opt-out and response rates.
External Link(s)

Registration Citation

Citation
Bresciani, Daniela, Ariel Kalil and Susan Mayer. 2025. "Chat2Learn: Comparing Static vs. AI-Enhanced Text-Based Conversational Prompts." AEA RCT Registry. February 05. https://doi.org/10.1257/rct.15280-1.0
Sponsors & Partners
Experimental Details

Interventions

Intervention(s)
Chat2Learn (C2L) is a text-message based program that delivers conversational prompts for parents to use with their children for 9 months. We will offer two versions of C2L to parents (parents will be randomly assigned to receive one of them):
- Static version: parents receive predetermined conversational prompts via text message.
- AI version: parents receive the same predetermined conversational prompts via text message. Additionally, parents can respond to the prompts or message the phone number and get unlimited AI-generated responses and prompts.
Intervention Start Date
2025-03-03
Intervention End Date
2025-12-19

Primary Outcomes

Primary Outcomes (end points)
1) Our first outcome will be a binary variable indicating if the parent opted out of the program before it was over.
2) Our second outcome will be, out of the 121 days in which the parents will receive a pre-programed prompt from C2L, the number of days in which the parent sends a message to C2L.
3) The third outcome will be the total number of days in which the parent sends a message to C2L, counting both the days when they received and the days when they didn’t receive pre-programed messages.
4) Finally, we will analyze the messages that parents send to C2L, such as the word count and the complexity of the message (which will be measured with the help of AI).
Primary Outcomes (explanation)
Outcome 2): This variable will range between 0 and 121; if a parent sends a message on a day when the program did not send one of the pre-programed prompts, that day will not count for this particular outcome. This will help us assess if receiving the AI modality encourages parents to send messages back when they receive the pre-programed prompts.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Randomized controlled trial: parents will be individually randomized, half to the static version of the program and the other half to the AI version of the program.
Experimental Design Details
Not available
Randomization Method
Randomization done in office by a computer
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1000 parents
Sample size: planned number of observations
1000 parents
Sample size (or number of clusters) by treatment arms
500 parents per arm
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
0.18 standard deviations.
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
Social and Behavioral Sciences Institutional Review Board
IRB Approval Date
2024-12-18
IRB Approval Number
IRB24-1571
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information