Effect of AI on Engagement in Online Learning Platforms

Last registered on February 12, 2024
View Trial History

Pre-Trial

Trial Information

General Information

Title
Effect of AI on Engagement in Online Learning Platforms
RCT ID
AEARCTR-0010750
Initial registration date
January 09, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
January 10, 2023, 10:38 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
February 12, 2024, 5:31 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country
United States of America
Region
Illinois

Primary Investigator

Name
Unnati Narang
Affiliation
UIUC
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Ruichun Liu
PI Affiliation
UIUC
Contact Investigator

Additional Trial Information

Status
Completed
Start date
2023-01-11
End date
2023-02-08
Keywords
Education
Additional Keywords
JEL code(s)
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The goal of this study is to evaluate the effect of encouraging use of artificial intelligence (AI) tools for learning and education in online learning platforms using an RCT that assigns participants in an online course into two conditions; the treatment encourages them to use AI tools (such as chatGPT) for posting in discussion prompts while the control does not.
External Link(s)

Registration Citation

Citation
Liu, Ruichun and Unnati Narang. 2024. "Effect of AI on Engagement in Online Learning Platforms." AEA RCT Registry. February 12. https://doi.org/10.1257/rct.10750-2.0
Sponsors & Partners
Experimental Details

Interventions

Intervention(s)
The RCT assigns participants in an online course into two conditions; the treatment encourages them to use AI tools (such as chatGPT) for posting in discussion prompts while the control does not.
Intervention Start Date
2023-01-11
Intervention End Date
2023-02-08

Primary Outcomes

Primary Outcomes (end points)
Learner performance and engagement (e.g., videos viewed, textual posts made, comments and likes on posts, overall performance in course).
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The RCT assigns participants in an online course into two conditions; the treatment encourages them to use AI tools (such as chatGPT) for posting in discussion prompts while the control does not.
Experimental Design Details
Randomization Method
Random number generator
Randomization Unit
Individual learners
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
350-400 learners
Sample size: planned number of observations
Same
Sample size (or number of clusters) by treatment arms
50% in treatment and 50% in control
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
Illinois
IRB Approval Date
2022-10-03
IRB Approval Number
23783
Analysis Plan

Analysis Plan Documents

Analysis plan

MD5: 096b6e8a60cf933a9c303d092daa9cb7

SHA1: 72d90af6b45cc999caad1f04c02fed418f002300

Uploaded At: February 12, 2024

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials