Back to History Current Version

Can AI Enhance Learning? Evidence from a Randomized Controlled Trial

Last registered on August 18, 2025
View Trial History

Pre-Trial

Trial Information

General Information

Title
Can AI Enhance Learning? Evidence from a Randomized Controlled Trial
RCT ID
AEARCTR-0016568
Initial registration date
August 13, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
August 18, 2025, 6:41 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Name
Swee Liang Tan
Affiliation
Singapore Management University
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Christine Ho
PI Affiliation
Singapore Management University
Contact Investigator

Additional Trial Information

Status
In development
Start date
2025-08-19
End date
2026-05-01
Keywords
Education, Other
Additional Keywords
AI
JEL code(s)
A22 C93 I14 I24 J24 O33
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study examines whether artificial intelligence (AI) tools enhance or substitute for student learning in higher education. We pilot a randomized experiment with around 240 first-year students across 6 classes in the compulsory university-wide Economics and Society course, comparing an AI-enhanced treatment group receiving structured AI tool access and guidance with a control group following traditional instruction. The treatment incorporates AI tools in 6 out of 10 sessions, focusing on complementary rather than substitutable use. Outcomes include test scores, attitudes towards AI, and study habits. The study addresses critical gaps in understanding optimal AI implementation in diverse student populations and contributes to the growing literature on educational technology's dual nature as both enhancer and potential hindrance to deep learning.
External Link(s)

Registration Citation

Citation
Ho, Christine and Swee Liang Tan. 2025. "Can AI Enhance Learning? Evidence from a Randomized Controlled Trial." AEA RCT Registry. August 18. https://doi.org/10.1257/rct.16568-1.0
Sponsors & Partners
Experimental Details

Interventions

Intervention(s)
This RCT has 2 arms:
Treatment: Instructor teaches students how to use AI for selected concepts in their course.
Control: Status quo
Intervention Start Date
2025-08-26
Intervention End Date
2026-04-19

Primary Outcomes

Primary Outcomes (end points)
test scores
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
This RCT has 2 arms:
Treatment: Instructor teaches students how to use AI for selected concepts in their course.
Control: Status quo
Experimental Design Details
Not available
Randomization Method
randomization done by computer
Randomization Unit
class
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
six classes
Sample size: planned number of observations
240 students
Sample size (or number of clusters) by treatment arms
120 students in each arm
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
Singapore Management University
IRB Approval Date
2025-07-29
IRB Approval Number
IRB-25-139-A1110(725)
Analysis Plan