Study Habits and AI Coach

Last registered on August 22, 2025
View Trial History

Pre-Trial

Trial Information

General Information

Title
Study Habits and AI Coach
RCT ID
AEARCTR-0016486
Initial registration date
August 19, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
August 22, 2025, 5:48 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Country
United States of America
Region
Arizona

Primary Investigator

Name
Stephanie El Khoury
Affiliation
Arizona State University
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Esteban Aucejo
PI Affiliation
Arizona State University
Contact Investigator
PI Name
Agustina Affonso Peyre
PI Affiliation
Arizona State University
Contact Investigator
PI Name
Martin Carbajal Vega
PI Affiliation
Arizona State University
Contact Investigator

Additional Trial Information

Status
In development
Start date
2025-09-15
End date
2025-12-05
Keywords
Behavior, Education
Additional Keywords
RCT, AI, Study Habits
JEL code(s)
I2, C93, D83, O33
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study evaluates whether customized feedback and AI-based academic coaching can improve college students' study habits and academic outcomes. We conduct a randomized controlled trial with undergraduate students enrolled in intermediate economics courses at Arizona State University. Participants first complete a baseline survey measuring study strategies, time management, test anxiety, and AI familiarity. Students who consent to participate are randomly assigned to one of three groups: (1) a control group, (2) a treatment group receiving personalized written feedback on their study habits and , or (3) a treatment group receiving the same written feedback as in treatment 2, plus access to a custom-designed AI chatbot.
The feedback on their study habits includes scores, calculated from their responses to the baseline survey, along with a brief interpretation of that score.The chatbot offers tailored academic support by interpreting survey scores on study habits, answering freeform study-related questions, and helping students develop personalized study plans. Follow-up data will be collected at the end of the semester through a second survey and matched to academic records to assess the intervention's effects on beliefs about study habits, study habits strategies, and course performance.
External Link(s)

Registration Citation

Citation
Affonso Peyre, Agustina et al. 2025. "Study Habits and AI Coach ." AEA RCT Registry. August 22. https://doi.org/10.1257/rct.16486-1.0
Sponsors & Partners
Experimental Details

Interventions

Intervention(s)
Participants and Setting:
- Undergraduate students enrolled in intermediate economics courses at Arizona State University (ASU).
- Recruitment begins after the first course exam via Canvas announcements.
- Baseline survey administered through Qualtrics.

Randomization and Stratification:
- Only students who provide informed consent are included.
- Stratified random assignment based on average high school GPA, implemented within Qualtrics.
- Randomly assigned to one of three groups: Control group, Personalized feedback group, and Personalized feedback + AI chatbot group

Survey & Video Procedures:

- After completing the baseline survey, students are shown a short video:
-- Chatbot group: video introduces the chatbot and explains how to use it.
-- Control and feedback groups: view a neutral, non-academic video (e.g., ASU campus content).

Post-Survey Emails (Immediately Following Survey Completion):

- Control group: receives a thank-you email.
- Feedback group: receives an email with personalized scores and written feedback on study habits.
- Chatbot group: receives the same personalized feedback email, plus: Access to the AI chatbot (hosted on ASU’s CreateAI Builder platform) and a usage guide explaining how to interact with the bot.

Chatbot Features:
- Tailored academic support based on individual survey scores.
- Generates study plans, answers study-related questions.
- Accepts course materials (e.g., lecture slides), which are processed only within-session.

Ongoing Intervention & Reminders (Before Subsequent Exams):
- Chatbot group: receives reminders on their study habit scores and encouraging bot use before each exam.
- Feedback group: receives reminders about their study habit scores before each exam..
- Control group: receives neutral study reminders before each exam..
- Reminders are aligned with exam dates and continue through the semester.

Follow-Up Survey (End of Semester):
- All students are invited to complete a follow-up Qualtrics survey
- Assesses:
-- Changes in study habits and beliefs
-- Intervention usage and perceptions (for treatment groups)
- Participation is voluntary; students may receive extra credit from instructors.
Intervention (Hidden)
Intervention Start Date
2025-09-15
Intervention End Date
2025-12-05

Primary Outcomes

Primary Outcomes (end points)
- Academic performance scores
- Attitude towards AI
- Beliefs of effectiveness of study habits
- Time allocation to different study habits while studying
- Beliefs about Return of effort to studying
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
- Perceived usefulness and satisfaction with the chatbot
- Time spent studying per week and cost of studying
- Student engagement
- Frequency of bot usage (for chatbot treatment group only)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
This project is a randomized controlled trial evaluating the effect of personalized feedback and an AI-powered chatbot on college students’ study behaviors and academic outcomes. The study population consists of students enrolled in intermediate economics courses at Arizona State University. After completing a baseline survey, consenting students are stratified by average high school GPA and randomly assigned at the individual level to one of three groups: (1) a control group, (2) a group receiving personalized written feedback on their study habits, or (3) a group receiving both personalized feedback and access to an AI chatbot. The chatbot offers academic coaching through interactive conversations and tailored study planning tools. Follow-up data are collected at the end of the semester via survey and matched to administrative academic records (with consent) to assess the effects of each intervention.
Experimental Design Details
Randomization Method
Randomization done in qualtrics by randomly assigning students into a treatment arm.
Randomization Unit
individual level
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1,500
Sample size: planned number of observations
1,500
Sample size (or number of clusters) by treatment arms
500 control, 500 personalized feedback, 500 AI chatbot
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
ERA (Enterprise Research Administration) system
IRB Approval Date
2025-08-12
IRB Approval Number
STUDY00022695
Analysis Plan

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials