Intervention(s)
Students are randomly assigned to receive access to interactive AI bots designed to teach core microeconomics topics such as demand, supply, and elasticity. The bots provide personalized feedback, topic-specific guidance, and reflective prompts via ASU’s CreateAI platform. Students in the control group receive standard instructional materials only. The intervention is conducted over five weeks.
Students assigned to the treatment group receive a total of five instructional emails, each aligned with a major topic in the course (e.g., demand, supply, elasticity). Each message introduces the relevant AI bot for that topic and includes a guide on how to interact with it via the ASU CreateAI Builder platform. These bots function as conversational tutors, capable of walking students through course content, problem-solving strategies, and real-time feedback. The first Bot is tied to a required course assignment implemented via Canvas Quizzes, which prompt structured interactions with the bots through open-ended questions to help treated students get used interacting with the bot. All students complete this graded assignment . The treatment group uses the bot to complete the assignment; the control group uses regular materials.
In addition to the instructional emails, students in the treatment group also receive bot reminders before major assessments (such as midterms). These reminders encourage students to revisit the bots and review key content.
Students in the control group receive parallel weekly emails that serve as neutral study reminders, directing them to review course material posted on Canvas. Before major assessments, they receive reminders that mirror the treatment group's message in structure and tone but exclude mention of the bots.
All students complete two Qualtrics surveys:
- Baseline Survey: Administered in the first weeks of class, collects demographic background, study routines, work status, AI familiarity, and expectations for the course. This data is also used to stratify the randomization. Randomization is at the average high school GPA level.
- Follow-Up Survey: Administered in the final weeks of the semester. This survey measures self-reported learning, confidence, engagement, perceptions of the bots (for treated students), and other academic behaviors. Both surveys are incentivized with extra credit.