Can AI Guidance Improve University Programme Decisions?

Last registered on June 23, 2026

Pre-Trial

Trial Information

General Information

Title
Can AI Guidance Improve University Programme Decisions?
RCT ID
AEARCTR-0018832
Initial registration date
June 17, 2026

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 23, 2026, 8:22 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
ETHZ

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2026-06-10
End date
2026-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This pre-analysis plan describes the design and planned empirical strategy for a randomised controlled trial (RCT) studying the causal effects of AI-powered guidance on university programme decisions among Danish higher-education applicants. We randomly assign applicants to an AI chatbot that provides personalised information about Danish university programmes or to the standard national information portal ug.dk. We measure effects on stated programme preferences, decision confidence, perceived informedness, decision stress, and --- via administrative registry linkage --- actual application choices and dropout rates.
External Link(s)

Registration Citation

Citation
Kohler, Benjamin. 2026. "Can AI Guidance Improve University Programme Decisions?." AEA RCT Registry. June 23. https://doi.org/10.1257/rct.18832-1.0
Experimental Details

Interventions

Intervention(s)
Participants are randomly assigned to one of two tools to support their university programme decision. The treatment group receives access to a custom AI chatbot, that provides personalised information about Danish higher education programmes. The chatbot is augmented with information retrieval tools for programmes and their institution-specific offerings; all underlying information is publicly available on ug.dk, and all conversation logs are stored and linked to the participant. The control group receives access to the standard national information portal ug.dk, i.e., the current state of the art. Both groups interact with their assigned tool within the session and are encouraged to keep using it until the national admission deadline.
Intervention Start Date
2026-06-18
Intervention End Date
2026-07-31

Primary Outcomes

Primary Outcomes (end points)
Primary outcome groups:

1. Application decision — (a) whether the top-ranked programme changes between the pre-survey and each post-survey (binary revision indicator); (b) rank-order correlation between pre-survey and post-survey rankings across all stated
choices; (c) whether previously unlisted programmes are newly chosen post-treatment.
2. Application propensity — binary indicator for whether the participant submitted a formal application to the Coordinated Enrolment system (KOT) by the July deadline.
3. Knowledge — (a) perceived informedness (self-reported knowledge about programme options, Likert); (b) admission realism (absolute gap between self-assessed admission probability for the first-choice programme and both the actual GPA
cut-off and the model-estimated admission likelihood following Agarwal & Somaini 2018).
4. Well-being — (a) decision confidence (certainty about the top-ranked programme); (b) application-induced stress.

More details in the PAP.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
See PAP for details.
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
A two-arm, individual-level randomised controlled trial. Within a single online session, participants complete a pre-survey, are randomly assigned to treatment (AI chatbot) or control (ug.dk), interact with their assigned tool, and complete a first post-survey (Post-survey I). Participants are encouraged to keep using their tool after the session. One day after the national higher-education admission deadline (6 July 2026) — they are re-contacted for Post-survey II. Administrative registry data are linked via CPR number after Post-survey II, and a third follow-up survey is administered after the first university semester (collecting well-being, programme satisfaction, and any subsequent switching). Participation is incentivised through a raffle of 200 gift cards of 1,000 DKK, with a doubled raffle entry for participants who spend at least three minutes with their tool.
Experimental Design Details
Not available
Randomization Method
Randomisation is pre-assigned at the invitation stage. This is done by the research team in office (by a computer) before invitations are sent, ensuring exact 50/50 balance and preventing within-session switching.
Randomization Unit
Individual (participant level).
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
No clustering — randomisation is at the individual level. (Equivalently, the number of clusters equals the number of individual participants, ~2,000.)
Sample size: planned number of observations
Approximately 2,000 participants. The sampling frame covers ~40% of each birth cohort aged 19–21 from Statistics Denmark administrative records; at an anticipated 5% response rate, we expect roughly 2,000 participants.
Sample size (or number of clusters) by treatment arms
50/50 allocation: approximately 1,000 in the treatment arm (AI chatbot) and approximately 1,000 in the control arm (ug.dk).
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Institutional Ethical Review Board, University of Copenhagen, Copenhagen Center for Social Data Science
IRB Approval Date
2026-04-16
IRB Approval Number
SODAS-2025-016
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information