Overcoming Medical Overuse with AI Assistance: An Experimental Investigation

Last registered on March 03, 2025

Pre-Trial

Trial Information

General Information

Title
Overcoming Medical Overuse with AI Assistance: An Experimental Investigation
RCT ID
AEARCTR-0015454
Initial registration date
February 26, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 03, 2025, 8:14 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Wuhan University

Other Primary Investigator(s)

PI Affiliation
Wuhan University
PI Affiliation
Wuhan University

Additional Trial Information

Status
On going
Start date
2025-02-07
End date
2025-03-22
Secondary IDs
Prior work
This trial is based on or builds upon one or more prior RCTs.
Abstract
This study explores the potential of Artificial Intelligence (AI) in mitigating medical overuse, specifically analyzing physicians' decision-making processes in a controlled experimental environment. Medical overuse, defined as unnecessary interventions that may cause harm to patients and increase healthcare costs, is a significant problem in both developed and developing healthcare systems. By integrating AI tools that provide evidence-based recommendations, this study aims to understand the extent to which AI can influence physician behavior and reduce overtreatment.

This experimental design consists of a lab-in-the-field setting within a medical school, and we used a two-by-three factorial design to manipulate monetary incentives and the availability of AI assistance between different groups of medical students. The study collects data on the potential causes of overtreatment and tests defensive medical behaviors. We built on previous experiments by conducting a field experiment with medical students, excluding the effects of physician self-learning as well as ordinal effects, examining AI-assisted consultations as a between-subject variable, and exploring the effects of medical students' overuse rates and clinical decision-making accuracy in familiar and unfamiliar consultation scenarios. Key findings of the study include the frequency of overtreatment, diagnostic accuracy, defensive medical behaviors, and adoption of AI recommendations.

The findings are expected to provide a broader contribution based on previous research, providing policymakers and healthcare administrators with more nuanced insights about the value of integrating AI technology in healthcare settings to potentially improve healthcare efficiency and patient safety.
External Link(s)

Registration Citation

Citation
Wang, Ziyi, Lijia Wei and Lian Xue. 2025. "Overcoming Medical Overuse with AI Assistance: An Experimental Investigation." AEA RCT Registry. March 03. https://doi.org/10.1257/rct.15454-1.0
Experimental Details

Interventions

Intervention(s)
Intervention (Hidden)
Intervention Start Date
2025-03-06
Intervention End Date
2025-03-14

Primary Outcomes

Primary Outcomes (end points)
The key outcome variables in this experiment are the degree of physician overtreatment, AI on accuracy rate and the analysis of the causes of overuse.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We conducted a lab-in-the-field experiment at a medical school affiliated with Central South Hospital, utilizing a two-by-three factorial design. The participants, referred to as prospective physicians, were recruited from this institution, where they were trained to become medical doctors.
Incentive Schemes (Between-Subject): The experiment varied the incentive structures for participants when making choices in a multiple-choice medicine prescription task. Three types of incentives were tested: flat, progressive and regressive, affecting how participants were compensated for their choices.
AI Assistance (Within-Subject): We are also transforming the decision-making process by introducing artificial intelligence-assisted functions. Participants will choose directly without AI advice and parsing in half of the questions in the experiment, and in the other half of the questions participants will see AI advice and parsing before making a choice.
Control Variables: To account for individual fixed effects and other potential confounders affecting the propensity for overtreatment, we implemented NoAI and WithAI experiment assessments. These assessments collected data on causes of overuse, defense medicine attitude, doctors’ professional abilities, cognitive reflection (CRT), IQ, algorithm literacy, trust in algorithms, awareness of algorithms, and perceptions of algorithm fairness.
Experimental Design Details
Randomization Method
randomization in recruitment
Randomization Unit
Individual
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
We aim to recruit between 120 and 150 participants.
Sample size: planned number of observations
We aim to recruit between 120 and 150 participants.
Sample size (or number of clusters) by treatment arms
40-50 individuals in the Group 1, Group 2 and Group 3, respectively.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Economics and Management School of Wuhan University
IRB Approval Date
2025-02-20
IRB Approval Number
EM240014

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials