Generative AI and Perceived Competence Bias: Evidence from a Field Experiment

Last registered on April 02, 2026
View Trial History

Pre-Trial

Trial Information

General Information

Title
Generative AI and Perceived Competence Bias: Evidence from a Field Experiment
RCT ID
AEARCTR-0018036
Initial registration date
March 19, 2026

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 23, 2026, 7:51 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
April 02, 2026, 12:35 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country
United States of America
Region

Primary Investigator

Name
Jiarui Wang
Affiliation
Boston University
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Raymond Fisman
PI Affiliation
Boston University
Contact Investigator

Additional Trial Information

Status
In development
Start date
2026-04-07
End date
2026-04-08
Keywords
Behavior, Education, Labor
Additional Keywords
JEL code(s)
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study examines how AI assistance affects individuals' beliefs about their own abilities. We use a randomized field experiment to estimate the causal effect of AI assistance on individuals' perceived competence and related outcomes.
External Link(s)

Registration Citation

Citation
Fisman, Raymond and Jiarui Wang. 2026. "Generative AI and Perceived Competence Bias: Evidence from a Field Experiment." AEA RCT Registry. April 02. https://doi.org/10.1257/rct.18036-1.2
Sponsors & Partners
Experimental Details

Interventions

Intervention(s)
Participants are randomly assigned to one of three conditions: AI-assistance, human-collaboration, and control condition.
Intervention (Hidden)
Participants are randomly assigned to one of three conditions. In the AI-assistance condition, they complete a task using a generative AI tool. In the human-collaboration condition, they complete the same task together with another participant. In the control condition, they complete the task independently without any assistance.
Intervention Start Date
2026-04-07
Intervention End Date
2026-04-08

Primary Outcomes

Primary Outcomes (end points)
Self-perceived competence
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We use a randomized controlled trial with three treatment arms: AI-assistance, human-collaboration, and control condition. Randomization is conducted at the cluster level. We measure impacts on self-perceived competence and related outcomes.
Experimental Design Details
We use a randomized controlled trial with three treatment arms: AI-assistance, human-collaboration, and control condition. Randomization is conducted at the cluster level. The experiment is conducted in a university course setting. Participants in the AI-assistance condition complete a task using a generative AI tool. Participants in the human-collaboration condition complete the same task together with another participant. Participants in the control condition complete the task independently without any assistance. After completing the task, all participants respond to survey questions measuring self-perceived competence and other related outcomes.
Randomization Method
Computer-generated random assignment
Randomization Unit
Course section (cluster-level randomization)
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
Around 20 class sections
Sample size: planned number of observations
Around 400 students
Sample size (or number of clusters) by treatment arms
Around 120 participants per treatment arm
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
Boston University Charles River Campus Institutional Review Board
IRB Approval Date
2026-01-12
IRB Approval Number
8301X
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials