Back to History Current Version

The Effect of AI vs Human Monitoring on Intrinsic Motivation

Last registered on July 28, 2025

Pre-Trial

Trial Information

General Information

Title
The Effect of AI vs Human Monitoring on Intrinsic Motivation
RCT ID
AEARCTR-0016411
Initial registration date
July 18, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 28, 2025, 8:24 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Middlebury College

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2025-07-18
End date
2026-07-17
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
We are testing the effect of having your work evaluated by AI vs humans on levels of intrinsic motivation and prosocial behavior and whether the effect depends on monetary incentives.
External Link(s)

Registration Citation

Citation
Abel, Martin. 2025. "The Effect of AI vs Human Monitoring on Intrinsic Motivation ." AEA RCT Registry. July 28. https://doi.org/10.1257/rct.16411-1.0
Experimental Details

Interventions

Intervention(s)
Intervention (Hidden)
We first ask people if they are willing to volunteer for a prosocial task. Based on pilot data, about 75% are willing. Among participants who agree, we ask them to write fundraising messages for a nonprofit organization. Specifically, they are watching a video on food shortage in the US and are asked to write a short fundraising message. The top 20 messages will be used in an actual fundraising campaign.
Intervention Start Date
2025-07-18
Intervention End Date
2025-09-17

Primary Outcomes

Primary Outcomes (end points)
Measures of intrinsic motivation and process perception, as explained in more detail in our pre-analysis plan.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We randomly assign who will evaluate the work and monetary incentives, as explained in more detail in our pre-analysis plan.
Experimental Design Details
As explained in more detail in our PAP, among those willing to volunteer, we randomize whether people receive monetary incentives to write effective fundraising messages. We also randomize whether the messages are evaluated by AI or humans. A last intervention tests the effect of having an AI evaluator that uses human criteria.
Randomization Method
Randomization is done in Qualtrics
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
No clusters
Sample size: planned number of observations
1500 individuals (upper bound depending on share interested in volunteering)
Sample size (or number of clusters) by treatment arms
300 per arm (upper bound depending on share interested in volunteering)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Bowdoin College IRB
IRB Approval Date
2025-06-20
IRB Approval Number
IRB-2025-23
Analysis Plan

Analysis Plan Documents

AI Monitoring_PAP_2025.07.17.pdf

MD5: 8f3ba88c12b30c121386fd74cfeb3e60

SHA1: c5bd6a8438074448cf8af6f72c5087f64c0d04b1

Uploaded At: July 18, 2025

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials