|
Field
Last Published
|
Before
October 23, 2025 07:38 AM
|
After
November 17, 2025 04:37 PM
|
|
Field
Primary Outcomes (End Points)
|
Before
The primary outcome variables in Phase 1 are:
• Number of correct questions
• Absolute and relative confidence (post-task)
The primary outcome variables in Phase 2 are:
• Choice of question (basic vs. more work, basic vs. more challenge)
• Number of correct questions
• Absolute and relative confidence (pre- and post-task)
|
After
The primary outcome variables in Phase 1 are:
• Number of correct questions
• Absolute and relative confidence (post-task)
The primary outcome variables in Phase 2 are:
• Choice of question (basic vs. more work, basic vs. more challenge) at different incentive levels
• Number of correct questions
• Absolute and relative confidence (pre- and post-task)
• Willingness to accept to choose the harder and longer task
|
|
Field
Experimental Design (Public)
|
Before
The study involves two phases. In Phase 1, participants complete tasks and are cross-randomized by question difficulty (easy vs. difficult) and access to an AI chatbot (“AI Advisor”). The AI Advisor allows participants to ask questions and upload materials.
In Phase 2, participants choose between tasks that vary in repetition and difficulty, both with and without AI access. For the choice question that is selected, the participant is then randomly assigned to receive their chosen option (75%) or the alternative option (25%).
The design measures how AI access and demographics such as gender influence performance, confidence, and willingness to engage in longer or more challenging work.
|
After
The study involves two phases. In Phase 1, participants complete tasks and are cross-randomized by question difficulty (easy vs. difficult) and access to an AI chatbot (“AI Advisor”). The AI Advisor allows participants to ask questions and upload materials.
In Phase 2, participants choose between tasks that vary in repetition and difficulty, both with and without AI access. We also vary incentives to measure WTA to complete the harder and longer tasks. For the choice question that is selected, the participant is then randomly assigned to receive their chosen option (75%) or the alternative option (25%).
Additionally, when choosing tasks for Phase 2, some participants will be randomized into an encouragement treatment, where the use of the AI Advisor is destigmatized.
The design measures how AI access and demographics such as gender influence performance, confidence, and willingness to engage in longer or more challenging work.
|
|
Field
Planned Number of Clusters
|
Before
100 MBA students, ca. 300 lab participants
|
After
100 MBA students, ca. 800-1100 lab participants, or as many as can be recruited in the fall and winter quarters.
|
|
Field
Planned Number of Observations
|
Before
100 MBA students, ca. 300 lab participants
|
After
100 MBA students, ca. 800-1100 lab participants, or as many as can be recruited in the fall and winter quarters.
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
In Phase 1, assignment to the easy vs. difficult condition and AI Advisor vs. No AI Advisor condition are with equal probability
In Phase 2, participants choose their preferred task and this is implemented with 75% probability.
|
After
In Phase 1, assignment to the easy vs. difficult condition and AI Advisor vs. No AI Advisor condition are with equal probability
In Phase 2, participants choose their preferred task and this is implemented with 75% probability. Additionally, in the lab participant sample, participants are cross-randomized to be in the encouragement treatment vs. not.
|