|
Field
Abstract
|
Before
Artificial intelligence (AI) is increasingly deployed as decision support in organisations. This study examines how prior exposure to AI advice affects subsequent human judgment in case-based decision tasks.
The study is an online experiment with 1:1 individual randomisation. Participants complete three short decision cases involving managerial judgment under uncertainty. The target sample is at least 200 eligible participants with formal leadership responsibility, defined as at least one year of formal responsibility for leading, coordinating, or professionally directing the work of others.
In the treatment condition, participants complete all three cases in a sequential two-step format: they first provide an initial answer without AI support, then receive AI advice and are given the opportunity to revise their answer. In the control condition, participants complete Case 1 and Case 2 without AI support only. In Case 3, both groups follow the same two-step procedure by first providing an initial answer, then receiving AI advice and being given the opportunity to revise.
The primary outcome is an ordinal measure of whether, and how strongly, participants revise their Case 3 answer toward, or away from, the AI recommendation after seeing it. The primary test compares this revision between treatment and control using ordinal logistic regression on the full eligible sample, without conditioning on the initial answer. Secondary analyses examine decision quality in Cases 1 and 2, confidence change, perceived mental effort, perceived task difficulty, and time-on-task. All AI messages are pre-written and fixed across participants. No live language model is used.
|
After
Artificial intelligence (AI) is increasingly deployed as decision support in organisations. This study examines how prior exposure to AI advice affects subsequent human judgment in case-based decision tasks.
The study is an online experiment with 1:1 individual randomisation. Participants complete three short decision cases involving managerial judgment under uncertainty. The target sample is at least 200 eligible participants with formal leadership responsibility, defined as at least one year of formal responsibility for leading, coordinating, or professionally directing the work of others.
In the treatment condition, participants complete all three cases in a sequential two-step format: they first provide an initial answer without AI support, then receive AI advice and are given the opportunity to revise their answer. In the control condition, participants complete Case 1 and Case 2 without AI support only. In Case 3, both groups follow the same two-step procedure by first providing an initial answer, then receiving AI advice and being given the opportunity to revise.
The primary outcome is an ordinal measure of whether, and how strongly, participants revise their Case 3 answer toward, or away from, the AI recommendation after seeing it. The primary test compares this revision between treatment and control using ordinal logistic regression on the full eligible sample, without conditioning on the initial answer. Secondary analyses examine decision quality in Cases 1 and 2, confidence change, perceived mental effort, perceived task difficulty, and time-on-task. All AI messages are pre-written and fixed across participants. No live language model is used.
|
|
Field
Planned Number of Observations
|
Before
200 individuals with formal leadership responsibility, defined as at least one year of formal responsibility for leading, coordinating, or professionally directing the work of others. Recruitment will target this primary sample and data collection will continue until the pre-specified data collection end date. Participants without leadership experience may complete the experiment and may be retained as a secondary convenience sample, but they will not count toward the primary target sample and will not be included in the primary confirmatory analyses. No interim analysis of treatment effects will be used to determine whether recruitment continues or stops.
|
After
200 individuals with formal leadership responsibility, defined as at least one year of formal responsibility for leading, coordinating, or professionally directing the work of others. Recruitment will target this primary sample and data collection will continue until the pre-specified data collection end date. Participants without leadership experience may complete the experiment and may be retained as a secondary convenience sample, but they will not count toward the primary target sample and will not be included in the primary confirmatory analyses. No interim analysis of treatment effects will be used to determine whether recruitment continues or stops.
Preregistration update 15.08.2026: Initial data collection end date was set to 15.08.2026, but was extended to 01.09.2026 due to slow recruitment (94 respondenter in target group at initial data collection end date).
|