The Impact of AI-assistance on Recruitment Judgment

Last registered on May 09, 2024

Pre-Trial

Trial Information

General Information

Title
The Impact of AI-assistance on Recruitment Judgment
RCT ID
AEARCTR-0013527
Initial registration date
April 29, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
May 09, 2024, 2:09 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
University of Michigan

Other Primary Investigator(s)

PI Affiliation
University of Michigan

Additional Trial Information

Status
In development
Start date
2024-04-29
End date
2026-05-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The increasing prevalence of artificial intelligence (AI) in job application process raises questions about its influence on recruiters' perceptions and decisions. This study aims to investigate the effects of perceived AI assistance and actual AI assistance usage in application materials on recruiters' judgments of job applicants. To address this question, we will conduct an experiment involving a simulated job opening for research assistants. Lab participants, such as students, will be asked to submit their resumes, write a cover letter based on the job position and complete a technical test.The primary participants in this study will be recruiters, who will evaluate candidates after reviewing their resumes and cover letters. We will employ a 2x2 experimental design, manipulating both the perceived use of AI assistance and the actual use of AI assistance in the cover letters. By analyzing the differences in how recruiters evaluate applicants under different conditions of perceived and actual AI assistance usage, we seek to understand their impact on recruiters' judgments. The findings of this study will contribute to the growing body of research on the role of AI in hiring processes and its potential implications for applicants and organizations.
External Link(s)

Registration Citation

Citation
Qiu, Jingyi and Qingyi Wang. 2024. "The Impact of AI-assistance on Recruitment Judgment ." AEA RCT Registry. May 09. https://doi.org/10.1257/rct.13527-1.0
Experimental Details

Interventions

Intervention(s)
Please refer to the pre-analysis plan.
Intervention Start Date
2024-04-29
Intervention End Date
2024-09-30

Primary Outcomes

Primary Outcomes (end points)
Please refer to the pre-analysis plan.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Please refer to the pre-analysis plan.
Experimental Design Details
Not available
Randomization Method
randomization done in office by a computer
Randomization Unit
individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
NA
Sample size: planned number of observations
200 participants
Sample size (or number of clusters) by treatment arms
100 in the high group, 100 in the low group
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Michigan
IRB Approval Date
2024-04-05
IRB Approval Number
HUM00252659
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information