Occupational Certifications and Employability

Last registered on October 31, 2025

Pre-Trial

Trial Information

General Information

Title
Occupational Certifications and Employability
RCT ID
AEARCTR-0017143
Initial registration date
October 30, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 31, 2025, 9:10 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Hunan University

Other Primary Investigator(s)

Additional Trial Information

Status
Completed
Start date
2018-10-01
End date
2019-02-27
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
We use a field experiment with triplets of resumes to causally identify how certification level, applicant ability, and job quality jointly affect employer callbacks. We show that advanced certifications raise callback rates by 42% relative to basic certifications, while intermediate certifications yield weak or insignificant gains. Effects are strongest for applicants with strong educational credentials, generating a Matthew effect in employability, where the advantages of certification accrue disproportionately to those already advantaged. Advanced certifications also increase the likelihood of matching to high-quality jobs. These findings isolate the signaling value of certification levels and show how they interact with education to shape access to employment opportunities.
External Link(s)

Registration Citation

Citation
Deng, Weiguang. 2025. "Occupational Certifications and Employability." AEA RCT Registry. October 31. https://doi.org/10.1257/rct.17143-1.0
Experimental Details

Interventions

Intervention(s)
In this experimental study, we implemented a randomized intervention to examine the impact of professional certifications on job application outcomes. The intervention consisted of the following key components:

Position Selection:

Randomly selected a sample of real job postings from the online recruitment platform
Ensured representation across various industries, company sizes, and position levels
Resume Preparation:

Created a set of baseline resumes with consistent core qualifications and work experience
Systematically varied certification information across different versions of the resumes
Maintained identical formatting and presentation across all resume variants
Application Procedure:

Simultaneously submitted the certification-variant resumes to the selected positions
Randomized the submission order to control for potential timing effects
Ensured consistent application content and submission method across all applications
Data Collection:

Tracked interview callback rates for each resume variant
Recorded response times and any additional feedback from employers
Maintained detailed logs of application statuses and outcomes
This intervention was designed to isolate the effect of certification information while controlling for other variables that might influence hiring decisions. The randomized, simultaneous submission approach ensures that our results reflect the true impact of certifications in real-world hiring scenarios.
Intervention (Hidden)
In this experimental study, we implemented a randomized intervention to examine the impact of professional certifications on job application outcomes. The intervention consisted of the following key components:

Position Selection:

Randomly selected a sample of real job postings from the online recruitment platform
Ensured representation across various industries, company sizes, and position levels
Resume Preparation:

Created a set of baseline resumes with consistent core qualifications and work experience
Systematically varied certification information across different versions of the resumes
Maintained identical formatting and presentation across all resume variants
Application Procedure:

Simultaneously submitted the certification-variant resumes to the selected positions
Randomized the submission order to control for potential timing effects
Ensured consistent application content and submission method across all applications
Data Collection:

Tracked interview callback rates for each resume variant
Recorded response times and any additional feedback from employers
Maintained detailed logs of application statuses and outcomes
This intervention was designed to isolate the effect of certification information while controlling for other variables that might influence hiring decisions. The randomized, simultaneous submission approach ensures that our results reflect the true impact of certifications in real-world hiring scenarios.
Intervention Start Date
2018-10-02
Intervention End Date
2018-12-31

Primary Outcomes

Primary Outcomes (end points)
The primary outcomes of this study focus on measuring the impact of professional certifications on job application outcomes through the following key metrics:
1. Interview Callback Rate:
o Percentage of resumes receiving interview invitations
o Comparison of callback rates between certified and non-certified applicants
o Analysis of callback rates across different certification levels
2. Position-Specific Outcomes:
o Variation in callback rates across different job categories
o Industry-specific response patterns to certification information
o Position-level analysis of certification effects
3. Certification Effect Size:
o Quantitative measurement of certification impact on callback probability
o Comparison of effect sizes across different certification types and levels
o Analysis of interaction effects between certifications and other resume attributes
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
1. Study Objective:
To empirically examine the impact of professional certifications on job application outcomes in real-world hiring scenarios.
2. Research Design:
Randomized controlled field experiment using actual job postings and modified resumes.
3. Sample Selection:
o Randomly selected 1500 active job postings across various industries and position levels
o Ensured geographic and sectoral diversity in the sample
4. Resume Development:
o Created base resumes with consistent qualifications and experience
o Developed 3 certification variants for each base resume:
 Entry-level certification
 Intermediate certification
 Advanced certification
o Maintained identical formatting and content structure across all variants
5. Application Procedure:
o Simultaneously submitted all resume variants to each selected position
o Randomized submission order to control for timing effects
o Used standardized application materials and submission methods
6. Analysis Plan:
o Primary analysis: Comparison of callback rates across certification groups
o Secondary analyses:
 Certification level effects
 Industry-specific patterns
 Position-level variations
 Interaction effects with other resume attributes
7. Expected Contributions:
• Practical insights for job seekers on certification value
• Evidence-based recommendations for hiring practices
• Contribution to academic literature on human resource management
This experimental design ensures rigorous, replicable, and ethically sound investigation of certification effects in the job market.
Experimental Design Details
Randomization Method
1. Job Posting Selection:
o Used stratified random sampling to select 1500 job postings
o Stratified by industry, company size, and position level
o Ensured proportional representation across strata
2. Resume Variant Assignment:
o Randomly assigned 3 certification variants to each base resume
o Used computer-generated random numbers for assignment
o Ensured equal distribution of variants across job postings
3. Application Submission Order:
o Randomized the order of resume submissions for each job posting
o Used a random permutation algorithm to determine submission sequence
o Controlled for potential timing effects
Randomization Unit
individual
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
1500
Sample size: planned number of observations
4000
Sample size (or number of clusters) by treatment arms
4000
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials