Personality tests and entrepreneurship

Last registered on March 31, 2023

Pre-Trial

Trial Information

General Information

Title
Personality tests and entrepreneurship
RCT ID
AEARCTR-0011169
Initial registration date
March 31, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 31, 2023, 11:23 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region
Region

Primary Investigator

Affiliation
Stanford University

Other Primary Investigator(s)

Additional Trial Information

Status
On going
Start date
2023-03-21
End date
2023-06-18
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The study provides a methodological contribution to the circumstances under which personality tests can be used effectively in the context of supporting entrepreneurs in developing countries. It tests whether personality tests are valid in these contexts and assesses the degree to which individuals are able and willing to “fake” their personality test results. Furthermore, the study tests whether gender differences in honesty and stereotype threat affect outcomes of otherwise equally qualified individuals and evaluates the extent to which the use of high cognitive load can reduce “faking” and any gender-based disadvantage in the use of personality tests.
External Link(s)

Registration Citation

Citation
Zempleni, Reka. 2023. "Personality tests and entrepreneurship." AEA RCT Registry. March 31. https://doi.org/10.1257/rct.11169-1.0
Experimental Details

Interventions

Intervention(s)
Intervention (Hidden)
The study is an online lab in the field experiment with various treatment arms. Participants answer personality test items twice, under different framings/incentives. Participants first complete the items under one of the following framings: honest, incentivized to be entrepreneurial, incentivized to be entrepreneurial with a cognitive load manipulation (time pressure), incentivized to appear entrepreneurial, or evaluation mode. The evaluation mode means that participants are asked to select the options the best business loan applicants would select and the more similar their scoring is to the one used by the researcher, the more bonus payment they receive. The second time all participants complete the test items in evaluation mode except for the ones who started with that. This group completes the test items under the honest framing.

Intervention Start Date
2023-03-21
Intervention End Date
2023-06-18

Primary Outcomes

Primary Outcomes (end points)
Entrepreneurial score and Honesty
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Online survey with an RCT approach. (Details hidden)
Experimental Design Details
The study is designed to use an online lab experiment setting to mimic the environment of a lender or investor wanting to use personality tests as a source of information for selection decisions. Some of the treatments (framings) create this environment (where participants can get the option of a highly paid task if their score on the test is among the most entrepreneurial ones) with some modifications (increased cognitive load through time pressure or removing the personal cost of lying by asking to appear entrepreneurial). The rest of the treatments use an honesty framing.

The main outcomes are measured as follows:
Entrepreneurial score (measured by performance in an entrepreneurial game and some logic and financial literacy puzzles) and Honesty (measured as following through on completing a task after the main survey is done)
The main treatment arms are incentivized as follows:
- Honest: you receive a personalized assessment including advice that might be helpful
- Evaluation mode: bonus payment, up to $0.40, the closer the answers to the researcher's criteria, the more
- Other three conditions: the top scorers are invited to a short follow up call for a compensation of $50
The Entrepreneurial score measures are also incentivized using a piece rate.
For the Honesty measure, participants agree to get an additional $1.50 bonus payment now in exchange for promising to complete a short follow up task at a later time, receiving no payment at the time of completion.

The study is implemented in 3 parts, using volunteer Stanford alumni participants, paid India based Amazon MTurk workers, and US based Prolific workers. The Stanford alumni participants select a nonprofit of their choice and the bonus payments they collect are donated to the nonprofit of their choice while the other two groups receive bonus payments themselves.
The Stanford Alumni data collection began on 3/21, the Mturk data collection will begin on 3/31 and the Prolific data collection will start in April.

The goal of the study is to test the susceptibility of the personality test results to the framing and incentives used, to test their predictive power on the key outcomes of interest (and on the product of the two key outcomes of interest, that an investor or lender would care about). Additionally, the study aims to test any gender differences in the scores and whether some of the treatments can mitigate them. Additionally, the study aims to test differences between geographies (India vs US) and between highly educated populations and others (Stanford alumni vs Mturk and Prolific workers).
Randomization Method
Qualtrics software
Randomization Unit
Individual participants.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
Individual units are used, no clusters
Sample size: planned number of observations
Approximately 300 from each of the three sources.
Sample size (or number of clusters) by treatment arms
1/9: evaluation then honest (control)
2/9: honest then evaluation
2/9: incentivized
2/9: incentivized with cognitive load
2/9: incentivized to appear
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
Administrative Panel on Human Subjects in Non-Medical Research of Stanford University
IRB Approval Date
2023-08-03
IRB Approval Number
61388

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials