Replication of “Is Pay for Performance Detrimental to Innovation?”

Last registered on March 07, 2025

Pre-Trial

Trial Information

General Information

Title
Replication of “Is Pay for Performance Detrimental to Innovation?”
RCT ID
AEARCTR-0015485
Initial registration date
March 03, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 07, 2025, 7:50 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Shanghai Jiao Tong University

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2025-03-10
End date
2025-03-21
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This study aims to replicate the key findings of Ederer and Manso (2013), an influential paper applying incentivized laboratory experiments to the study of entrepreneurship and innovation. Using the same experimental design involving a lemonade stand task, we will randomly assign subjects to three incentive conditions: fixed wage, standard pay-for-performance, and an "exploration" contract that tolerates early failure but rewards long-term success. We will test the original hypotheses that subjects under the exploration contract will engage in more exploratory behavior and be more likely to discover the optimal business strategy compared to the other conditions. We will measure exploration through subjects' location choices and variability in product decisions, as well as their final performance. The experiment will be conducted at Shanghai Jiao Tong University Smith Experimental Economics Research Center using the same program and instruction as the original study (with translation). A standard Snowberg/Yariv survey will be conducted. By replicating this study with a new sample, we aim to assess the reliability and generalizability of the original findings on how compensation structures impact innovation. The results will have implications for designing incentive schemes to motivate exploration and innovation in organizational settings.
External Link(s)

Registration Citation

Citation
Jiang, Ming. 2025. "Replication of “Is Pay for Performance Detrimental to Innovation?”." AEA RCT Registry. March 07. https://doi.org/10.1257/rct.15485-1.0
Experimental Details

Interventions

Intervention(s)
incentives affect innovation and exploration behavior. Participants will be randomly assigned to one of five treatment conditions:

Fixed wage: Participants receive a fixed payment per period regardless of performance.

Pay-for-performance: Participants receive a percentage of the profits they generate throughout the entire experiment.

Exploration contract: Participants receive a percentage of the profits they generate only during the second half of the experiment.

Termination: Participants receive a percentage of profits generated in the second half of the experiment, but if their performance falls below a threshold in the first half, the experiment ends early.

Golden parachute: Same as termination, but participants receive a compensation payment if terminated early.

All participants will complete a task that involves operating a lemonade stand where they must make decisions about location, price, and product attributes. The task is designed to create a tension between exploiting a known strategy and exploring potentially better but initially unknown strategies.
Intervention (Hidden)
Intervention Start Date
2025-03-10
Intervention End Date
2025-03-21

Primary Outcomes

Primary Outcomes (end points)
Innovation success: Measured by whether participants discover and choose the optimal business strategy (selling at the school location with appropriate product attributes) by the final period of the experiment.

Exploration behavior: Measured by:
Proportion of periods in which participants choose locations other than the default business district
Subject-specific standard deviation of strategy choices for continuous variables (sugar content, lemon content, price)
Time until subjects stop exploring (based on hazard rate models)

Performance: Measured by:
Maximum per-period profit achieved
Final-period profit
Average profit across all periods

Effort: Measured by:
Time spent on decision screens
Completeness of participants' record-keeping in the provided decision tables
Heterogeneous treatment effects: Examining how risk aversion moderates the effectiveness of different incentive schemes.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The experiment design will follow exactly at the original study this study tries to replicate, other the instruction language (Chinese instead of English), experimental platform (oTree instead of zTree), and payment (standard hourly payment at Smith Experimental Economics Research Center at Shanghai Jiao Tong University).
Experimental Design Details
Randomization Method
randomization of treatment at session level, determined by computer
Randomization Unit
individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
at least 379
Sample size: planned number of observations
at least 379
Sample size (or number of clusters) by treatment arms
fixed wage: 51; pay-for-performance: 46; exploration: 47; termination: 71; golden parachute: 78.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
the same number of observation as the original study
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials