Potential Biases in the Publication Process

Last registered on April 17, 2020

Pre-Trial

Trial Information

General Information

Title
Potential Biases in the Publication Process
RCT ID
AEARCTR-0005729
Initial registration date
April 16, 2020
Last updated
April 17, 2020, 12:56 PM EDT

Locations

Region

Primary Investigator

Affiliation
Loyola Marymount University

Other Primary Investigator(s)

PI Affiliation
Loyola Marymount University

Additional Trial Information

Status
In development
Start date
2020-05-01
End date
2020-08-31
Secondary IDs
Abstract
This project explores the existence and the degree of the different biases economists face in the publication process with the help of an experiment.
External Link(s)

Registration Citation

Citation
Ersoy, Fulya and Jennifer Pate. 2020. "Potential Biases in the Publication Process." AEA RCT Registry. April 17. https://doi.org/10.1257/rct.5729-1.0
Experimental Details

Interventions

Intervention(s)
Intervention Start Date
2020-05-01
Intervention End Date
2020-08-31

Primary Outcomes

Primary Outcomes (end points)
1. Guesses about whether a paper has been published and if yes, in which journal
2. Guesses about the number of citations a paper has
3. Guesses about the overall quality of the paper
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Subjects will receive 8 abstracts that belong to economics papers. These abstracts will vary along some dimensions. Subjects will be randomly assigned into one of the four treatments. Depending on the treatment, subjects will receive no information, partial information or full information about these abstracts. Subjects will answer questions regarding the quality of the abstracts. There will be a demographics questionnaire at the end.
Experimental Design Details
Subjects will receive 8 abstracts that belong to economics papers. These abstracts will vary along two dimensions: gender of the author and institution of the author. Subjects will be randomly assigned into one of the four conditions: no information, name information, institution information, name and institution information. In the no information treatment, subjects will not receive any information about the author of the paper. In the name information, subjects will know the name of the author. In the institution information, subjects will know the institution of the author. In the name and institution information, subjects will know both the name and the institution of the author. Subjects will answer questions regarding the quality of the abstract per each abstract. At the end of the survey, we ask our respondents a few demographic questions (gender, race, age, title, research area, institutional affiliation, journal affiliation) based on which we will conduct our heterogeneity analysis.
Randomization Method
Randomization is done using random.org.
Randomization Unit
Randomization unit is individual. Individuals are first stratified into 4 groups based on their journal affiliations, then randomly assigned to one of the 4 treatment groups.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
200 subjects
Sample size: planned number of observations
200 subjects
Sample size (or number of clusters) by treatment arms
50 subjects in each treatment arm
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Loyola Marymount University
IRB Approval Date
2020-03-17
IRB Approval Number
2020 SP 26 R

Post-Trial

Post Trial Information

Study Withdrawal

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials