Back to History Current Version

Structural Analysis of Xenophobia

Last registered on August 26, 2020

Pre-Trial

Trial Information

General Information

Title
Anti-Asian Racism during COVID-19
RCT ID
AEARCTR-0006365
Initial registration date
August 26, 2020

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
August 26, 2020, 11:47 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Johns Hopkins University

Other Primary Investigator(s)

PI Affiliation
Johns Hopkins University

Additional Trial Information

Status
On going
Start date
2020-08-26
End date
2020-12-31
Secondary IDs
Abstract
This is a registry for our pilot survey. We aim to examine how biased media reports on COVID-19 may affect anti-Asian racism. We will do a randomized controlled trial by showing a real CNN news clip. The treatment group will watch a potentially racially biased news clip about COVID-19, while the control group will watch a neutral news clip on health advice. We will estimate the treatment effect on anti-Asian sentiment, perception about racism, and racist behaviors. To measure racist behaviors, we will use three outcome measures: a donation question, a dictator game, and a petition question. The dictator game is an incentivized survey item with real money at stake, and the other two questions ask about intentions to donate and to sign a petition.
In the pilot survey, we will randomize different survey formats to understand how they affect the estimation of continuous latent variables, such as attitude and perception. One half of survey participants will respond to a questionnaire using Likert scale and another half will respond to a questionnaire using Slider. Using survey responses from two different formats, we will estimate the nonparametric densities of latent variables and will discuss which survey method can provide responses that are more aligned with standard identification assumptions in the measurement error literature.
External Link(s)

Registration Citation

Citation
Deng, Huan and Yujung Hwang. 2020. "Anti-Asian Racism during COVID-19." AEA RCT Registry. August 26. https://doi.org/10.1257/rct.6365-1.0
Experimental Details

Interventions

Intervention(s)
We will randomly show different CNN news clips for 100 seconds. The treatment group will watch a potentially racially biased news clip about COVID-19. The control group will watch a neutral news clip on health advice.
In addition to the RCT, we will randomize the survey formats to understand their impact on the estimation. Half of survey sample will respond to a questionnaire using Likert scale and another half will respond to a questionnaire using Slider. Using pilot survey responses from two different formats, we will estimate the nonparametric densities of latent variables and we will discuss which survey method is better to apply the standard econometric techniques to study measurement errors.
Intervention Start Date
2020-08-26
Intervention End Date
2020-09-09

Primary Outcomes

Primary Outcomes (end points)
We have three primary sets of outcome variables.
The first set of outcome variables is about anti-Asian sentiments. The second set of outcome variables is about perception about racism in the US. The third set of outcome variables is three measurements of discriminatory behaviors.
Primary Outcomes (explanation)
We collect multiple measurements for each set of outcome variables, not to cherry-pick the most responsive survey items later, but to apply nonparametric estimation techniques to estimate measurement errors. Having multiple measurements is one of the essential identifying assumptions.
The first set of outcome variables on anti-Asian sentiment is a shorter version of the realistic threat measure, intergroup anxiety and prejudice measures used in Stephan et al. (1999). The second set of outcome variables on perception about racism in the US is measured by asking how much respondents agree to five statements. The statements are (1) whether typical American citizens might feel annoyed at racial stereotype jokes, (2) whether typical American citizens will follow a manager with racial bias as long as the person delivers results, (3) whether a person who publicly claims to be a racist can maintain good social relationships with most people, (4) whether typical American citizens will tolerate racial bias to some degree, as long as it does not violate the law evidently, and (5) if a person refers to the novel corona virus as “China virus”, the person will face severe criticism.
The third set of outcome variables is about discriminatory actions. We will ask three questions: a donation question, a dictator game, and a petition question. The dictator game is an incentivized survey item with real money at stake, and the other two questions ask about intentions to donate and to sign a petition. In a donation question, we present descriptions about two organizations with opposing attitudes to Asians: the Center for Immigration Studies (CIS) and the Asian Pacific Policy & Planning Council (A3PCON). Next, we ask to which organization and how much respondents are willing to donate if they are given $10. If they choose to donate to CIS, the racist action is coded as 1. In a dictator game, we randomly match respondents with two other survey participants, who responded to donate to the CIS and A3PCON, respectively. Next, we ask respondents to split $1 between themselves and their matched partners. To remove deception, we will randomly select 10% of survey sample and will make actual payment to survey participants based on responses. We will explain that their answers will not affect the probability of winning the lottery. We repeat dictator games twice with two different partners (CIS or A3PCON) to remove individual fixed effect, which includes generosity in sharing money with someone else. We randomize the order of two dictator games to remove any order effect. If survey respondents share more money with a partner who donated to CIS than with a partner who donated to A3PCON, the racist action is coded as 1. In the petition question, we present two different petition forms, with one urging to protect the United States’ interests from Chinese threats and another urging to protect safety and rights of Asian Americans in the US. We ask which petition survey participants would like to sign. If they choose to sign a petition to protect the US from Chinese threats, the racist action is coded as 1.


Reference
Stephan, Walter G., Oscar Ybarra, and Guy Bachman. "Prejudice toward immigrants 1." Journal of Applied Social Psychology 29.11 (1999): 2221-2237.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
To screen out survey participants who pay little attention to the survey, we have inserted an attention check question just before implementing our video intervention. In an attention check question, we ask respondents how they are currently feeling, but we tell them to check only “None of the above” option in the middle of the question. Survey participants who fail to pay attention to our message and thus choose any other choices will be screened out.
Experimental Design Details
To screen out survey participants who pay little attention to the survey, we have inserted an attention check question just before implementing our video intervention. In an attention check question, we ask respondents how they are currently feeling, but we tell them to check only “None of the above” option in the middle of the question. Survey participants who fail to pay attention to our message and thus choose any other choices will be screened out.
Randomization Method
We randomize using a Qualtrics randomizer.
Randomization Unit
We do individual level randomization.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
360 in pilot survey and 3000 in main survey.
Sample size: planned number of observations
360 in pilot survey and 3000 in main survey.
Sample size (or number of clusters) by treatment arms
50% of sample is in treatment arm and 50% of sample is in control arm.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
We will compute MDE using the pilot data, which is yet to be collected.
IRB

Institutional Review Boards (IRBs)

IRB Name
Homewood Institutional Review Board
IRB Approval Date
2020-08-20
IRB Approval Number
HIRB00011674
IRB Name
Homewood Institutional Review Board
IRB Approval Date
2020-08-17
IRB Approval Number
HIRB00011673

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials