Does Anti-Americanism Benefit Incumbents in Russia?

Last registered on July 15, 2019

Pre-Trial

Trial Information

General Information

Title
Does Anti-Americanism Benefit Incumbents in Russia?
RCT ID
AEARCTR-0004448
Initial registration date
July 15, 2019

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 15, 2019, 9:56 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
George Washington University

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2019-07-18
End date
2020-09-30
Secondary IDs
Abstract
This study investigates whether Russian President Putin gains support from anti-Americanism through a priming experiment. Apart from a control group, four randomly selected subsets of individual in the study are primed to have in mind: international relations generally (a placebo); a statement about United States hostility to Russia; a statement by Vladimir Putin on United States hostility to Russia; and a statement by Vladimir Putin calling for better relations with the United States. The study then assesses whether these primes are associated with different levels of support for Putin using two different indicators. The study will also explore whether effects vary by anti-Americanism measured prior to the experiment in the same survey as well as by key demographics including age, gender, education, and ethnicity.
External Link(s)

Registration Citation

Citation
Hale, Henry. 2019. "Does Anti-Americanism Benefit Incumbents in Russia?." AEA RCT Registry. July 15. https://doi.org/10.1257/rct.4448-1.0
Former Citation
Hale, Henry. 2019. "Does Anti-Americanism Benefit Incumbents in Russia?." AEA RCT Registry. July 15. https://www.socialscienceregistry.org/trials/4448/history/50039
Experimental Details

Interventions

Intervention(s)
All respondents in a sample of adults in the Russian Federation designed to be nationally representative are asked two questions designed to assess support for the president. The sample is randomly divided into five parts, each one receiving a different preamble to the first question on support for the president. The first preamble is a control. The second preamble is a placebo treatment reminding individuals that the president handles international relations. The remaining three preambles include: a statement about United States hostility to Russia; a statement by Vladimir Putin on United States hostility to Russia; and a statement by Vladimir Putin calling for better relations with the United States.
Intervention Start Date
2019-07-18
Intervention End Date
2019-07-24

Primary Outcomes

Primary Outcomes (end points)
One outcome variable is a simple question asking people to specify whether they strongly support, tend to support, tend not to support, or definitely do not support Putin’s activity as president. A second outcome variable draws from social psychology literature on affective attachment, asking people to state the extent to which they agree or disagree (on a four-point scale) with the statement that they feel personally insulted when someone criticizes Putin in their presence. The latter question has, in Russia, generally yielded fewer positive answers than are elicited from standard questions of support like the first question here.
Primary Outcomes (explanation)
The outcome of primary interest is the differences in the frequency of responses given to the two questions of Putin support by respondents in the different treatment subsamples. These differences will enable the researcher to assess whether having anti-American sentiments in mind helps or hurts support for Putin, and the extent to which such effects can be shaped by Putin’s own leading.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The experiment is embedded in the monthly omnibus survey of the highly reputable independent Russian firm Levada Market Research (LMR), using their standard methodology.
Experimental Design Details
The experiment is embedded in the monthly omnibus survey of the highly reputable independent Russian firm Levada Market Research (LMR), using their regular multi-stage area probability sample designed to be representative of the adult Russian Federation population. Interviews are conducted face-to-face, with tablets (the CAPI method) used for about four-fifths of the sample. For the remaining roughly one-fifth of the sample, visual aids are presented on and answers are recorded on paper (the PAPI method). Based on data from the Russian state statistical agency in 2015, LMR’s sample is distributed among the country’s eight federal districts and the capital city Moscow, with each district divided into five strata proportionally to adult population size. All cities with a population of over one million are included as self-representative units; in the remaining (non self-representing) strata, probability proportional to size (PPS) is used to elect 1-10 urban settlements (or rural districts in rural areas). The number of interviews in a given stratum is divided equally among selected settlements. In total, 137 primary sampling units (PSUs) are drawn, including 99 urban settlements and 38 rural districts in 48 subjects of the federation (official federation-forming regions). In each selected settlement, two electoral districts (or two villages in a rural district, 18 districts in Moscow, and 8 districts in St. Petersburg) are selected at random from a complete list of electoral districts (or villages where appropriate), resulting in about 280 secondary sampling units (SSUs). Selection of households is accomplished by the random route method using route lists, and one eligible adult per household is selected according to gender, age, and education level. People institutionalized in prisons or hospitals, people conscripted into the military, the homeless, and people living in very remote, difficult-to-access, or extremely small settlements are excluded from the sample.
Randomization Method
Roughly equal proportions of CAPI and PAPI respondents will receive each treatment. For the CAPI respondents in the sample, randomization is achieved using the randomization feature of the software Simpleforms, designed specifically for survey research. For the PAPI respondents in the sample, the research uses the randomization feature of the software Microsoft Excel to randomly assign one of the five versions of the randomized-preamble question described above to the number of each questionnaire to be administered as part of LMR’s omnibus survey. The survey agency then creates single-page “inserts,” with each insert containing only the correct version of the question to be administered for its assigned questionnaire and the number of that assigned questionnaire. The inserts are then inserted into the questionnaire assigned to that insert. The questionnaire itself (independently of the insert) contains not the actual question, but instructions for the enumerator to use the insert and instructions for recording the respondent’s response (count).
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
137 PSUs
Sample size: planned number of observations
1602 people
Sample size (or number of clusters) by treatment arms
Approximately 320 control, 320 each for the four treatments
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
George Washington University
IRB Approval Date
2019-07-02
IRB Approval Number
031629
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials