Experimental Design Details
EMPIRICAL FACT QUESTIONS
- Police shootings: In 2015, the Washington Post began to log every fatal shooting by an on-duty police officer in the United States.
For context:
As of 2019, the US population was approximately 12.8% Black.
In 2019, according to the FBI, among people arrested for violent crimes, approximately 36.4% were Black.
What is your best estimate of the percentage of people fatally shot by police (from 2015 through 2020) who were Black (amongst those whose race was known)?
- Climate change: Climate scientists at NASA's Goddard Institute for Space Studies maintain records on global average temperatures since 1880.
How many of the 20 hottest years on record would you estimate have occurred since the year 2000, according to the NASA data?
- Affirmative action: Elite colleges and universities such as Harvard have a very restricted number of slots to which they admit applicants for undergraduate study each year.
Harvard states that it "does not discriminate against applicants from any group in its admissions processes."
According to data released by Harvard University, between 1995 and 2013, the average SAT score for admitted White students was 2234 out of 2400.
What is your best estimate of the average SAT score (out of 2400) for admitted African-American students over the same time period, according to Harvard's data?
- Income taxation: Every year, the Internal Revenue Service (IRS) releases data on income and taxation in the United States. From this data, the share of federal income tax paid by the top 1% of income-earners can be computed.
For context:
According to the IRS, 21% of all income was earned by the top 1% of income-earners.
What is your best estimate of the share of federal income tax that was paid by the top 1% of income-earners in 2019, according to the IRS data?
- Economic Mobility: The Internal Revenue Service (IRS) maintains an archive of historical tax return data from individual taxpayers. This data can be linked across generations and used to compute estimates of social mobility -- such as the fraction of children born to families in the bottom 20 percentiles of income who themselves made it into the top 20 percentiles of income at the same point later in their life.
Consider the poorest 20 percentiles of children, as measured by their parents' income in early adulthood. Then:
If there was no relationship between parent and child income, 20% of these children would themselves make it into the top 20 percentiles of income at the same age later in life.
0% corresponds to none of these children making it into the top 20 percentiles of income at the same age later in life.
100% corresponds to all of these children making it into the top 20 percentiles of income at the same age later in life.
Consider the poorest 20 percentiles of children, as measured by their parents' income in early adulthood.
What is your best estimate of the share of these children who themselves make it into the top 20 percentiles of income at the same age later in life, according to the IRS data?
- Zoning: Zoning laws regulate land-use. They restrict the types of buildings and/or activities that are permitted in certain areas within communities. Common motives for zoning laws include environmental concerns, neighborhood beautification, or preferences of the existing population for maintaining the community's size and character.
Research has suggested, however, that by constraining the supply of housing, restrictive zoning laws can increase rents and home prices.
For context:
According to an index compiled by the Cato Institute which measures land-use regulation, California has the 4th-most restrictive land-use regulations in the United States while Nevada has the 26th-most restrictive land-use regulations.
According to the US Census Bureau, as of 2019, the Las Vegas metropolitan area has 0.7% of total US population while the Los Angeles metropolitan area has 5.7% of total US population.
The Census Bureau compiles data on the number of building permits issued for the construction of new single-family homes in the United States. Between 2015 and 2019, 1.2% of those permits were issued in Las Vegas.
What percentage of permits do you think were issued in Los Angeles?
- Olympics: The modern Olympics games have occurred since 1896. According to the International Olympic Committee (IOC), counting both summer and winter Olympics (through 2018), the ten athletes who have won the most gold medals have won a total of 99 gold medals between them.
Of course, some sports provide more opportunities for an individual athlete to win many medals.
What is your best estimate of the number of gold medals won by American swimmer Michael Phelps?
NORMATIVE BELIEFS QUESTIONS
Police Shootings:
Normative Belief Question A: Do you believe that police in the US are systemically racist against Black people?
Normative Belief Question B: Do you support “defunding the police,” which entails reducing funding for police departments and reallocating that funding toward social services such as counseling, healthcare, and public housing?
Climate Change:
Normative Belief Question A: Do you support stronger government action to combat climate change, even if it requires higher taxes?
Normative Belief Question B: Do you believe that the global average temperature is warming due primarily to human activity?
Affirmative Action:
Normative Belief Question A: Do you think the Supreme Court should ban universities from using race as a factor in admission decisions? (Universities argue that affirmative action is key to improving representation of minorities.)
Normative Belief Question B: Do you think that affirmative action causes lower performing and less deserving students from underrepresented minority groups to take places that otherwise would be earned by more deserving students of other races?
Income Taxation:
Normative Belief Question A: Do you support higher taxes on the top 1% of income-earners?
Normative Belief Question B: Do you think the top 1% of income-earners excessively use loopholes to avoid paying their fair share of taxes?
Economic Mobility:
Normative Belief Question A: Do you believe that hard work doesn't generally bring success; luck and connections are more important?
Normative Belief Question B: Do you think that most wealthy people are only wealthy because of inheritance and/or family privilege?
Zoning:
Normative Belief Question A: Do you think zoning laws (often promoted for their environmental, aesthetic, and other benefits) are too restrictive and should be relaxed?
Normative Belief Question B: Do you think that differences in zoning laws substantially explain why some parts of the US (e.g. San Francisco, New York City) have extremely high housing prices relative to other areas (e.g. Houston, Orlando)?
Olympics:
Normative Belief Question A: Do you believe Michael Phelps is the greatest Olympic athlete of all time?
Normative Belief Question B: Do you believe Michael Phelps is the greatest swimmer of all time?