|
Field
Experimental Design (Public)
|
Before
*Overview*
This is a factorial vignette experiment in which participants – in this case, professional philosophers – see a subset of 10 vignettes, or "scenarios", drawn from a pool of 31 scenarios, with an option to see 10 more.
All the scenarios concern the hypothetical purchase, sale and production of mugs. They differ along three principal dimensions – the explicit exercise of power, the existence of inequality, whether it is relational – and four subsidiary dimensions – background luck, the satisfaction of basic needs, unjust power source and disrespect.
The full text from the survey (the initial email confirmation page and the main survey) is attached to this registry entry.
Our main hypotheses and an outline of our analysis plan are attached to this registry entry.
Individual choices are not incentivized, but participation will be, via the distribution of Amazon vouchers worth 200 USD (or local equivalent) sent to 10 randomly selected addresses from the set of respondents who complete the survey (and do not opt out of the prize draw).
*Subjects*
We will recruit philosophers (professional academics and graduate students) online, through two well-known philosophy blogs and a direct e-mail mail out. Subjects responding via the blog are required first to enter their institutional email address in an initial one-page “survey”, which then emails them a personalized link to the main survey. This enables us to confirm they are at a recognized academic institution.
The blogs are Leiter Reports: A Philosophy Blog (https://leiterreports.typepad.com) and Daily Nous (https://dailynous.com). Leiter Reports is the preeminent blog in professional philosophy, reporting “news and views about philosophy, the academic profession, academic freedom, intellectual culture, and other topics.” It is edited by Prof. Brian Leiter (Chicago), receives over 300,000 monthly visits, and is ranked 401,118 on alexa.com (as of 30 April 2022). Daily Nous is a similarly popular blog, reporting “news for and about the philosophy profession”. It is edited by Dr. Justin Weinberg (University of South Carolina), receives a similar number of monthly visits, and is ranked 263,056 on alexa.com (as of 30 April 2022).
[Update on May 18, 2022: Since launching on the two main blogs reporting news from the philosophy profession (Leiter Reports and Daily Nous) discussed above, we made connections with one additional blog and a list serv. A link to the survey was posted on Crooked Timber (https://crookedtimber.org) on May 17 and will be distributed to the Philos-L list serv (hosted by the University of Liverpool) on May 20. Our survey’s expiration date of July 4, 2022 remains valid for all data sources.]
A database of ~2600 professional philosophers’ emails was compiled from the addresses available on the websites of the world’s top rated philosophy departments, as ranked by the Philosophical Gourmet Report (https://www.philosophicalgourmet.com).
We selected many likely locations in the Trial Information section of this entry. Ours is a global (online) study so participation is possible from anywhere in principle, but "global" or "online" were not options in the Location field and we were required to enter at least one location.
*Exclusion criteria*
We will discard any responses linked to non-institutional email domains because it is important that we restrict responses to academic philosophers only (see notes on subject-recruitment below). We will discard responses from those declaring themselves to be undergraduate students. Data from those respondents will not be analyzed or presented.
Additional possible grounds for exclusion include response times so fast (e.g., within 2 seconds) that it is not credible that any attention was paid or incomplete survey responses. If we exclude any such data, we will report the exclusions, and report results both with and without the exclusions.
|
After
*Overview*
This is a factorial vignette experiment in which participants – in this case, professional philosophers – see a subset of 10 vignettes, or "scenarios", drawn from a pool of 31 scenarios, with an option to see 10 more.
All the scenarios concern the hypothetical purchase, sale and production of mugs. They differ along three principal dimensions – the explicit exercise of power, the existence of inequality, whether it is relational – and four subsidiary dimensions – background luck, the satisfaction of basic needs, unjust power source and disrespect.
The full text from the survey (the initial email confirmation page and the main survey) is attached to this registry entry.
Our main hypotheses and an outline of our analysis plan are attached to this registry entry.
Individual choices are not incentivized, but participation will be, via the distribution of Amazon vouchers worth 200 USD (or local equivalent) sent to 10 randomly selected addresses from the set of respondents who complete the survey (and do not opt out of the prize draw).
*Subjects*
We will recruit philosophers (professional academics and graduate students) online, through two well-known philosophy blogs and a direct e-mail mail out. Subjects responding via the blog are required first to enter their institutional email address in an initial one-page “survey”, which then emails them a personalized link to the main survey. This enables us to confirm they are at a recognized academic institution.
The blogs are Leiter Reports: A Philosophy Blog (https://leiterreports.typepad.com) and Daily Nous (https://dailynous.com). Leiter Reports is the preeminent blog in professional philosophy, reporting “news and views about philosophy, the academic profession, academic freedom, intellectual culture, and other topics.” It is edited by Prof. Brian Leiter (Chicago), receives over 300,000 monthly visits, and is ranked 401,118 on alexa.com (as of 30 April 2022). Daily Nous is a similarly popular blog, reporting “news for and about the philosophy profession”. It is edited by Dr. Justin Weinberg (University of South Carolina), receives a similar number of monthly visits, and is ranked 263,056 on alexa.com (as of 30 April 2022).
[Update on May 18, 2022: Since launching on the two main blogs reporting news from the philosophy profession (Leiter Reports and Daily Nous) discussed above, we made connections with one additional blog and a list serv. A link to the survey was posted on Crooked Timber (https://crookedtimber.org) on May 17 and will be distributed to the Philos-L list serv (hosted by the University of Liverpool) on May 20. Our survey’s expiration date of July 4, 2022 remains valid for all data sources.]
A database of ~2600 professional philosophers’ emails was compiled from the addresses available on the websites of the world’s top rated philosophy departments, as ranked by the Philosophical Gourmet Report (https://www.philosophicalgourmet.com).
We selected many likely locations in the Trial Information section of this entry. Ours is a global (online) study so participation is possible from anywhere in principle, but "global" or "online" were not options in the Location field and we were required to enter at least one location.
[Update on May 1, 2023: We expand the scope of the project to collect responses to the same pool of vignettes, from a non-academic pool of subjects, intended to be more representative of the population at large. We will use the platform Prolific to collect responses from 800 subjects. Other than the subjects themselves, the only differences in design are that we
(i) present these subjects with the 10 initial vignettes only (i.e., without the option to answer a further 10);
(ii) will not ask them the opinion and professional questions only relevant to academic philosophers;
(iii) will pay them for their work through the platform rather than with via an Amazon voucher lottery.
In terms of analysis, we intend to use these data to compare against those from academic philosophers. This is exploratory and we do not put forward any particular hypotheses.]
*Exclusion criteria*
We will discard any responses linked to non-institutional email domains because it is important that we restrict responses to academic philosophers only (see notes on subject-recruitment below). We will discard responses from those declaring themselves to be undergraduate students. Data from those respondents will not be analyzed or presented.
Additional possible grounds for exclusion include response times so fast (e.g., within 2 seconds) that it is not credible that any attention was paid or incomplete survey responses. If we exclude any such data, we will report the exclusions, and report results both with and without the exclusions.
|
|
Field
Randomization Unit
|
Before
The presentation of the scenarios is quasi-randomized within-subject: all participants first see the same two control scenarios, displayed in a random order, followed by a random selection of the remaining 29 scenarios. At most, one subject would see 20 of the total set of 31 scenarios.
|
After
The presentation of the scenarios is quasi-randomized within-subject: all participants first see the same two control scenarios, displayed in a random order, followed by a random selection of the remaining 29 scenarios. At most, one subject would see 20 of the total set of 31 scenarios.
[Update on May 1, 2023: Prolific subjects will see only the initial 10 scenarios, with no option to see a further 10.]
|
|
Field
Planned Number of Observations
|
Before
We expect to recruit several hundred participants. Due to the nature of the data collection process we do not restrict ourselves to a given sample size. Instead, we fix the amount of time the survey is live: the initial link will be posted on the blogs no earlier than May 16, 2022 (the exact date and time the blog owner posts the link is out of our control), we send the link to our database of email addresses on June 6, 2022 and a reminder to those who did not respond on June 20, 2022. We will close the survey at 12.00PM UTC on July 4, 2022. After that point, no more data can or will be be collected.
|
After
We expect to recruit several hundred participants. Due to the nature of the data collection process we do not restrict ourselves to a given sample size. Instead, we fix the amount of time the survey is live: the initial link will be posted on the blogs no earlier than May 16, 2022 (the exact date and time the blog owner posts the link is out of our control), we send the link to our database of email addresses on June 6, 2022 and a reminder to those who did not respond on June 20, 2022. We will close the survey at 12.00PM UTC on July 4, 2022. After that point, no more data can or will be be collected.
[Update on May 1, 2023: We will additionally collect data from 800 workers on the Prolific platform.]
|