Science by Consensus: Eliciting Citizens’ Research Funding Priorities

2025-05-22

2026-05-22

We will include the following outcome variables in the sample of citizens (C), policymakers (P), and experts (E).

1. Allocation to R&D: Continuous measure of the desired share of the total government spending on R&D (C, E, P)
2. 1(Allocation to R&D > current): Binary measure that takes a value of 1 if a participant’s desired share allocated to R&D is greater than the current allocation (3%) and 0 otherwise (C,E,P)
3. Social returns to R&D: Continuous measure of the beliefs about the social returns to R&D (C,E,P)

In specifications involving Citizens’ desired R&D spending, we will use quantile regressions to compare the change in the median view.

02/06/2025 Update: This version of the pre-registration was registered before collecting data from the Policymakers and Citizens samples. We have made two changes in this version. First, in the Policymakers' sample, we no longer plan to invite non-US policymakers to the study. Second, for Citizens, we plan to modify the treatments within one of the treatment dimensions. These changes are reflected below.

We conduct our study using samples of U.S. Citizens, Policymakers, and “Experts.”

For the Citizens’ sample, we will recruit 2,000 U.S. respondents using the data collection provider Bilendi. We will include quotas to ensure that our sample is representative of the U.S. population based on age, gender, income, education, and region. We exclude participants from the study when the demographic quotas have been met. We also exclude participants who fail our attention checks. Among those who completed the survey, we will exclude those who attempted to take the survey multiple times.

Policymakers are recruited via the Policymakers Lab at the University of Warwick, which hosts a panel of 200 policymakers working primarily in central governments around the world, and through our professional networks. All 67 U.S. policymakers part of the lab will be invited to participate in our study. In addition, we plan to reach out to about 50 Policymakers through our networks and invite them to participate in our survey. We expect a completion rate of 30-50%.

Finally, our sample of Experts consists of member heads at the various programs at the National Science Foundation (NSF), members and non-resident fellows at the Institute for Progress, economists who have participated in the NBER Science of Science Funding Summer Institutes from 2019 to 2025, and economists who have participated in the NBER Innovation Summer Institutes from 2014 to 2025. These Experts are invited via email to participate in our study. We aim to invite about 750 experts and expect about a third of them to complete the survey. In case we find difficulties with recruitment, we will reach out to editors at Nature and Science and experts at various funding agencies, such as the European Research Council (ERC), UK Research and Innovation (UKRI), Dutch Research Council (NWO), and Swiss National Science Foundation (SNSF).

Not available

Software-based randomization (Qualtrics)

Individual

No

Our final sample will include 2000 Citizens recruited from Bilendi. We plan to invite about 117 Policymakers via the Policymakers Lab and through our professional networks to participate in the survey, and expect a completion rate of 30-50%. Finally, we plan to invite about 750 Experts to participate in the survey, and expect about a third to complete the survey.

Same as the above, since the design is not clustered.

As explained above, Citizens are randomized into treatments in a 2x2 between-subjects design. The sample of 2000 Citizens would be randomized into one of these four cells in equal proportions. There are no randomizations in the sample of Policymakers and Experts.