Experimental Design
We randomly assigned eligible agricultural producers in the study area to either a treatment or control group. Treatment and control groups remain the same throughout the trial. Eligibility was based on ownership of one or more wells in the study area. The treatment group of producers received a mailer during the beginning of the 2019, 2020, and 2021 growing seasons which compared 2018 groundwater use of up to three wells that they own to groundwater wells within their groundwater management district (GWMD) in Colorado or county in Kansas. Note that the trail was not conducted in Kansas in 2019.
The mailer graphically provided treated producers with information comparing the groundwater use of up to three of the wells that they own to well-level mean groundwater use and the groundwater use of the 20th percentile well in the GWMD/county. The mailer also indicated the percentile of the GWMD/county groundwater use distribution for each of their wells, using the following language “Comparing your YEAR water use to other wells in the YY GWMD/county, your well(s) recorded use higher than X% of wells.”
Many agricultural producers in our study area operate multiple wells. The assignment to treatment or control groups occurred at the producer level, not the well level. Producers receiving the treatment mailers were provided with well-level comparison information, but due to size constraints on the mailer, recipients were provided comparisons for a maximum of three wells. For producers that own or operate more than three wells, we limit the well-level comparison information to the three wells that utilized the most water in the previous year. We also exclude wells that rank less than the 5th percentile among wells within their comparison group. An exception to this rule is if a well owner's wells used ranked above the 5th percentile in the initial mailing and then less than the 5th percentile in subsequent mailings. These well owners continue to receive mailers to maintain the same treatment and control groups throughout the trial. Finally, some producers operate and own wells within multiple GWMDs/counties. For these producers we determine their comparison group based on the GWMD/county the majority of their wells are located within.
To assign agricultural producers to treatment or control we follow a block randomization methodology wherein we block at the GWMD/county level and on past water use compared to their comparison group’s average. Specifically, we generate a variable that indicates whether a producer’s 2018/2019 water use averaged across all their wells exceeded the median well-level water use within their comparison group (2018 for Colorado and 2019 for Kansas). This blocking protocol resulted in 14 mutually-exclusive blocking groups. Assignment of producers to treatment or control was conducted using R’s randomizr package, which in Colorado assigned 487 producers into the treatment group and 489 into the control group based on 2018 pumping data. The same blocking protocol was used in Kansas based on 2019 data and resulted in the assignment of 1414 producers into the treatment group and 1414 into the control group