Back to History

Fields Changed

Registration

Field Before After
Trial Status in_development completed
Last Published June 26, 2023 02:10 PM March 20, 2024 09:13 AM
Intervention (Public) This project studied several interventions designed to encourage addresses to make use of the local lead service line self-inspection program, which allows residents to submit photos of their service lines to have their material identified. Addresses will be assigned to one of the following treatments: an informational treatment consisting of distributed materials explaining the program, or a financial incentive treatment consisting of the same materials, but with the offer of a gift card reward for participating in the program. Addresses that do not respond to treatment after one month will receive one of the following cross-randomized treatment enhancements to allow us to estimate the costs and impacts of varied treatment intensities to inform policy feasibility at scale in Phase 2: either a repeat of their original treatment, or in-person follow-up by field staff offering to help them complete the self-inspection. This project studied several interventions designed to encourage addresses to make use of the local lead service line self-inspection program, which allows residents to submit photos of their service lines to have their material identified. Addresses will be assigned to one of the following treatments: an informational treatment consisting of distributed materials explaining the program, or a financial incentive treatment consisting of the same materials, but with the offer of a gift card reward for participating in the program. Addresses that do not respond to treatment after one month will receive one of the following cross-randomized treatment enhancements to allow us to estimate the costs and impacts of varied treatment intensities to inform policy feasibility at scale in Phase 2: remote outreach via email, SMS, or both requesting them to complete the self-inspection.
Experimental Design (Public) This study focuses on the impact of different outreach and engagement methods designed to encourage households to submit a self-inspection of their service lines to help the local utility identify which addresses have lead service lines connecting them to the water system. Each address in our sample of 9,000 is assigned to one of three roughly equal-sized experimental groups of 3,000 addresses – Treatment 1 (information only), Treatment 2 (information and financial incentive), or Control (no further outreach or incentive). Participating households will submit photos of their service line online, following instructions to ensure they are of sufficient quality for trained staff to identify the service line material. For Phase 2, after one month, we will randomize all addresses that were assigned to Treatment 1 or 2 but did not respond to the intervention into one of three, equal-sized, cross-randomized, secondary treatments – Secondary Treatment 1 (repeat initial treatment), Secondary Treatment 2 (in-person follow-up), or Control (no additional treatment). In the in-person follow-up, staff will make several attempts to make contact with the resident, and will offer to assist them in completing the self-inspection, including providing a device to use for taking and submitting the photos. We will principally examine the difference in uptake between each of these interventions and the control. We will also compare the difference in uptake between different levels of financial incentive to trace demand curves for the program, and will examine the prevalence of lead among respondents at different levels of incentive to assess if households that already know they do not have lead are less likely to participate in the absence of a high incentive. This study focuses on the impact of different outreach and engagement methods designed to encourage households to submit a self-inspection of their service lines to help the local utility identify which addresses have lead service lines connecting them to the water system. Each address in our sample of 9,000 is assigned to one of three roughly equal-sized experimental groups of 3,000 addresses – Treatment 1 (information only), Treatment 2 (information and financial incentive), or Control (no further outreach or incentive). Participating households will submit photos of their service line online, following instructions to ensure they are of sufficient quality for trained staff to identify the service line material. For Phase 2, after one month, we will randomize all addresses that were assigned to Treatment 1 or 2 but did not respond to the intervention into one of three, equal-sized, cross-randomized, secondary treatments – Secondary Treatment 1 (remote outreach), Secondary Treatment 2 (remote outreach and financial incentive), or Control (no additional treatment). We will principally examine the difference in uptake between each of these interventions and the control. We will also compare the difference in uptake between different levels of financial incentive to trace demand curves for the program, and will examine the prevalence of lead among respondents at different levels of incentive to assess if households that already know they do not have lead are less likely to participate in the absence of a high incentive.
Intervention (Hidden) Treatment 1: Provide all study households with an informational door-hanger in English and Spanish including instructions on how to self-inspect and submit photos of service line material to Trenton Water Works. Treatment 2: Provide a similar informational door hanger as in Treatment 1 that includes a gift card incentive offer of different randomized amounts ($10, $25, $50, or $100) in return for completing a self-inspection. Secondary Treatment 1: A repeat door hanger identical to the original treatment (i.e. households in Treatment 2 receive incentive offers of the same value as in the first round of treatment). Secondary Treatment 2: An in-person visit offering verbal instructions, visual aids, and technical assistance to help the resident complete photo self-inspections, following a process currently employed by Trenton LSLR contractors. Treatment 1: Provide all study households with an informational door-hanger in English and Spanish including instructions on how to self-inspect and submit photos of service line material to Trenton Water Works. Treatment 2: Provide a similar informational door hanger as in Treatment 1 that includes a gift card incentive offer of different randomized amounts ($10, $25, $50, or $100) in return for completing a self-inspection. Secondary Treatment 1: An email, SMS text or both with a request to complete the self-inspection. Secondary Treatment 2: Similar remote outreach that includes a gift card incentive offer of different randomized amounts ($10, $25, $50, or $100) in return for completing a self-inspection.
Back to top