Experimental Design
The study will take place in the All of Us Research Program (AoURP). This is a longitudinal health research program looking at the impact of genetics and environmental factors on health outcomes, with a particular focus on individuals that are underrepresented in biomedical research. Once the user consents to become a participant, they can share different types of health data with the program, including through surveys, donating a biosample and by linking their Electronic Health Records. Our focus is on participants at the beginning of the journey and their likelihood to complete three important surveys for the program.
AoURP participants are recruited from the general public through advertisements on websites such as webmd.com and nextdoor.com. To date, AoURP has enrolled more than 400,000 participants. We will aim to recruit 21,700 participants. This corresponds to 4,340 participants in the control condition and 8,680 for each of the treatment conditions (17,360 participants for the pooled comparison).
After creating an account on the AoURP platform, users go through the primary consent module. Once the user has given consent to join the program, they become a program participant. Upon completing the primary consent, the participant becomes eligible to complete the Basics survey (PPI 1). This survey informs us of key information about the participant, including their age, race, gender and education level. Once completed, the participant becomes eligible to complete the Overall Health and the Lifestyle surveys. The Overall Health (PPI 2) survey asks participants about their physical and mental health backgrounds, which enables researchers to understand the health conditions of the AoURP cohort. The Lifestyle (PPI 3) survey asks about the habits of the participant, including smoking, alcohol, and recreational drug use habits. Participants are randomized to one of three trial arms after completing primary consent and receive specific reminder messages corresponding to their group assignment if they meet the reminder requirements.
The control includes two business-as-usual reminder emails. The first email is sent 24 hours after completing primary consent AND PPI 1 AND PPI 2 AND PPI 3 are incomplete. The second email is sent 5 days after completing primary consent AND PPI 1 OR PPI 2 OR PPI 3 are incomplete.
The pure reminder arm includes up to 6 pure reminders. The pure reminder emails inform the participant that they need to complete a survey. These emails include a CTA, but don't give detail about the survey content or its impact. In this arm, each PPI survey has two email alternatives for a total of 6 reminder emails. The first PPI 1 email is sent 24 hours after completing primary consent AND PPI 1 is incomplete. The first PPI 2 email is sent 24 hours after completing PPI 1 AND PPI 2 is incomplete. The first PPI 3 email is sent 24 hours after completing PPI 2 AND PPI 3 is incomplete OR 12 days after completing consent AND PPI 1 is complete AND PPI 3 is incomplete. The second PPI 1 email is sent 5 days after completing primary consent AND PPI 1 is incomplete. The second PPI 2 email is sent 5 days after completing PPI 1 AND PPI 2 is incomplete. The second PPI 3 email is sent 5 days after completing PPI 2 AND PPI 3 is incomplete OR after 17 days of completing consent AND PPI 1 is complete AND PPI 3 is incomplete.
The reminder + content + impact arm includes up to 6 reminders that include a CTA at the top as well as information about the survey content and its impact for AoURP researchers. In this arm, each PPI survey has two email alternatives for a total of 6 reminder emails. The first PPI 1 email is sent 24 hours after completing primary consent AND PPI 1 is incomplete. The first PPI 2 email is sent 24 hours after completing PPI 1 AND PPI 2 is incomplete. The first PPI 3 email is sent 24 hours after completing PPI 2 AND PPI 3 is incomplete OR 12 days after completing consent AND PPI 1 is complete AND PPI 3 is incomplete. The second PPI 1 email is sent 5 days after completing primary consent AND PPI 1 is incomplete. The second PPI 2 email is sent 5 days after completing PPI 1 AND PPI 2 is incomplete. The second PPI 3 email is sent 5 days after completing PPI 2 AND PPI 3 is incomplete OR after 17 days of completing consent AND PPI 1 is complete AND PPI 3 is incomplete.
The proportion of participants that complete the respective surveys (PPI 1, 2 and 3) relative to those that complete primary consent after receiving one of three reminder email interventions will be calculated. This measure will assess which intervention was the most successful at improving the conversion rate for the PPI 1-3 surveys.
The study will be active in the AoURP dashboard for an estimated nine weeks allowing for individuals to participate in the study.
Update made to registration on 09/22/22:
See additional documentation for message content and trigger conditions of the PPI 5-6 messages.