Comparing content effect and frequency effect of reminder messages: A field experiment in health checkups

Last registered on October 31, 2022

Pre-Trial

Trial Information

General Information

Title
Comparing content effect and frequency effect of reminder messages: A field experiment in health checkups
RCT ID
AEARCTR-0010296
Initial registration date
October 22, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 31, 2022, 3:26 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
October 31, 2022, 4:51 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
Osaka University

Other Primary Investigator(s)

PI Affiliation
Osaka University
PI Affiliation
Osaka University
PI Affiliation
Osaka University

Additional Trial Information

Status
On going
Start date
2022-10-24
End date
2025-03-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
In 2008, the Japanese government launched a new health checkup system, the Specified Health Examination. The purpose of this checkup is to screen pre-diabetic patients who are at risk of developing cardiovascular diseases and diabetes mellitus, and to provide early intervention for receiving medical treatment and improving lifestyle. The uptake rate in FY2020 was 53.4%, compared to the government’s target of 70%. The uptake rate for National Health Insurance subscribers, which includes self-employed people, was only 33.7%.

Based on behavioral economics findings, this study aims to develop reminder postcards to encourage National Health Insurance subscribers to take the specific health examination and to clarify how these interventions affect the uptake behavior experimentally. Specifically, in this study, we collaborate with a local government in the Kansai region and conduct a field experiment for their citizens. We set up interventions to devise the content of reminder postcards and another intervention to increase the number of times reminder postcards are mailed. We estimate these interventions' effects and compare them with each other. In addition, we examine how the effects depend on the subjects' past experiences of receiving the checkups and other factors.

The subjects of this experiment (around 48,000 citizens) are the National Health Insurance subscribers in the age group eligible for the Specified Health Examination in FY2022. In addition, they have not received the checkups by the time the postcards are mailed. We randomly assign them to four groups at the individual level. In the treatment groups, we change the content of the reminder postcard and the number of mailings as follows:

- Control group: We mail a postcard explaining the necessity of the specific health examination and how to make an appointment.

- Treatment group 1: We add the message "Do you still have your free voucher for the specific health examination?" to the control group's postcard and then introduce a simple way to reissue the voucher.

- Treatment group 2: We add the message "Do you believe that you do not need to take the specific health examination this year?" to the control group's postcard and then explain the importance of continuously receiving health checkups.

- Treatment group 3: We mail the control group's postcard twice.

We will send the postcards in late October 2022. In treatment group 3, we will send the second mailing in late January 2023. The outcome variables are the presence or absence and timing of the health checkup from the first mailing time to the end of March 2023.
External Link(s)

Registration Citation

Citation
Sasaki, Shusaku et al. 2022. "Comparing content effect and frequency effect of reminder messages: A field experiment in health checkups." AEA RCT Registry. October 31. https://doi.org/10.1257/rct.10296-1.1
Experimental Details

Interventions

Intervention(s)
- Control group: We mail a postcard explaining the necessity of the specific health examination and how to make an appointment.

- Treatment group 1: We add the message "Do you still have your free voucher for the specific health examination?" to the control group's postcard and then introduce a simple way to reissue the voucher.

- Treatment group 2: We add the message "Do you believe that you do not need to take the specific health examination this year?" to the control group's postcard and then explain the importance of continuously receiving health checkups.

- Treatment group 3: We mail the control group's postcard twice.
Intervention Start Date
2022-10-25
Intervention End Date
2023-03-31

Primary Outcomes

Primary Outcomes (end points)
Whether a subject receives the specific health examination or not
Primary Outcomes (explanation)
These outcome variable will be collected by the local government as administrative data and then shared with the researchers under a nondisclosure agreement.

Secondary Outcomes

Secondary Outcomes (end points)
When a subject receives the specific health examination
Secondary Outcomes (explanation)
These outcome variable will be collected by the local government as administrative data and then shared with the researchers under a nondisclosure agreement.

Experimental Design

Experimental Design
We perform stratified randomization for approximately 48,000 citizens and dividing them into a control group, treatment group 1, treatment group 2, and treatment group 3. In the treatment groups, we change the content of the reminder postcard and the number of mailings as follows:

- Control group: We mail a postcard explaining the necessity of the specific health examination and how to make an appointment.

- Treatment group 1: We add the message "Do you still have your free voucher for the specific health examination?" to the control group's postcard and then introduce a simple way to reissue the voucher.

- Treatment group 2: We add the message "Do you believe that you do not need to take the specific health examination this year?" to the control group's postcard and then explain the importance of continuously receiving health checkups.

- Treatment group 3: We mail the control group's postcard twice.

We will send the postcards in late October 2022. In treatment group 3, we will send the second mailing in late January 2023.
Experimental Design Details
Not available
Randomization Method
Stratified randomization; we construct the fourteen strata based on the subject’s sex, age and probability of receiving the specific health examination. We predict the individual probability, using the information on their past uptake behavior and health examination results.
Randomization Unit
Individuals.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
N/A
Sample size: planned number of observations
Around 48,000 citizens
Sample size (or number of clusters) by treatment arms
Around 12,000 citizens per group
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
N/A
IRB

Institutional Review Boards (IRBs)

IRB Name
Center for Infectious Disease Education and Research, Osaka University IRB
IRB Approval Date
2022-10-17
IRB Approval Number
2022CRER1017