Documenting and Understanding the Invisible Load

In the interest of preserving the integrity of the experiment, the intervention is being described in full in the experimental design sections that will remain hidden until the experiment is completed.

2025-09-01

2027-12-31

Reply received (0/1).

· ReplyLatency: Continuous measure of time to reply (in hours or days) from when the email was sent. This is the primary definition for latency and will be used in all main analyses.
· Tone / sentiment of response.
· Length of reply (word/character count).
. Content: Measures based on the content of the response (e.g. offer to schedule a tour/appointment, provision of alternative options or helpful resources, etc.)
Note on robustness: While the primary definition of ReplyLatency is continuous, for robustness and interpretability we may also categorize response time into bins (e.g., within 1 day, within 7 days).

In the interest of preserving the integrity of the experiment, the experimental design is being described in full in the experimental design sections that will remain hidden until the experiment is completed.

Not available

Randomization done by computer. Stratification ensures balance across demographic attributes of the centers like provider type, region, and other characteristics.

Daycare or eldercare center.

No

We included about 2000 daycares in the first pilot study. And we plan to include approximately 3000 daycare centers and 1500 eldercare centers in the second pilot study. Each center represents one cluster, as responses are measured at the center level. Following the pilot, we will update our power calculations based on the observed effect sizes.

Because each center is contacted only once, the total number of observations will also be 2000 & 4500 carecenters for the primary outcomes in the first and second pilots. Each observation corresponds to one unique center’s response (or non-response) to our email. The secondary outcomes (e.g. sentiment of the email response) will be determined by the response rate to our various treatments.

We are running a 3×6 factorial design with eighteen treatment arms with equal size samples in each treatment:
T1_M_S: “Unexpected Need” message, male sender, single parent
T1_F_S: “Unexpected Need” message, female sender, single parent
T2_M_S: “Dropped the ball” message, male sender, single parent
T2_F_S: “Dropped the ball” message, female sender, single parent
T3_M_S: No reason message, male sender, single parent
T3_F_S: No reason message, female sender, single parent
T1_M_N: “Unexpected Need” message, male sender, non-single
T1_F_N: “Unexpected Need” message, female sender, non-single
T2_M_N: “Dropped the ball” message, male sender, non-single
T2_F_N: “Dropped the ball” message, female sender, non-single
T3_M_N: No reason message, male sender, non-single
T3_F_N: No reason message, female sender, non-single
T1_M_C: “Unexpected Need” message, male sender, child
T1_F_C: “Unexpected Need” message, female sender, child
T2_M_C: “Dropped the ball” message, male sender, child
T2_F_C: “Dropped the ball” message, female sender, child
T3_M_C: No reason message, male sender, child
T3_F_C: No reason message, female sender, child
We plan to have 2000 centers and 4500 centers in the first and second pilots.

See pre-analysis plan for power calculation details