Randomization Method
Randomization is conducted at the individual level. Each of the 3,367 individuals in the study sample is assigned to one of four treatment conditions in a two-by-two factorial design. Assignment is implemented in Stata using a reproducible random-number seed to ensure full replicability.
Randomization is stratified on two pre-treatment characteristics recorded in the organization’s administrative data:
Past donation status: whether the individual has ever made a prior donation to the organization;
Past engagement: whether the individual has previously interacted with the organization’s communications (e.g., opened or clicked prior messages, or participated in previous actions).
Stratification on these variables ensures balanced assignment across groups that differ in historical involvement with the organization.
Participants do not choose their treatment assignment, and the assignment is not visible to them at any stage. All individuals receive a fundraising message with an identical header, format, and general structure. Only selected lines in the body of the message vary according to the experimental condition. This design eliminates self-selection into treatment and supports unbiased estimation of intent-to-treat effects.
Within each stratum, individuals are assigned with equal probability to one of the four treatment cells (Anonymous–Local, Anonymous–Global, Public–Local, Public–Global). No cluster-level randomization is used.