Effect of Gamification on Survey Participation – Experimental Evidence from Swiss Agriculture

Last registered on June 20, 2025

Pre-Trial

Trial Information

General Information

Title
Effect of Gamification on Survey Participation – Experimental Evidence from Swiss Agriculture
RCT ID
AEARCTR-0016210
Initial registration date
June 17, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 20, 2025, 11:39 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation

Other Primary Investigator(s)

PI Affiliation
ETH Zurich

Additional Trial Information

Status
In development
Start date
2025-06-29
End date
2025-10-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Human labour is crucial to food production, especially in labour-intensive crops such as horticulture. Research on agricultural labour remains limited and largely qualitative due to sampling barriers such as incomplete registries and low online survey response rates. To address this, we combine web-based respondent-driven sampling (RDS) with gamification to improve reach and engagement. RDS enables access to hard-to-reach populations through chain referrals and double compensation, while gamification adds a prize for the longest referral chain to increase motivation. Using a randomised controlled trial, we assess the impact of gamification on participation and referral chain length. This is the first study to combine these approaches, offering a novel strategy to enhance survey participation in agriculture and beyond.
External Link(s)

Registration Citation

Citation
Heepen, Celestina and Eva-Marie Meemken. 2025. "Effect of Gamification on Survey Participation – Experimental Evidence from Swiss Agriculture." AEA RCT Registry. June 20. https://doi.org/10.1257/rct.16210-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The intervention is the chance and information about winning a voucher if the participants’ (farmer and seeds) chain is the longest. While all farmers will receive an email asking them to forward the survey to a worker, only 50% of the farmers and the following seeds will receive the information treatment as part of the invitation email. The treatment for the farmers will be assigned randomly. The treatment for the first worker will be based on whether their employer was assigned to the treatment group or the control group.
Intervention (Hidden)
Intervention Start Date
2025-06-29
Intervention End Date
2025-10-31

Primary Outcomes

Primary Outcomes (end points)
Chain length (number of waves the survey has been forwarded), which can be observed in the survey tool based on the participant's ID
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
1) Probability of farmers, seeds and sub-seeds forwarding the link
2) Probability of seeds and sub-seeds participating in the survey
Both are measured by the share of participants participating or forwarding (0/1), which can be observed in the survey tool.
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Seasonal farmworkers in Switzerland are not always registered with authorities, which is why we lack complete lists of all migrant workers to sample from. Furthermore, workers are not organised, meaning there are also no non-governmental organisations with comprehensive lists of workers. However, since the employers are known to the authorities we aim to get in contact through the farmers. We receive a list from the Federal Office of Agriculture with contact details of around 1,500 Swiss horticulture farmers who work with seasonal migrant workers. The Federal Office of Agriculture will select the farmers based on random sampling. We first contact the farmers by personal email to explain the study. If they do not respond to the email, we will follow up with one reminder.
In the email, farmers will be asked to recruit a seasonal worker to participate in the initial stage of the chain (seeds). Once a worker is selected, the farmer copies the unique link to the survey and shares it with them. The workers will then be directed to the landing page of the survey, where they will first watch a video explaining the sampling process, then they will fill out the survey and provide their contact details (which is required to compensate participants). After completing the survey, they will be asked to forward the survey link to three other workers (subseeds) together with the prepared message. These subseeds again will be asked to fill out the survey and forward the link to three workers. The link can be forwarded directly through WhatsApp, email or by copying the link into another application. Each of the three links can only be used once, and the potential participants are asked if they have participated in the survey before to prevent multiple participation by the same person. If they have participated before, they will be asked to inform the sender of the link. So that they can send it to another person. The referral from subseed to subseed will be repeated until the respondents are not willing to pass it on or when the sample size has been reached, (Tyldum & Johnston, 2014) as further explained below. The process will be facilitated with the online tool Limesurvey, which also allows us to generate unique IDs to identify the referral chains (Ferrer-Rosende et al., 2023). The referral process will work autonomously between the participants. However, we will monitor the chains and interfere if we observe irregularities.
Experimental Design Details
Randomization Method
Randomisation of farmers is done by an office computer
Randomization Unit
The treatment for the farmers will be assigned randomly based on a list with the farmers' contact details. The treatment for the first worker will be based on whether their employer was assigned to the treatment group or the control group
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
No, cluster
Sample size: planned number of observations
Around 225 farmers and 120 workers (seeds)
Sample size (or number of clusters) by treatment arms
Treatment and control group each: 750 farmers and around 225 workers based on which farmers forwarded the survey
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
We have around 1,500 farmer contacts. Assuming a 15% farmer participation rate (Zachmann et al., 2023a, 2023b), a 53% worker response rate (Ferrer-Rosende et al., 2023), we estimate a sample size of 225 farmers and around 120 workers. To determine the chain length, we’ll monitor key indicators to identify equilibrium. Based on earlier studies, we expect around 4–5 waves per seed (Ferrer-Rosende et al., 2023). In addition, we will conduct a power calculation comparing 50% treated chains with 50% control chains, targeting 80% power at 5% significance. Since gamification in RDS and in the agricultural contexts lacks precedent, we cannot pre-specify effect sizes. Therefore, we will recruit farmers in two waves, conducting a power calculation after the first wave.
IRB

Institutional Review Boards (IRBs)

IRB Name
Ethical comission ETH
IRB Approval Date
2025-06-11
IRB Approval Number
25-Ethics-132
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials