Work health and safety of food delivery workers in the gig economy: field trial of delivery window messaging

Last registered on March 15, 2021

Pre-Trial

Trial Information

General Information

Title
Work health and safety of food delivery workers in the gig economy: field trial of delivery window messaging
RCT ID
AEARCTR-0007360
Initial registration date
March 13, 2021

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 15, 2021, 10:54 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Behavioural Insights Team

Other Primary Investigator(s)

PI Affiliation
Macquarie University
PI Affiliation
Centre for Work Health and Safety
PI Affiliation
Behavioural Insights Team
PI Affiliation
Behavioural Insights Team
PI Affiliation
Behavioural Insights Team
PI Affiliation
Behavioural Insights Team

Additional Trial Information

Status
In development
Start date
2021-04-01
End date
2021-06-30
Secondary IDs
Abstract
When food delivery workers in the app-based gig economy accept an order from a customer, they are given “time windows” for their trip to the restaurant to pick up the order and for their trip from the restaurant to the customer to deliver the order. In earlier phases of our research, we found that there was a widespread perception among food delivery workers that these time windows are firm expectations rather than the estimates that food delivery platforms intend them to be. This perception is further compounded by the belief among food delivery workers that their in-app ratings, access to preferred shifts, and, ultimately, their tenure with the platform are all affected by their ability to pick up and deliver within specified time windows, which is not the case. Since food delivery platforms do not explicitly communicate the difference between expectations and estimates to their fleet, these misperceptions have persisted.

As a result, food delivery workers may be incentivised to engage in behaviours that pose significant work health and safety (WHS) risks. In the context of road and traffic safety, these behaviours include using mobile phones while riding or driving, pushing themselves to continue working while fatigued, cycling on footpaths and in other pedestrian-only areas to cut down on travel time, and speeding or rushing. These behaviours are extremely widespread - only 5% of the food delivery workers we surveyed in an earlier phase of this project reported “never” rushing to deliver orders - and are driven largely by the desire to achieve and maintain high in-app ratings, satisfy customers, and maximise income (Convery et al., 2020).

The overall aim of this trial is therefore to determine whether reframing in-app messages that communicate pickup and delivery time windows as estimates rather than expectations reduces risk exacerbation and/or increases risk mitigation behaviours on the road. Specifically, we seek to answer the following research questions: (1) Can a behaviourally framed message reduce average maximum travel speed? (2) Can this message change food delivery worker beliefs about the negative consequences of exceeding the delivery estimate? (3) Do any effects on travel speed or beliefs negatively impact business as usual practices (e.g. delivery times, earnings, and customer satisfaction)?
External Link(s)

Registration Citation

Citation
Convery, Elizabeth et al. 2021. "Work health and safety of food delivery workers in the gig economy: field trial of delivery window messaging." AEA RCT Registry. March 15. https://doi.org/10.1257/rct.7360-1.0
Experimental Details

Interventions

Intervention(s)
The intervention under test is a series of behaviourally informed messages to reframe food delivery workers’ perceptions of delivery times from expectations to estimates. The communications will be sent to food delivery workers via the in-app messaging function or newsfeed, and “pinned” to the top of the inbox or feed for the duration of the trial. Messages will be sent weekly over the 1-month trial period (for a total of 4 messages), varying the framing week to week to maintain novelty and salience.
Intervention Start Date
2021-04-01
Intervention End Date
2021-04-30

Primary Outcomes

Primary Outcomes (end points)
Average maximum travel speed
Primary Outcomes (explanation)
Calculated from telemetry data that is collected by the food delivery platforms

Secondary Outcomes

Secondary Outcomes (end points)
Food delivery workers' subjective belief that exceeding delivery estimates will have a negative impact on their performance metrics
Secondary Outcomes (explanation)
Collected via an in-app survey

Experimental Design

Experimental Design
The study will be a two-armed randomised controlled trial run at two sites.
Experimental Design Details
Randomization Method
Randomisation of all food delivery workers who are registered on the food delivery platform, stratified by vehicle type. Separate randomisations will be conducted for each of the two trial sites.
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
N/A
Sample size: planned number of observations
Total minimum N = 10,000 (minimum of 5,000 food delivery workers at each of the two trial sites)
Sample size (or number of clusters) by treatment arms
Total minimum n in the treatment group = 5,000 (minimum of 2,500 food delivery workers at each of the two trial sites); total minimum n in the control group = 5,000 (minimum of 2,500 food delivery workers at each of the two trial sites)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials