Scaling digital payments: A market-level randomized controlled trial on cross-side referrals

Last registered on December 20, 2023

Pre-Trial

Trial Information

General Information

Title
Scaling digital payments: A market-level randomized controlled trial on cross-side referrals
RCT ID
AEARCTR-0012548
Initial registration date
December 12, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 20, 2023, 12:51 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Primary Investigator

Affiliation
GiveWell

Other Primary Investigator(s)

PI Affiliation
National University of Singapore
PI Affiliation
William & Mary
PI Affiliation
University of Sydney

Additional Trial Information

Status
In development
Start date
2023-03-11
End date
2024-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Despite the penetration of mobile money across many emerging economies, cash continues to dominate retail payments. Following from a canonical literature on two-sided markets, customers and merchants face coordination problems in adopting a two-sided platform, such as digital retail payments. In partnership with a leading mobile network operator in Tanzania, we test the efficacy of locally-targeted adoption and referral incentives to catalyze adoption of digital retail payments. This experiment will be one of the first to quantify the causal effects of merchant-customer coordination on digital payments adoption.
External Link(s)

Registration Citation

Citation
Roessler, Philip et al. 2023. "Scaling digital payments: A market-level randomized controlled trial on cross-side referrals ." AEA RCT Registry. December 20. https://doi.org/10.1257/rct.12548-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Note that all interventions are implemented at the market-level.

The main intervention provides incentives for merchants and customers in a market to adopt digital retail payments and for merchants to communicate with their customers about digital retail payments.

The low-saturation main intervention is identical but engages fewer merchants.

The adoption incentives only intervention includes only the adoption incentives from the main intervention.

The referral incentives only intervention includes only the referral incentives from the main intervention.

Intervention Start Date
2024-03-01
Intervention End Date
2024-05-01

Primary Outcomes

Primary Outcomes (end points)
Adoption of digital retail payments; Regular user of digital retail payments; Volume of digital retail payments
Primary Outcomes (explanation)
A merchant will be considered to have adopted digital retail payments if they accepted a digital retail payment at least once after intervention launch.

A customer will be considered to have adopted digital retail payments if they made a digital retail payment at least once after intervention launch.

A merchant will be considered to be a regular user if they accepted digital retail payments >=4 times per month.

A customer will be considered to be a regular user if they made digital retail payments >=1.5 times per month.

Volume defined as number of digital retail payments accepted/made over a given period.

Secondary Outcomes

Secondary Outcomes (end points)
Main secondary outcomes: Frequency of cash out; Usage of other digital financial services; Willingness to accept mobile money
Mechanisms: Conversations about digital retail payments; Awareness of digital retail payments; Perceptions of digital retail payments
Auxiliary outcomes: Crime; Government revenue; Merchant formalization; Merchant profits; Frequency of remote payments; Multi-homing
Alternative outcome measures: Value of digital retail payments
Secondary Outcomes (explanation)
Cash out will be measured based on volume and value of cash withdrawals from mobile money agents in the market in time since intervention.

A merchant will be considered to be multi-homing if they accepted digital retail payments using two different products since intervention launch.

A customer will be considered to be multi-homing if they made digital retail payments using two different products since intervention launch.

Usage of other digital financial services will be captured by an index. The index will include usage of mobile money, digital loans, digital savings, and other relevant digital financial services.

Perceptions of digital retail payments will be captured by an index. The index will include overall ratings of digital retail payments, and ratings on specific sub-categories such as cost, convenience, security, privacy, speed, and other relevant sub-categories.

Willingness to accept mobile money will be elicited through the Becker-DeGroot-Mashak mechanism.

Crime will be captured by whether the respondent was robbed since intervention launch.

Taxation will be captured by the amount of transaction fees and tax payments made by the respondent since intervention launch.

Merchant formalization will be captured by an index. The index will include whether the firm has a tax identification number, whether the firm is registered with the government, and other relevant measures of formalization.

Merchant profits will be captured by an estimate of the merchant’s revenue subtracting out their costs since launch of the intervention.

All indices will be constructed in the style of “Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects” (Anderson, 2008). If there are substantial amounts of missing values in an index, then item response theory may be used instead.

Experimental Design

Experimental Design
A baseline census and survey was conducted across 300 markets between March and May 2023. We sampled 4 merchants per market and 6 customers per market for the baseline survey.

The 300 markets in our sample will be randomized into 5 groups:

60 control markets
60 main intervention markets
60 low-saturation main intervention markets
60 adoption incentives only markets
60 referral incentives only markets

We plan to conduct the endline survey 30 days after the end of the intervention. We plan to use administrative data from one year prior to the intervention to one year after the intervention.
Experimental Design Details
Not available
Randomization Method
Randomization by computer
Randomization Unit
Market
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
300 markets
Sample size: planned number of observations
For market-level outcomes: 300 (1 per cluster) For merchant-only outcomes based on endline survey responses: 1200 (4 per cluster) For customer-only outcomes based on endline survey responses: 1800 (6 per cluster) For merchant and customer outcomes based on endline survey responses: 3000 (10 per cluster) For administrative data outcomes relevant for target merchants: 3600 (12 per cluster) For administrative data outcomes relevant for all merchants in the merchant census: Approximately 12000 (40 per cluster)
Sample size (or number of clusters) by treatment arms
60 markets per treatment arm
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Assuming the baseline survey standard deviations and intra-cluster correlations for adoption of digital retail payments match the endline values for these parameters, we would be able to identify a minimum detectable effect size of 16.4 pps in market-level adoption, 8.9 pps in surveyed merchant-level adoption, 7.6 pps in surveyed consumer-level adoption, 6.4 pps in surveyed respondent-level adoption, 6.1 pps for target merchant-level adoption, and 4.7 pps for enumerated merchant-level adoption with .8 power at the 95% significance level.
IRB

Institutional Review Boards (IRBs)

IRB Name
Tanzania Commission for Science and Technology
IRB Approval Date
2022-04-26
IRB Approval Number
2022-299-NA-2022-052
IRB Name
William & Mary IRB
IRB Approval Date
2022-01-19
IRB Approval Number
PHSC-2022-01-19-15388-proessler