The Supply-Side and Demand-Side Effects of Financial Incentives: Experimental Evidence from Branchless Banking Agents in Rural Indonesia

Last registered on July 28, 2018

Pre-Trial

Trial Information

General Information

Title
The Supply-Side and Demand-Side Effects of Financial Incentives: Experimental Evidence from Branchless Banking Agents in Rural Indonesia
RCT ID
AEARCTR-0003167
Initial registration date
July 26, 2018

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 27, 2018, 1:30 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
July 28, 2018, 12:50 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
Universitat Pompeu Fabra

Other Primary Investigator(s)

PI Affiliation
Survey Meter
PI Affiliation
Northwestern University

Additional Trial Information

Status
On going
Start date
2016-04-15
End date
2019-12-31
Secondary IDs
Abstract
We propose to test the effects of monetary incentives for frontline service providers on the take up of a new technology to promote financial inclusion. The context is one of a large state bank which hires local branchless banking agents to introduce a new saving product in a rural and largely unbanked area of Indonesia. These agents are randomized into receiving a high vs. low piece rate for recruiting new customers.

The goal of our experiment is to shed light not only on the supply-side effect of these incentives, but also on their potential demand-side effects, where:

• Supply effect = effect of higher incentives on the effort exerted by the delivery agent.
• Demand effect = effect of higher incentives on community’s perceptions of the quality of the product and the intentions of the agent/organization who promotes the product.

While most of the literature has focused on the supply-side effect of incentives, our conjecture is that, in a context where there is incomplete information about a new technology or product, incentives can also affect take-up through a change in the potential customer’s perceptions. Higher incentives can, for instance adversely affect potential clients’ beliefs about the true intentions of the agent, i.e., they may think that the agent is promoting the product to earn money rather than because the product is beneficial to customers (thereby reducing their perceived quality of the product). On the other hand, higher financial incentives may convey that the agent has a high opportunity cost and is therefore a good worker, or the organization is “efficient” in that it pays its employees more money, and increase the perceived quality of the product or the willingness to adopt it. If financial incentives convey negative signals about the product to customers, then they may backfire even if agent’s effort increases (the supply and demand effect of incentives in opposite directions). If incentives instead convey positive signals about the product, the demand effect of incentives may instead reinforce the supply effect.

This study takes place in the context of the introduction of a new technology to promote financial inclusion in rural Indonesia. The Government of Indonesia has recently adopted a new financial inclusion initiative, and issued a law designed to promote branchless banking as means to increase access to financial services among its largely unbanked population. The model uses one local branchless banking agent per village to promote the take-up and the use of savings and current accounts. Cash-in’s and cash-out’s from customers’ accounts are done through the agents. Five large banks have been approved by the Government to provide branchless banking and we collaborate with one of them.

The experiment takes place in 400 villages in five kabupatens of East Java, in which the population is almost exclusively unbanked and in which our partner bank is expanding. Each village is served by a newly-hired local agent. The compensation scheme offered to agents included a fee for each new customer who signs up for an account, and a fee for each transaction made.

The experiment randomizes the 400 villages (one agent per village) into high and low incentive, stratifying the sample by whether the village has good internet access, distance from the village to the main bank branch, and the presence of other banks in the village:

1. “Low-incentive” treatment: the agent receives 2,000 IDR (~ 0.14 USD) for each new customer who signs up for an account.
2. “High-incentive” treatment: the agent receives four times as much (i.e., 10,000 IDR~ 0.69 USD) for each new customer who signs up for an account.

We define an individual as having “signed-up” if she opens an account and keeps a minimum balance of 20,000 IRP (~1.6USD) in her account for at least two weeks. The latter condition has been added to avoid collusion between the customer and the agent.

To estimate the effect of the treatment on take-up, we survey a random sample of 4,800 households (12 per village.) For each of these households, we will have information on whether they take-up the product at endline, and--if they have--we will ask the amount saved in the account, the number of transactions made, etc. This data will be corroborated by administrative information from the bank.

The comparison of the take-up under the high vs low incentive treatments will allow us to estimate the reduced form effect of monetary incentives on the take up of the new technology: a combination of the supply and demand side effects. To disentangle between these two, we cross randomize an equal share of the high and the low incentive treatment into two treatment arms:

• In the “Private information” treatment, the sample of households we survey are given information about the new product but are not informed about the compensation of the agent.
• In the “Public information” treatment, the sample of households we survey are informed about the product and are also informed about the compensation of the agent (i.e., they are told the fee the agents make for each new customer).
The experimental design is as follows:

Table 1: Experimental Design

T1: High Incentives + Private information (70 Villages)
T2: High Incentives + Public information (130 Villages)
T3: Low Incentives + Private information (70 Villages)
T4: Low Incentives + Public information (130 Villages)

The rationale for using the private vs information treatment is that we believe demand effects of incentives will be minimized in the private information treatment. The context we analyze is indeed one where very people infrequently talk about their earnings to each other, and potential clients in the high or low incentive treatment are likely to have the same perception of agent earning when the information is private, at least in the short term (we’ll test for this).

Our experimental design will compare take-up of the new technology among our sample households in the 4 treatment groups:

• Conditional on being in the private information treatment, the difference between the high vs. the low incentive treatment provides the supply side effect of incentives (increased effort) (T1-T3 in Table 1).
• The difference between the high and the low incentives in the public information treatment will instead provide us with the aggregate supply effect + the demand effect (T4-T2).
• The difference-in-difference between high vs low incentives in public vs public treatment ((T4-T2)-(T1-T3)) will isolate the demand effect.

To reinforce the evidence supporting the hypothesized mechanisms, these results will be complemented by: (1) the effects of the treatments on agent perceived own amount of effort, and (2) household survey questions on the amount of effort provided by the agent, and perceptions about: (a) the quality of the product, (b) their level of trust in the product, the agent and the bank, (c) the perceived identity of the agent.

In addition to the village level treatments described above, the project also tests whether financial literacy can be used as a tool to boost demand for financial products. Within each village, we offer financial literacy and business training to random sample of 5 women entrepreneurs. This variation is orthogonal to the village-level variation in incentives and is part of a separate evaluation.
External Link(s)

Registration Citation

Citation
Deserranno, Erika, Gianmarco Leon and Firman Witoelar. 2018. "The Supply-Side and Demand-Side Effects of Financial Incentives: Experimental Evidence from Branchless Banking Agents in Rural Indonesia." AEA RCT Registry. July 28. https://doi.org/10.1257/rct.3167-2.0
Former Citation
Deserranno, Erika, Gianmarco Leon and Firman Witoelar. 2018. "The Supply-Side and Demand-Side Effects of Financial Incentives: Experimental Evidence from Branchless Banking Agents in Rural Indonesia." AEA RCT Registry. July 28. https://www.socialscienceregistry.org/trials/3167/history/32248
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The interventions in this project are as follows (see Table 1 for details):

1) High financial incentives for signing-up new clients.
2) Low financial incentives for signing-up new clients.
3) Public information about the agent’s compensation.
4) Private information about the agent’s compensation.
Intervention Start Date
2016-04-15
Intervention End Date
2018-06-15

Primary Outcomes

Primary Outcomes (end points)
The outcome variables of the project will be obtained from two sources:
• Baseline, midline and endline surveys of a random subsample of roughly 12 households per village.
• Baseline, midline and endline surveys of all 400 agents working in each of the experimental villages.
• Administrative data collected by the bank on the universe of users of the bank financial products in each of our intervention villages.

The main information to be collected from each of these sources is as follows:

Administrative data:
- Number of people who sign up
- Number of transactions (i.e., cash-in and cash-out)
- Frequency of the transactions
- Balance in the account

Survey questions:
- Potential client’s perceptions about qualities of the agent, the product and the bank
- Potential client’s trust in the bank, the agent and the product
- Potential client’s perceptions and willingness to pay for different financial products
- Potential client’s business activities
- Agent’s perceptions about the qualities of the product and the bank
- Agent’s perceptions about the social benefits of the financial products offered
- Agent’s self-reported measure of motivation (pro-social, monetary, etc.), and perceived own identity in the village.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
See Table 1. Details about each treatment arm are provided in the abstract.
Experimental Design Details
Randomization Method
Randomization done by a computer using Stata.
Randomization Unit
The level of randomization for the compensation and information treatments is the village.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
400 villages.
Sample size: planned number of observations
400 agents and 4800 respondents.
Sample size (or number of clusters) by treatment arms
In each of the villages, we survey at baseline and endline; 1 agent and 12 households (randomly selected from the underlying pool of potential clients), in each household we interview 1 person. In sum, the total sample is: 400 agents and 4800 respondents.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Universitat Pompeu Fabra
IRB Approval Date
2017-10-06
IRB Approval Number
0069
IRB Name
London School of Economics and Political Science
IRB Approval Date
2016-04-05
IRB Approval Number
N/A

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials