No margin, no mission? A field experiment on incentives for public service delivery

Last registered on April 07, 2016

Pre-Trial

Trial Information

General Information

Title
No margin, no mission? A field experiment on incentives for public service delivery
RCT ID
AEARCTR-0001104
Initial registration date
April 07, 2016

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
April 07, 2016, 2:57 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
UC Santa Barbara

Other Primary Investigator(s)

PI Affiliation
Harvard Business School
PI Affiliation
Department of Economics, LSE, United Kingdom

Additional Trial Information

Status
Completed
Start date
2009-07-01
End date
2010-12-31
Secondary IDs
Abstract
We conduct a field experiment to evaluate the effect of extrinsic rewards, both financial and non-financial, on the performance of agents recruited by a public health organization to promote HIV prevention and sell condoms. In this setting: (i) non-financial rewards are effective at improving performance; (ii) the effect of both types of rewards is stronger for pro-socially motivated agents; and (iii) both types of rewards are effective when their relative value is high. The findings illustrate that extrinsic rewards can improve the performance of agents engaged in public service delivery, and that non-financial rewards can be effective in settings where the power of financial incentives is limited.
External Link(s)

Registration Citation

Citation
Ashraf, Nava, Oriana Bandiera and Kelsey Jack. 2016. "No margin, no mission? A field experiment on incentives for public service delivery." AEA RCT Registry. April 07. https://doi.org/10.1257/rct.1104-1.0
Former Citation
Ashraf, Nava, Oriana Bandiera and Kelsey Jack. 2016. "No margin, no mission? A field experiment on incentives for public service delivery." AEA RCT Registry. April 07. https://www.socialscienceregistry.org/trials/1104/history/7575
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The experiment utilizes one of the existing programs of Society for Family Health (SFS) that used hair salons in Lusaka to distribute female condoms. Hairstylists were identified as ideal agents for the delivery of this health service, both because the familiarity between the stylist and the client creates the potential for successful targeting of female condoms to “at risk” customers, and because during the period that a client is in the salon, he or she is a captive audience, allowing the stylist to provide information about HIV prevention generally, and specifically about the female condom. Finally, hair salons are numerous and distributed throughout Lusaka thus making the intervention easily scalable if successful.

Sample hairstylists, selected through a census of all salons in the Lusaka (described below) were invited for a one-day training program and randomly allocated to four different reward structures: (i) no margin on sale (control group) (ii) a financial margin of 10% on retail price (iii) a financial margin of 90% on retail price (iv) non-financial treatment group where each sale was rewarded with a star stamped on a thermometer display, which is labeled as measuring the stylist's contribution to the health of their community. After the training, interested agents were given promotional materials and a starting stock of 12 packs sold to them at a subsidized price.

SFH officers visited the hair salons once every month to restock the agent and to pay rewards if any were due. They checked certain metrics of effort such as display of promotional materials, completeness of log books, interest in continuing to deliver this service and attentiveness during the visit.
Intervention Start Date
2009-10-01
Intervention End Date
2010-12-31

Primary Outcomes

Primary Outcomes (end points)
Number of female condoms sold by agents

Other measures of stylist effort: display of promotional materials, completion of log books, measures of stylist interest and attention.
Primary Outcomes (explanation)
Sales performance measured by the number of packs each stylist restocks from SFH over the study period. Restocking is precisely measured from SFH inventory data and checked against invoices signed by the agents upon purchase.

An alternate measure of performance is calculated by SFH sales representatives, by subtracting the hairdresser's stock at month t from the sales representative's record of stock at t − 1. Sales representatives measure stock each time they visit the salon by counting the number of packs on display and confirming with the stylists that no other packs are stored elsewhere. This variable suffers from measurement error due to the fact that unsold packs might not be visible to the SFH representative and/or hidden intentionally.

When SFH representatives visited the salons, they also recorded measures of stylist effort, including observations of promotional materials, whether the stylist was keeping records of sales, and subjective assessments of stylist interest and attention.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
A census was conducted of all hair salons in Lusaka and a grid was imposed on the GPS-mapped locations of the salons to divide the city into equal geographical areas of 650m by 650m each. A buffer zone of 75 m on all sides of the grid cell was excluded, resulting in at least 150 m between salons in adjacent areas. The resulting areas, each measuring 250,000 m2, served as the unit of randomization. Salons located in buffer areas were not invited to join the program. The final sample for randomization consists of 205 distinct neighborhoods, containing 1222 hair salons, all of whom were invited to join the training. To prevent spillover effects, agents in the same neighborhood were assigned to the same treatment and salons neighbors are either in the same treatment or not part of the program.


Invitation to attend the training was extended to all 1222 stylist of whom 747 ultimately became agents. Attendees were allocated to one of four intervention groups - no reward, 10% margin, 90% margin, and non-financial (stars and thermometer display). Thereafter, dispensers or single packs could be purchased either during a monthly restocking visit by SFH representatives or by calling a toll-free number dedicated to the female condom program.

To elicit an incentive-compatible measure of pro-social motivation toward HIV causes, a dictator game was implemented during the training program. Agents were told that, in addition to the training show-up fee (40,000 ZMK), each of them would receive 12,500 ZMK, which they could keep for themselves or donate, in part or in full, to a well known charity in Lusaka that provides care to HIV/AIDS patients. The amount donated is taken as a proxy for the agents' motivation for the cause. Since this is likely to be correlated with the agents' wealth, it is always used together with asset- and socio-economic-status measures in the analysis that follows.

Finally, given the non-financial treatment with its public display of thermometer and stars differs from the other three treatment conditions in that the customers do not that the stylists are being rewarded or their level of condom sales performance, a placebo star treatment is given to the control group in a later round. The thermometer looks the same as that of the actual treatment group but the number of stars reflect average sales by all salons, rather than the individual salon sales.
Experimental Design Details
Randomization Method
Minmax t-stat approach, balanced on salon type (hairdresser or barber); salon size (proxied by the number of employees); whether the salon is located near a bar (a proxy for condom demand); the number of salons in the same cell; the agents’ total assets; whether the agent reports giving to charitable causes; and whether the agent sells other products in their salon
Randomization Unit
Grid cells (geographical area).
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
205 grid cells
Sample size: planned number of observations
771 agents
Sample size (or number of clusters) by treatment arms
No reward (control): 44 cells
10% margin reward: 42 cells
90% margin reward: 44 cells
Non-financial reward: 43 cells
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Zambia Biomedical Research Ethics Committee
IRB Approval Date
2008-10-01
IRB Approval Number
014-07-08
IRB Name
Harvard University-Area Committee on the Use of Human Subjects
IRB Approval Date
2008-07-02
IRB Approval Number
F16429

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
December 31, 2010, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
December 31, 2010, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
205 grid cells
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
1222
Final Sample Size (or Number of Clusters) by Treatment Arms
No reward (control): 44 cells 10% margin reward: 42 cells 90% margin reward: 44 cells Non-financial reward: 43 cells
Data Publication

Data Publication

Is public data available?
No

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Abstract
NO MARGIN, NO MISSION? A FIELD EXPERIMENT ON INCENTIVES FOR PUBLIC SERVICE DELIVERY

We conduct a field experiment to evaluate the effect of extrinsic rewards, both financial and non-financial, on the performance of agents recruited by a public health organization to promote HIV prevention and sell condoms. In this setting: (i) non-financial rewards are effective at improving performance; (ii) the effect of both types of rewards is stronger for pro-socially motivated agents; and (iii) both types of rewards are effective when their relative value is high. The findings illustrate that extrinsic rewards can improve the performance of agents engaged in public service delivery, and that non-financial rewards can be effective in settings where the power of financial incentives is limited.
Citation
Ashraf, Nava, Oriana Bandiera, and Kelsey Jack. 2014. "No Margin, No Mission? A Field Experiment on Incentives for Public Service Delivery.” Journal of Public Economics 120: 1-17.

Reports & Other Materials