x

We are happy to announce that all trial registrations will now be issued DOIs (digital object identifiers). For more information, see here.
Recruiting and Compensating Civil Servants: A Large-Scale Field Experiment in Zambia (CHWs)
Last registered on April 28, 2017

Pre-Trial

Trial Information
General Information
Title
Recruiting and Compensating Civil Servants: A Large-Scale Field Experiment in Zambia (CHWs)
RCT ID
AEARCTR-0000064
Initial registration date
April 27, 2017
Last updated
April 28, 2017 11:00 AM EDT
Location(s)
Region
Primary Investigator
Affiliation
London School of Economics and Political Science (LSE)
Other Primary Investigator(s)
PI Affiliation
London School of Economics
PI Affiliation
Harvard Medical School and Harvard Business School
Additional Trial Information
Status
Completed
Start date
2010-09-01
End date
2016-07-01
Secondary IDs
Abstract
State capacity to provide public services depends on the motivation of the agents recruited to deliver them. We design an experiment to quantify the effect of agent selection on service effectiveness. The experiment, embedded in a nationwide recruitment drive for a new government health position in Zambia, shows that agents attracted to a civil service career have more skills and ambition than those attracted to “doing good”. Data from a mobile platform, administrative records, and household surveys show that they deliver more services, change health practices, and produce better health outcomes in the communities they serve.
External Link(s)
Registration Citation
Citation
Ashraf, Nava, Oriana Bandiera and Scott Lee. 2017. "Recruiting and Compensating Civil Servants: A Large-Scale Field Experiment in Zambia (CHWs)." AEA RCT Registry. April 28. https://doi.org/10.1257/rct.64-1.0.
Former Citation
Ashraf, Nava, Oriana Bandiera and Scott Lee. 2017. "Recruiting and Compensating Civil Servants: A Large-Scale Field Experiment in Zambia (CHWs)." AEA RCT Registry. April 28. https://www.socialscienceregistry.org/trials/64/history/16992.
Sponsors & Partners

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information
Experimental Details
Interventions
Intervention(s)
The recruitment and selection process occurred at the community (health post) level, with on-the-ground implementation coordinated by district health officials. In each community, paper advertisements for the job were posted in local public spaces, such as schools, churches, and the health post itself. The treatment poster makes career incentives salient. To do so it lists, as the main benefit, the opportunity to ascend the civil-service career ladder to higher and better-paid positions, which are illustrated and enumerated in the poster--e.g., environmental health technician, nurse, clinical officer, and doctor. This incentive is summarized in a bold caption stating, "Become a community health worker to gain skills and boost your career!" In this setting, the pay gradient associated with career advancement is steep, as the starting monthly wage is USD 290 for CHAs, USD 530 for entry-level nurses, USD 615 for environmental health technicians, and USD 1,625 for resident doctors. The control poster, in contrast, lists as the main benefit the opportunity to contribute to one's community, such as "[gaining] the skills you need to prevent illness and promote health for your family and neighbors" and "[being] a respected leader in your community." This incentive is summarized in a caption stating, "Want to serve your community? Become a community health worker!" Potential applicants exposed to the control poster are thus presented with a description akin to the informal community health workers that are common in these areas, a position they would be familiar with.
Intervention Start Date
2011-06-01
Intervention End Date
2014-01-31
Primary Outcomes
Primary Outcomes (end points)
Pro-social and career preferences, ability, performance, retention, use of health services
Primary Outcomes (explanation)
Pro-social and career preferences: Applicants recruited under both approaches displayed similar levels of pro-social preferences: about 84 percent of both groups perceived their self-interest as overlapping with their community' s interests, and a little over half planned to stay in the same community for the next 5-10 years. However, applicants recruited by making career incentives salient were more ambitious regarding career advancement: a larger portion aspired to hold a higher-ranking government position in the next 5-10 years.

Ability: Applicants recruited by making career incentives salient had higher secondary school graduation exam scores overall and in natural sciences.

Performance: During the first 18 months of work, CHAs recruited by making career incentives salient conducted 94 more household visits than those recruited in the social incentives group, who conducted an average of 319 visits. They did not achieve these gains by targeting easy-to-reach households or by spending less time on each visit. CHAs in the career benefits group also hosted almost twice as many community meetings (an average of 43 meetings, compared with 22 meetings in the community benefits group). The effect on performance was driven by high-performing CHAs in the career incentives group—workers who would not have been recruited if they had not seen materials emphasizing opportunities for career advancement.

Retention: There was no evidence that career incentives improved performance at the expense of retention. During the first six months after the CHAs' one-year commitment period, the number of dropouts was similar across both groups. None of the CHAs who left did so for a higher-ranking position within the Ministry of Health because the Ministry requires CHAs to work for two years before applying for promotion.

Use of health services: In communities with CHAs recruited by making career incentives salient, the number of women giving birth at health centers increased by 14 per quarter from an average of 47 in comparison communities (a 30 percent increase). This suggests that the greater number of household visits performed by CHAs may have prompted people to make better use of the health services available to them.
Secondary Outcomes
Secondary Outcomes (end points)
Secondary Outcomes (explanation)
Experimental Design
Experimental Design
The experiment aims to identify the effect of career incentives on performance through selection. We use the recruitment posters described above to experimentally vary the salience of career incentives at the recruitment stage so as to engineer an exogenous change in selection. Once recruited, all CHAs face the same incentives; thus performance differences, if any, are due to selection. Since recruitment for the CHA position was organized by district officials, we randomized treatment at the district level in order to maximize compliance with the experimental assignment, evenly splitting the 48 districts into two groups. This implies that each district official is only exposed to one treatment and is unaware of the other. As district officials are the main source of information for aspiring CHAs, randomization at the district level minimizes the risk of contamination.
Experimental Design Details
Randomization Method
Computer randomization
Randomization Unit
District level
Was the treatment clustered?
Yes
Experiment Characteristics
Sample size: planned number of clusters
48 districts
Sample size: planned number of observations
The government received over 2,400 applications and interviewed 1,585 eligible candidates. Then, 314 candidates attended a year-long training, and 307 graduated and began work as CHAs.
Sample size (or number of clusters) by treatment arms
Treatment: 24 districts
Control: 24 districts
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information
IRB
INSTITUTIONAL REVIEW BOARDS (IRBs)
IRB Name
Innovations for Poverty Action IRB-USA
IRB Approval Date
2013-07-15
IRB Approval Number
702.12July-001
IRB Name
Committee on the Use of Human Subjects, Harvard University
IRB Approval Date
2013-10-23
IRB Approval Number
CR-19584-01
IRB Name
University of Zambia, Biomedical Research Ethics Committee
IRB Approval Date
2013-04-02
IRB Approval Number
FWA00000338
Post-Trial
Post Trial Information
Study Withdrawal
Intervention
Is the intervention completed?
Yes
Intervention Completion Date
January 31, 2014, 12:00 AM +00:00
Is data collection complete?
Yes
Data Collection Completion Date
January 31, 2014, 12:00 AM +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
48 districts
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
307 CHAs
Final Sample Size (or Number of Clusters) by Treatment Arms
Data Publication
Data Publication
Is public data available?
No
Program Files
Program Files
Reports and Papers
Preliminary Reports
Relevant Papers
Abstract
We study how career incentives affect who selects into public health jobs and, through selection,
their performance while in service. We collaborate with the Government of Zambia to
experimentally vary the salience of career incentives in a newly created health worker position
when recruiting agents nationally. We find that making career incentives salient at the recruitment
stage attracts health workers who are more effective at delivering health services, and administrative
data show an improvement in institutional deliveries, child visits and immunization
in the treatment areas. While career incentives attract agents who differ on observables—they
have higher skills and career ambitions—91% of the performance gap is due to unobservables.
The results highlight the importance of incentive design at the recruitment stage as a tool to
improve performance in organizations.
Citation
Ashraf, Nava, Oriana Bandiera, and Scott Lee. "Do-Gooders and Go-Getters: Career Incentives, Selection, and Performance in Public Service Delivery." Working Paper, February 2015.