Performance Scorecards and Government Service Delivery: Experimental Evidence from Land Record Changes in Bangladesh
Last registered on August 18, 2018

Pre-Trial

Trial Information
General Information
Title
Performance Scorecards and Government Service Delivery: Experimental Evidence from Land Record Changes in Bangladesh
RCT ID
AEARCTR-0003232
Initial registration date
August 13, 2018
Last updated
August 18, 2018 12:18 AM EDT
Location(s)

This section is unavailable to the public. Use the button below to request access to this information.

Request Information
Primary Investigator
Affiliation
Yale University
Other Primary Investigator(s)
Additional Trial Information
Status
In development
Start date
2018-09-01
End date
2019-08-01
Secondary IDs
Abstract
Slow government service delivery and low accountability among government bureaucrats are common problems in many low- and middle-income countries. As eGovernance systems are becoming common practice in government service delivery in Bangladesh, more and more data is generated regarding about how bureaucrats are providing government services but so far very little of data is used by the government to improve service delivery. In this project we will use the data generated by one eGovernance system to generate a monthly Performance Scorecard for government bureaucrats in terms of the timeliness of their service provision. The service for which we will implement this intervention is land record changes, also know as “mutations”. We will be sending out performance scorecards displaying how many applications for mutations were processed within the government mandated time limit of 45 working days as well as how many applications that are still pending beyond this limit. By sending these performance scorecards to both the bureaucrats doing the land record changes, as well as the superiors of these bureaucrats we hope to improve accountability within the bureaucracy and thereby increasing the number of government services provided within the time limit.
External Link(s)
Registration Citation
Citation
Mattsson, Martin. 2018. "Performance Scorecards and Government Service Delivery: Experimental Evidence from Land Record Changes in Bangladesh." AEA RCT Registry. August 18. https://www.socialscienceregistry.org/trials/3232/history/33175
Sponsors & Partners

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information
Experimental Details
Interventions
Intervention(s)
The intervention of our experiment is to generate a monthly “Performance scorecard” for bureaucrats in charge of making changes to land records in Bangladesh. We will share these scorecards with the bureaucrats and their superiors. The scorecard will contain information on the number of applications processed within 45 working days (the limit for how long a processing time can be according to current regulation) in the past month as well as the number of applications pending for more than 45 working days at the end of each month. In addition to these figures, a percentile ranking among the bureaucrats will be generated so anyone receiving the scorecard can assess the relative performance of the bureaucrat.
Intervention Start Date
2018-09-01
Intervention End Date
2019-03-01
Primary Outcomes
Primary Outcomes (end points)
1. Effect of Performance Scorecard on bureaucrat performance as measured by the scorecards
2. Benefits of Performance Scorecard to applicants
3. Testing predictions of the model outlined in Pre-Analysis Plan
4. Spillover effect on applications not entering the scorecards

All of these outcomes are described in detail in the Pre-Analysis Plan.
Primary Outcomes (explanation)
Secondary Outcomes
Secondary Outcomes (end points)
Secondary Outcomes (explanation)
Experimental Design
Experimental Design
The main identification strategy of the study will be the randomization of which offices the scorecard system is implemented in. Out of 114 Upazila Land Offices currently connected to the eMutation system, 57 will have scorecards generated for them. There are currently 18 offices that have fully implemented the eMutation system so that all applications are processed using the digital system. The randomization will be done separately for the group with the 100% implementation and for the group with partial implementation. After these two groups have been separated the randomization will be stratified using the following strata:

1. Having processed above/below the median number of applications within 45 working days in the months of June and July, 2018 in full implementation group
2. Having processed within the first, second or third tertile number of applications within 45 working days in the months of June and July, 2018 in partial implementation group
3. Having above/below the median number of applications pending for more than 45 working days in full implementation group
4. Having a number within the first, second or third tertile of applications pending for more than 45 working days in partial implementation group

This gives me 13 strata. Within each strata half of the ULOs are assigned to treatment.
Experimental Design Details
Not available
Randomization Method
Stratified (Block) randomization using Stata.
Randomization Unit
Upazila Land Office
Was the treatment clustered?
Yes
Experiment Characteristics
Sample size: planned number of clusters
114 Upazila Land Offices
Sample size: planned number of observations
Approximately 40,000 applications
Sample size (or number of clusters) by treatment arms
57 Treatment Upazila Land Offices, 57 Control Upazila Land Offices
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB
INSTITUTIONAL REVIEW BOARDS (IRBs)
IRB Name
Human Subjects Committee - Yale University
IRB Approval Date
2018-06-20
IRB Approval Number
2000021565
Analysis Plan

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information