Beyond Box-Ticking: Bureaucrat-Firm Relationships and Policy Success

Last registered on July 02, 2026

Pre-Trial

Trial Information

General Information

Title
Beyond Box-Ticking: Bureaucrat-Firm Relationships and Policy Success
RCT ID
AEARCTR-0017482
Initial registration date
December 28, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
January 06, 2026, 7:07 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
July 02, 2026, 2:00 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
Georgia State University

Other Primary Investigator(s)

PI Affiliation
The University of Hong Kong
PI Affiliation
Ludwig-Maximilian University of Munich

Additional Trial Information

Status
On going
Start date
2025-11-10
End date
2027-03-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Many active labor market policies in low- and middle-income countries struggle to reduce youth unemployment (McKenzie 2017; Card et al. 2018). A growing literature suggests that the challenge may lie not only in policy design, but also in how policies are implemented by street-level bureaucrats (Besley et al. 2022; Bandiera et al. 2021). In this project, we focus on the performance of bureaucrats tasked with delivering these programs and the potential importance of misaligned incentives. Bureaucrats are frequently evaluated on easily observable, “box-ticking” outputs—such as the number of vacancies collected—rather than on harder-to-monitor outcomes like sustained job placements. This misalignment may skew effort toward the easily observable parts of the job. We study this question in Addis Ababa (Ethiopia), where the Ministry of Labor and Skills operates a large-scale labor market matching program. Local district-level (“woreda”) officials collect vacancy information from firms and recommend registered job seekers, yet program effectiveness has been limited. We ask: can improved measurement of bureaucrat tasks strengthen the effectiveness of an active labor market program?

We work with around 110 woredas, surveying around 450 bureaucrats and 1760 firms. We will conduct a cluster-randomized controlled trial at the woreda level in two intervention waves. In the first wave, all participating woredas receive a digitized vacancy checklist, while a random subset also receives two additional follow-up checklists: one to record referrals of job seekers and another to document actual placements. These tools will be designed to allow measurement of the respective tasks and hence allow for performance evaluation in line with sustained job placements. We will compare the impacts on policy implementation and endline firm outcomes between treated and control woredas.

July 2026 amendment: After Wave 1 and before implementation and outcome verification for the second intervention wave, we propose to add team-leader incentives in selected woredas based on verified referral and hiring outcomes. This amendment is motivated by preliminary Wave 1 evidence suggesting that measurement tools may be more effective when paired with incentives aligned with referrals and placements. The amendment does not change the study population, consent procedures, voluntary participation, or study outcomes.
External Link(s)

Registration Citation

Citation
Barteska, Philipp, Ritwika Sen and David Wu. 2026. "Beyond Box-Ticking: Bureaucrat-Firm Relationships and Policy Success." AEA RCT Registry. July 02. https://doi.org/10.1257/rct.17482-2.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
We collaborate with most woredas in Addis Ababa, Ethiopia. Each woreda Office of Labor and Skills implements a standardized labor market matching policy mandated by the Ministry of Labor and Skills. The policy aims to identify firm vacancies and unemployed jobseekers and to facilitate matches between the two. We focus on three core program components: (1) collecting vacancy information from firms, (2) referring jobseekers to these vacancies, and (3) verifying whether referred jobseekers are ultimately hired by the firms.

We will provide a digitized version of an existing checklist to all woredas – control and treatment. This digital checklist is focused on component (1): collecting vacancies from firms. In the status quo, bureaucrats fill out a pen-and-paper version of this checklist, which they later have to copy into excel for reporting purposes. The digital checklist simplifies this as data entered digitally is immediately exportable into an excel sheet that follows the existing format and reporting requirements. Both team leaders and ground-level bureaucrats (“experts”) have a personal login to the dashboard that highlights key information and allows for downloading of the excel sheet.

For a random subset of woredas, bureaucrats will also be provided with two new (digital) checklists. These checklists are focused on steps that are crucial to the policy’s goal, but which are not measured consistently. In the treated woredas, team leaders and experts will have access to an upgraded dashboard that allows tracking (2) which vacancies have jobseekers referred to them and (3) whether the referred jobseekers end up working at the firm.

July 2026 amendment: The proposed second intervention wave builds on the original random assignment described above. In the first intervention wave, all participating woredas received a list of eight assigned firms for team leaders and experts to visit. The 58 woredas assigned to the Wave 1 treatment arm are referred to here as the “Measurement” arm, because they received the digitized vacancy checklist as well as the additional digitized referral and placement checklists. The 52 woredas assigned to the Wave 1 control arm are referred to here as the “Digitization” arm, because they received the digitized vacancy checklist only.

In Wave 2, study woredas will receive a new list of eight assigned firms with current or future hiring needs, to the extent possible. Among the 58 woredas previously assigned to Measurement, approximately 29 will continue with Measurement Only and 29 will receive Measurement plus Incentives. Among the 52 woredas previously assigned to Digitization, approximately 26 will continue with Digitization Only and 26 will receive Digitization plus Incentives. The incentives will be tied to verified referral and hiring outcomes among the eight assigned firms, as determined by the research team using firm endline data. Payments will be made directly to the team leader.

Within each Digitization woreda, the eight assigned firms will then be randomly divided into two groups according to whether woreda officials use a digitized vacancy checklist or the standard paper checklist during the visit. In Digitization woredas without incentives, four firms in each woreda will be assigned to Pure Control (PC), for which woreda officials will use the standard paper checklist, and four firms will be assigned to Digitization Control (DC), for which officials will use a digitized vacancy checklist. In Digitization woredas with incentives, four firms in each woreda will be assigned to Incentives Only (IO), for which officials will use the standard paper checklist and team-leader incentives will apply. The remaining four firms will be assigned to Digitization and Incentives (DI), for which officials will use a digitized vacancy checklist and team-leader incentives will apply.

All eight assigned firms will remain equally part of the study, regardless of whether woreda officials use a digitized or paper checklist. To avoid suggesting that firms assigned to one checklist format are more important than others, team leaders will be informed that firms were randomly assigned to different checklist formats for research purposes. For firms assigned to the paper checklist condition, team leaders, not the responsible experts, will also be asked to collect and photograph the completed paper checklist and submit the photograph to the survey team.
Intervention Start Date
2025-12-29
Intervention End Date
2026-12-05

Primary Outcomes

Primary Outcomes (end points)
The primary outcomes for this study will be measured under three key domains:

0. Take Up of Digital Checklist by Bureaucrats
- Adoption of digital checklists: (i) any checklist submitted by a woreda? (ii) number of checklists submitted; (iii) share of assigned firms for which a (relevant) checklist was completed.
Note: Vacancy checklist for both control and treatment woredas; Referral and Follow-up checklist only for treatment woredas.

1. Policy Implementation Metrics Focused on Firms:
- Firm-reported frequency of site visits by woreda officials
- Share of firms that post at least one vacancy through the woreda
- Share of firms with vacancies where >0 jobseekers recommended by woreda
- Share of vacancy types where >0 jobseekers recommended by woreda

2. Firms’ willingness to take up the policy:
- Firms’ willingness to hire (suitable) jobseekers from the woreda in the future, including wage offers for job seekers
- Firms’ perceptions of the woreda office including: levels of trust in bureaucrats, belief that woreda office will find suitable jobseekers, and satisfaction with prior interactions.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
The secondary outcomes for this study will be measured under two key domains:

1. Downstream firm outcomes
- Share of firms where >0 woreda-recommended jobseekers start working
- Share of firms with vacancies where >0 woreda-recommended jobseekers start working
- Share of vacancy types where >0 woreda-recommended jobseekers start working

2. Policy Implementation Metrics Focused on the Organization:

- Embeddedness measures: (i) share of time spent interacting with firms; (ii) number of firms whose phone number a bureaucrat can name;

- Bureaucrat beliefs: (i) how many jobs are created per vacancy collected?; (ii) how many vacancies need to be collected to create n jobs?

- Goals/Evaluation content: (i) is one of the top 3 KPIs related to post-vacancy collection tasks?

- Adherence with pre-specified policy guidelines (0/1) linked to: vacancy collection, job seeker referrals and follow up.
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We collaborate with most woredas in Addis Ababa, Ethiopia.

For a random subset of woredas, bureaucrats will also be provided with two new checklists. Team leaders from the treated woredas will be able to monitor the progress and measure bureaucrats’ performance for both vacancy collection and the subsequent follow-ups.
After the intervention, we will conduct an endline survey of bureaucrats and firms involved in the intervention, to compare the impacts on policy implementation and outcomes between treated and control woredas.

July 2026 amendment: The proposed second intervention wave builds on the original random assignment described above. As described in the intervention section, the Wave 1 treatment arm is referred to here as Measurement and the Wave 1 control arm as Digitization.

In Wave 2, Measurement woredas will be randomized between Measurement Only and Measurement plus Incentives, while Digitization woredas will be randomized between Digitization Only and Digitization plus Incentives. Within Digitization woredas, assigned firms will also be randomized between paper and digitized vacancy checklist formats.

This amended design allows us to assess whether the effects of enhanced measurement only exist when measurement is aligned with team leaders’ incentives, whether incentives affect outcomes independently of enhanced measurement, whether digitized vacancy checklists affect implementation relative to paper checklists, and whether measurement effects differ depending on whether officials already knew a firm's current vacancy status.
Experimental Design Details
Not available
Randomization Method
Randomization done in office by a computer using the software Stata.
Randomization Unit
The unit of randomization is the woreda (local district level in Addis Ababa). July 2026 update: an additional randomization will be carried out at the firm-level for within Digitization Only and Digitization plus Incentives woredas.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
Target: 110 woredas

Sample size: planned number of observations
Target: 110 woredas, 450 bureaucrats, 1760 firms
Sample size (or number of clusters) by treatment arms
Original Target: 55 clusters (880 firms over two waves) control; 55 clusters (880 firms over two waves) treated

July 2026 Target: Wave 1 assigned 58 woredas to Measurement (digitized vacancy, referral, and placement checklists) and 52 woredas to Digitization (digitized vacancy checklist) in practice. Proposed Wave 2 splits the 58 Measurement woredas into 29 Measurement Only and 29 Measurement plus Incentives, and splits the 52 Digitization woredas into 26 Digitization Only and 26 Digitization plus Incentives. Within Digitization woredas in Wave 2, assigned firms will be randomly split within woreda between paper and digitized vacancy checklist conditions: Pure Control, Digitization Control, Incentives Only, and Digitization and Incentives.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
The Ethics Commission, Department of Economics, University of Munich
IRB Approval Date
2025-10-15
IRB Approval Number
2025-12