Government agents’ capacity and MSME performance

Last registered on May 13, 2024

Pre-Trial

Trial Information

General Information

Title
Government agents’ capacity and MSME performance
RCT ID
AEARCTR-0013531
Initial registration date
May 07, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
May 13, 2024, 12:22 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
University of Warwick

Other Primary Investigator(s)

PI Affiliation
Central European University
PI Affiliation
University of Indonesia

Additional Trial Information

Status
In development
Start date
2024-05-08
End date
2025-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
MSME capabilities can be more effectively improved with customized programs such as mentoring or peer interactions. But we lack evidence on how the government can implement and scale such programs. To make progress, we study a government-run small-group mentoring program provided to thousands of MSMEs each year in Depok City, Indonesia. We introduce three randomized interventions to 2,200 firms and 63 mentors. (1) We randomize admittance to evaluate whether a government-run program can achieve similar gains as researcher-run programs. (2) We improve the government’s delivery capacity by training and monitoring mentors, to study the effect of state capacity on program effectiveness. (3) We enhance content on marketing practices, to evaluate the effect of providing content demanded specifically by the MSMEs. The results can help design scalable programs that meaningfully improve MSME performance.
External Link(s)

Registration Citation

Citation
Stegmann, Andreas, Adam Szeidl and Muhammad Halley Yudhistira. 2024. "Government agents’ capacity and MSME performance." AEA RCT Registry. May 13. https://doi.org/10.1257/rct.13531-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
We administer two interventions to selected mentors who deliver weekly mentoring sessions to local MSMEs:

Intervention to improve mentoring delivery capacity.

This intervention will consist of the following elements: (i) two days of training in communication and organizational skills, and (ii) improved monitoring, in which a dedicated expert we hire regularly attends the meetings of these mentors, gives feedback about mentoring techniques, and is available for consultations.

Intervention about marketing practices.

This intervention will consist of the following elements: (i) two days of training about marketing and sales practices that are geared to the type of MSMEs in our sample. The training also covers the steps to obtain a halal certification, and (ii) monitoring specifically about marketing by dedicated experts who will provide additional feedback to mentors specifically about the marketing and halal certification process.
Intervention Start Date
2024-05-29
Intervention End Date
2024-11-30

Primary Outcomes

Primary Outcomes (end points)
Firm performance, mentor practices, and mentee business practices.
Primary Outcomes (explanation)
Firm performance, including main outcomes such as revenue, profits, costs, as well as intermediate outcomes such as the number of clients, price, consumer evaluation by mystery shoppers, new product introduction, investments in tools, etc. These provide both headline measures of the effects of the treatment arms, and some evidence on the mechanisms.

Mentor practices. We will look at practices as measured by our enumerators in the meetings. Our focus is whether the enhanced delivery and enhanced content changed the number or the type of mentoring practices. We will also look at mentors’ satisfaction with the program and mentees’ satisfaction with the mentors.

Mentee business practices. These measure whether better mentor practices lead to the adoption of more mentee practices. Of particular interest are marketing-related practices, including online sales and obtaining a halal certificate.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We conduct training and monitoring to selected mentors who are responsible to train and mentor local MSMEs. We randomize mentees and mentors into the following nested treatment arms, which feature an increasing set of features:

C: Control (350 firms). These applicant firms meet the eligibility criteria but will not be accepted to the program.

T1: Mentoring program (~360 firms, 21 mentors). These firms are accepted and receive the program as designed by the government.

T2: Mentoring with enhanced capacity (~360 firms, 21 mentors). In addition to T1, for these firms we improve delivery capacity.

T3: Mentoring with enhanced capacity and content (~360 firms, 21 mentors). In addition to T2, we improve content.

To create the control group, in our first intervention we randomize acceptance to the program. We plan to pre-select a pool of about 2,000 applicants who meet the minimum requirements of our government partner. Out of these, we randomize about 1,450 to be accepted to the program, and about 350 to be denied acceptance due to space constraints. The latter constitute our pure control group. This randomization will be stratified at the level of the 11 subdistricts.
Experimental Design Details
Not available
Randomization Method
Randomisation done in office by a computer
Randomization Unit
We will randomize the acceptance into the program at the individual level, stratified at the level of subdistricts. We will randomize the treatment status at the mentor/village level.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
63 mentors/villages.
Sample size: planned number of observations
63 mentors at sub-district level 18 supervisory mentors 1100 mentees 350 control MSMEs
Sample size (or number of clusters) by treatment arms
C: Control (350 firms).
T1: Mentoring program (~360 firms, 21 mentors).
T2: Mentoring with enhanced capacity (~360 firms, 21 mentors).
T3: Mentoring with enhanced capacity and content (~360 firms, 21 mentors).
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Indonesia - KEP LPEM
IRB Approval Date
2024-05-07
IRB Approval Number
014/UN2.F6.D2.LPM/PPM.KEP/V/2024
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information