Back to History Current Version

Upgrading Management Technology in Colombia

Last registered on January 03, 2017

Pre-Trial

Trial Information

General Information

Title
Upgrading Management Technology in Colombia
RCT ID
AEARCTR-0000528
Initial registration date
October 17, 2014

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 17, 2014, 2:38 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 03, 2017, 3:32 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
World Bank

Other Primary Investigator(s)

PI Affiliation
World Bank
PI Affiliation
World Bank

Additional Trial Information

Status
On going
Start date
2013-11-01
End date
2017-11-30
Secondary IDs
Abstract
The key objectives of this research are i) to test whether a scalable and cost-effective approach to closing the gap in management practices between developing and more developed countries can be implemented; and ii) to measure the impact of closing this management gap on firm productivity and profitability. It will do this by means of a randomized experiment in Colombia, which will allocate firms into three groups: a control group who just receive a diagnostic on their management practices, an individualized treatment group who receive one-on-one consulting to improve 5 different processes: Logistics, Human Resources, Finance, Marketing and Sales, and Production; and a treatment group in which management improvements will be implemented in a small group setting, analogous to agricultural extension, with firms learning from one another. The interventions take place over a 6 month period and are intended to improve growth, productivity, and the scope for innovation in these businesses.
External Link(s)

Registration Citation

Citation
Iacovone, Leonardo, William Maloney and David McKenzie. 2017. "Upgrading Management Technology in Colombia." AEA RCT Registry. January 03. https://doi.org/10.1257/rct.528-2.0
Former Citation
Iacovone, Leonardo, William Maloney and David McKenzie. 2017. "Upgrading Management Technology in Colombia." AEA RCT Registry. January 03. https://www.socialscienceregistry.org/trials/528/history/12897
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The first phase is common to all firms, and includes a detailed diagnostic of 5 different areas (Logistics, Human Resources, Finance, Marketing and Sales, and Production) implemented by a team of 6 consultants, 5 of them specialists in each specific area analyzed and one team leader coordinating the process. This diagnostic phase lasts 2 full-time weeks and is completed by a report that analyzes both managerial practices for each one of these areas and key performance indicators associated with each one of the areas analyzed

There are two interventions being piloted, which will be received by different treatment groups:

1) Individual consulting services support: Firms assigned to this group will receive individual support of a team of 5 consultants for 5 different processes: Logistic, Human Resources, Finance, Marketing and Sales, and Production during a period of 4-6 months to implement a set of improved managerial practices prioritized for their potential impact on growth and productivity of the businesses based on the diagnostic performed in phase one.

2) Group consulting services support: Firms assigned to this group will receive group support of a team of 6 consultants for 4-6 months to implement a set of improved managerial practices prioritized for their potential impact on growth and productivity of the businesses based on the diagnostic performed in phase one. The difference with the individual support is that groups of 5 or 6 firms located in the same region receive a group intervention. Leaders from the firms in a group sign an agreement to work together and help each other improve. Training in particular topic areas first occurs in a group class setting, with each firm sending the people in charge of that production process along. This is then followed up by in-person demonstrations, with group members being able to learn from each other, so that an improvement in practice in one firm can be observed and mimicked by others in the group. Groups are formed so that members are not direct competitors to one another, but instead are producing complementary products with similar management problems.
Intervention Start Date
2014-02-01
Intervention End Date
2015-05-30

Primary Outcomes

Primary Outcomes (end points)
We will examine impacts at three key levels of the causal chain: first whether the interventions lead to improvements in management practices; second, whether these improvements in management practices lead to changes in factory operations (such as changes in machine downtime rates, electricity usage, quality defect rates, and labor hours); and thirdly, whether these changes ultimately lead to higher production, improved productivity, greater sales, and higher profitability.

The exact measures will depend on data availability, and particularly on what measures can be reliably compared across different groups without being affected by the intervention. We plan in particular to focus on four key outcomes:
* Management practices
* Production levels
* Employment levels
* Sales
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Following the diagnostic, we dropped firms with fewer than 10 workers, to leave a sample of 159 firms for the experiment. We then formed matched triplets of firms, choosing this grouping in a way to minimize the Mahalanobis distance between firms in a triplet in terms of their geographic location, size, labor productivity, and management practices. This took place in November 2013. Then within each triplet, firms were randomly allocated to a control group and two treatment groups. Each group consists of 53 firms.
Experimental Design Details
Randomization Method
Randomization within triplets was done in a semi-public setting, with representatives of government and industry observing.
Randomization Unit
Randomization at the level of the individual firm.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
No clusters
Sample size: planned number of observations
159 firms
Sample size (or number of clusters) by treatment arms
53 firms to control, 53 to individual consulting treatment, 53 to group consulting treatment
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
The proposed study details with a single industry, and collects very detailed data at a monthly frequency. These two features help to ensure we have sufficient power to detect meaningful treatment effects of interest. In particular, we have more than 5 times the number of firms in each treatment group as was the case in the Bloom et al. (2013) study, which was still able to detect significant impacts. First consider our power to detect a change in management practices. During the diagnostic phase, the index collected by CNP of all management practices has a mean of 0.46 (out of 1) and standard deviation of 0.10. Even without any controls we would still have 80 percent power to detect a change of approximately 5.5 percentage points in the proportion of desirable management practices that are implemented – and power to detect even smaller impacts once additional controls are used. Given the intensity of the intervention and the evidence from India, we expect at least this much of a change in management practices. Second, consider our power to detect an increase in productivity. Labor productivity at baseline has a mean of 30.76 and standard deviation of 18.29. Labor productivity here is annual sales (in millions of Colombian pesos) per employee, so 30.76 indicates sales per worker of approx..US$14,600. We will have this data at a monthly level, with 12 months pre-intervention, and 12 months post-intervention. Assuming an autocorrelation of 0.5 then gives us power of 95.1 percent to detect a 10% increase in productivity, again without taking into account power gains from the random assignment within matched triplets. This allows us to detect an effect smaller than the size measured in Bloom et al. (2013), whilst allowing room for attrition to potentially reduce the sample slightly. Taken together we view these calculations as indicating we have sufficient power to detect meaningful treatment effects of interest.
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials