Back to History Current Version

Benchmarking: Field Evidence from Singapore

Last registered on June 27, 2019

Pre-Trial

Trial Information

General Information

Title
Benchmarking: Field Evidence from Singapore
RCT ID
AEARCTR-0003216
Initial registration date
October 08, 2018

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 09, 2018, 1:53 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
June 27, 2019, 12:55 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
NUS Business School

Other Primary Investigator(s)

PI Affiliation
NUS Business School
PI Affiliation
NUS Business School

Additional Trial Information

Status
On going
Start date
2019-06-01
End date
2021-01-31
Secondary IDs
Abstract
Benchmarking -- the provision of information on relative performance and best practices -- has been widely advocated as a tool to help businesses improve performance. To investigate the causal impact of benchmarking on business performance, we plan a randomized controlled trial among owners of cooked food stalls in Singapore food courts. Food courts, which are owned by the government or commercial businesses, lease stalls to individual food and beverage vendors. This context is ideal for our research as those stalls compete in well-defined niches, use similar technologies, and do not suffer from any internal principal-agent problem. Our experiment will subject stall owners to three benchmarking treatments: performance, practices, and both performance and practices. We will also investigate the channel(s) by which benchmarking motivates businesses to change management practices and adopt new technologies.
External Link(s)

Registration Citation

Citation
Hou, Yun, Ivan Png and Charmaine Tan. 2019. "Benchmarking: Field Evidence from Singapore." AEA RCT Registry. June 27. https://doi.org/10.1257/rct.3216-3.0
Former Citation
Hou, Yun, Ivan Png and Charmaine Tan. 2019. "Benchmarking: Field Evidence from Singapore." AEA RCT Registry. June 27. https://www.socialscienceregistry.org/trials/3216/history/48738
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
We will randomly assign the food courts to two groups, and only enroll individually-owned vendors into the experiment. All the enrolled vendors within each food centre would be assigned to the same manipulation condition.

A. Control group;
B. Performance benchmarking group;
C. Practice benchmarking group;
D. Performance with practice benchmarking group.

Stall owners in all groups will be given a report on four measures of performance -- sales volume (number of plates sold per week), average cost per plate, profit per plate, and profit per owner working hour (the latter calculated as sales revenue minus total cost divided by total hours worked by the stall owner).

Apart from performance indicators, the report to stall owners in the performance benchmarking group will also include their performance relative to the first, second, and third quartiles of all stalls selling cooked food. The report to stall owners in the practice benchmarking group will also include three managerial or technology best practices, randomly selected from the ten practices identified by the regression analysis. The report to the combined performance with practice benchmarking group will include both performance and practice benchmarking information.
Intervention Start Date
2019-08-01
Intervention End Date
2019-08-15

Primary Outcomes

Primary Outcomes (end points)
Sales revenue; cost; owner productivity; management and technology practices.
Primary Outcomes (explanation)
1. Owner productivity: We measure food stall productivity by owner productivity, calculated as the sales revenue minus total cost divided by the number of owner-hours worked.
2. Management practices: Include whether vendors keep systematic accounting records, adopt incentive-based salary schemes, get Facebook/Instagram accounts and so forth.
3. Technology practices: Include whether vendors use automatic kitchen equipment, install digital ordering systems and E-payment, adopt calling pager and so forth.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We plan to conduct the randomized control trial in about 15 food courts in Singapore. We plan to enroll 20-50 individual vendors in each food court to participate in our study.

At Time 0, we will conduct a pre-intervention survey to collect baseline information: sales revenue, cost, working procedures, management practices, adoption of technology, personal background, and psychological profiles.

We will compile the information from the pre-intervention survey and then calculate performance indicators as well as benchmarking information for all vendors. We will then randomly assign the food courts into control group, performance benchmarking group, practice benchmarking group, and performance with practice benchmarking group.

At Time 1, upon completing data collection and analysis, we will contact the four groups and provide the corresponding information (control or treatment respectively).

3 month (Time 2), 12 months (Time 3) and 18 months (Time 4) respectively after the control/intervention visit, we will return to interview all participating vendors to collect information about changes in productivity and management and technology practices.
Experimental Design Details
Randomization Method
Randomization done in office by a computer.
Randomization Unit
Randomization by each row of stalls within one food court.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
15 food courts, with 20-50 vendors from each food court.
Sample size: planned number of observations
vendors.
Sample size (or number of clusters) by treatment arms
20% vendors control, 25% vendors performance benchmarking, 25% vendors under practice benchmarking, and 30% performance with statistics benchmarking.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
NUS Institutional Review Board
IRB Approval Date
2018-10-03
IRB Approval Number
S-18-281E

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials