Managing Digital Technologies: Evidence from a Field Experiment 3

Last registered on July 08, 2022


Trial Information

General Information

Managing Digital Technologies: Evidence from a Field Experiment 3
Initial registration date
July 05, 2022

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 08, 2022, 9:47 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.


Primary Investigator

University of Nottingham

Other Primary Investigator(s)

PI Affiliation
University of Nottingham
PI Affiliation
University of Nottingham

Additional Trial Information

In development
Start date
End date
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
The question how firms improve their productivity is of paramount policy im-
portance for every nation. To harness the benefits from the recent acceleration
of investment in digital technologies, firms must put in place appropriate man-
agement practices. In this paper, we aim to use a field experiment among
UK firms to causally identify the effect of information provision on the perfor-
mance management of a key digital asset - business websites - and the software
technologies used to build them. Specifically, we investigate the importance of
information gap in hindering technology adoption, performance and manage-
ment of digital technologies. For this end, we provide a randomly selected firm
with an information about own website performance, industry common and
best practice together with inputs of digital management and monitoring tools.
After that we assess if these change the adoption of web-based technologies,
and website performance. The information provision or encouragement design
will be carried out to randomly selected firms in the retail industry.
External Link(s)

Registration Citation

Adem, Anwar , Richard Kneller and Cher Li. 2022. "Managing Digital Technologies: Evidence from a Field Experiment 3." AEA RCT Registry. July 08.
Experimental Details


The intervention is an encouragement design, which will provide firms with infor-
mation on their website performance, common and best practice within the indus-
try. The information will be framed to be consistent with best practice performance
management processes for this technology. The information will be sent using mail
and/or email addresses of firms.
Intervention Start Date
Intervention End Date

Primary Outcomes

Primary Outcomes (end points)
Our primary outcome will be indicators for website performance
Primary Outcomes (explanation)
collected from Google Lighthouse

Secondary Outcomes

Secondary Outcomes (end points)
Secondary outcomes include the adoption and retention of website softwares
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
This is a four-arm block or Stratified randomization design. Within each block,
firms are randomly assigned to one of two arms:
1. Control group [C]
2. Benchmark information treated group[T].

Arm-blocks will based on previous adoption of analytics software in the baseline period, and non-adoption, plus the above/below average performance of website performance measures in the baseline.

Experimental Design Details
Randomization Method
We used Stata’s randtreat command to carry out the randomization
Randomization Unit
Random assignment occurs at the firm-level
Was the treatment clustered?

Experiment Characteristics

Sample size: planned number of clusters
7089 firms
Sample size: planned number of observations
7089 firms
Sample size (or number of clusters) by treatment arms
4492 firms using analytics software in baseline; 2597 firms not using analytics in baseline.
Of the 4492 analytics users in baseline; 2246 above average performance in baseline and 2246 below average. Treatment arms 1123 treated and 1123 control firms for above/below average analytics users in baseline.
Of the 2597 analytics users in baseline; 1298.5 above average performance in baseline and 1298.5 below average. Treatment arms 649 treated and 649 control firms for above/below average analytics non-users in baseline.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Not yet available

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number


Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information


Is the intervention completed?
Data Collection Complete
Data Publication

Data Publication

Is public data available?

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials