Evaluation of a review screen in an online registration form

Last registered on December 23, 2020

View Trial History

Pre-Trial

Trial Information

General Information

Title

Evaluation of a review screen in an online registration form

RCT ID

AEARCTR-0006971

Initial registration date

December 22, 2020

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published

December 23, 2020, 6:44 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Country

Australia

Region

ACT

Primary Investigator

Name

BETA Team Registration

Affiliation

Behavioural Economics Team of the Australian Government

Contact Primary Investigator

Other Primary Investigator(s)

PI Name

Andrew Bromwich

PI Affiliation

BETA

Contact Investigator

PI Name

Andrei Turenko

PI Affiliation

BETA

Contact Investigator

Additional Trial Information

Status

On going

Start date

2020-12-16

End date

2021-12-31

Keywords

Behavior, Governance

Additional Keywords

behavioural economics, registries, forms, field experiments

JEL code(s)

C21, C93, D91, D80

Secondary IDs

Abstract

Behavioural Economics Team of the Australian Government (BETA) is evaluating the effect of presenting additional prompts/warnings in an online Government form.

External Link(s)

Registration Citation

Citation

Bromwich, Andrew, BETA Team Registration and Andrei Turenko. 2020. "Evaluation of a review screen in an online registration form." AEA RCT Registry. December 23. https://doi.org/10.1257/rct.6971-1.0

Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Experimental Details

Interventions

Intervention(s)

Details of this intervention are kept private until the trial is complete.

Intervention Start Date

2020-12-16

Intervention End Date

2021-03-02

Primary Outcomes

Primary Outcomes (end points)

Details of this intervention are kept private until the trial is complete.

Primary Outcomes (explanation)

Details of this intervention are kept private until the trial is complete.

Secondary Outcomes

Secondary Outcomes (end points)

Secondary Outcomes (explanation)

Experimental Design

Details of this intervention are kept private until the trial is complete.

Experimental Design Details

This trial is a field experiment in the form of a simple two arm randomised controlled trial, with equal randomisation between treatment and control conditions.

Outcome measures:

1. [Primary] Accuracy of registration. We are using a proxy measure (accuracy of the Grantor Identifier component of the registration) to assess the proportion of ‘accurate’ registrations in each condition. To measure the accuracy of registrations, we will cross-reference information from the PPSR forms with the Australian Business Register and the Australian Securities Investment Commission databases. We will treat this outcome as binary (correct / incorrect)
2. [Primary] Changes made after review point. We will examine whether or not users make changes to the form after the encounter the review point. We will treat this as a binary variable (made changes / did not make changes).
3. [Secondary] Ease of use. We will conduct a four-question survey at the end of the form. Two of these questions will be used for this outcome measure:
• How did you find the registration process?
• How helpful did you find the review screen?
Both questions are answered on a 4-point Likert scale, converted to a continuous variable for the purposes of analysis.
4. [Secondary] Time taken after review point. We will measure the amount of time taken by participants after the first point at which they reach the review screen until they submit the registration. We will also measure the time spent on the review screen itself.
5. [Secondary] Navigation back and forth after review point. We will examine the number of movements back and forth between the review page and other parts of the form after users are exposed to the review screen.

Randomization Method

Randomisation will be conducted by field partner, assigning accounts to treatment or control at a 1:1 ratio.

Randomization Unit

Randomisation will be clustered at the ‘Account’ level.

Was the treatment clustered?

Yes

Experiment Characteristics

Sample size: planned number of clusters

2200 accounts

Sample size: planned number of observations

4,970 observations

Sample size (or number of clusters) by treatment arms

Approximately 1100 accounts in the control condition, 1100 accounts in the treatment condition

Minimum detectable effect size for main outcomes (accounting for sample design and clustering)

Using a conservative ICC estimate of 0.2, and assuming an alpha of 0.1 and power of 0.8, an effective sample size of around 4,970 registrations would allow for a minimum detectable effect size of about 3.5 percentage point change at a base accuracy rate of 60%.

Supporting Documents and Materials

IRB