Evaluation of a review screen in an online registration form

Last registered on December 23, 2020

Pre-Trial

Trial Information

General Information

Title
Evaluation of a review screen in an online registration form
RCT ID
AEARCTR-0006971
Initial registration date
December 22, 2020

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 23, 2020, 6:44 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Behavioural Economics Team of the Australian Government

Other Primary Investigator(s)

PI Affiliation
BETA
PI Affiliation
BETA

Additional Trial Information

Status
On going
Start date
2020-12-16
End date
2021-12-31
Secondary IDs
Abstract
Behavioural Economics Team of the Australian Government (BETA) is evaluating the effect of presenting additional prompts/warnings in an online Government form.
External Link(s)

Registration Citation

Citation
Bromwich, Andrew, BETA Team Registration and Andrei Turenko. 2020. "Evaluation of a review screen in an online registration form." AEA RCT Registry. December 23. https://doi.org/10.1257/rct.6971
Sponsors & Partners

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information
Experimental Details

Interventions

Intervention(s)
Details of this intervention are kept private until the trial is complete.
Intervention Start Date
2020-12-16
Intervention End Date
2021-03-02

Primary Outcomes

Primary Outcomes (end points)
Details of this intervention are kept private until the trial is complete.
Primary Outcomes (explanation)
Details of this intervention are kept private until the trial is complete.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Details of this intervention are kept private until the trial is complete.
Experimental Design Details
This trial is a field experiment in the form of a simple two arm randomised controlled trial, with equal randomisation between treatment and control conditions.

Outcome measures:

1. [Primary] Accuracy of registration. We are using a proxy measure (accuracy of the Grantor Identifier component of the registration) to assess the proportion of ‘accurate’ registrations in each condition. To measure the accuracy of registrations, we will cross-reference information from the PPSR forms with the Australian Business Register and the Australian Securities Investment Commission databases. We will treat this outcome as binary (correct / incorrect)
2. [Primary] Changes made after review point. We will examine whether or not users make changes to the form after the encounter the review point. We will treat this as a binary variable (made changes / did not make changes).
3. [Secondary] Ease of use. We will conduct a four-question survey at the end of the form. Two of these questions will be used for this outcome measure:
• How did you find the registration process?
• How helpful did you find the review screen?
Both questions are answered on a 4-point Likert scale, converted to a continuous variable for the purposes of analysis.
4. [Secondary] Time taken after review point. We will measure the amount of time taken by participants after the first point at which they reach the review screen until they submit the registration. We will also measure the time spent on the review screen itself.
5. [Secondary] Navigation back and forth after review point. We will examine the number of movements back and forth between the review page and other parts of the form after users are exposed to the review screen.
Randomization Method
Randomisation will be conducted by field partner, assigning accounts to treatment or control at a 1:1 ratio.
Randomization Unit
Randomisation will be clustered at the ‘Account’ level.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
2200 accounts
Sample size: planned number of observations
4,970 observations
Sample size (or number of clusters) by treatment arms
Approximately 1100 accounts in the control condition, 1100 accounts in the treatment condition
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Using a conservative ICC estimate of 0.2, and assuming an alpha of 0.1 and power of 0.8, an effective sample size of around 4,970 registrations would allow for a minimum detectable effect size of about 3.5 percentage point change at a base accuracy rate of 60%.
IRB

Institutional Review Boards (IRBs)

IRB Name
Human Research Ethics Committee (HREC) Humanities and Social Sciences, Macquarie University
IRB Approval Date
2020-12-01
IRB Approval Number
52020932222681
Analysis Plan

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials