Evaluating prompts and a more intuitive layout in an online registration form

Last registered on October 10, 2021

Pre-Trial

Trial Information

General Information

Title
Evaluating prompts and a more intuitive layout in an online registration form
RCT ID
AEARCTR-0008355
Initial registration date
October 10, 2021
Last updated
October 10, 2021, 9:53 PM EDT

Locations

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information

Primary Investigator

Affiliation
Behavioural Economics Team of the Australian Government

Other Primary Investigator(s)

PI Affiliation
BETA
PI Affiliation
BETA

Additional Trial Information

Status
On going
Start date
2021-07-28
End date
2022-02-28
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Behavioural Economics Team of the Australian Government (BETA) is evaluating the effect of presenting additional prompts/warnings and introducing a new layout in an online Government form.
External Link(s)

Registration Citation

Citation
Team Registration, BETA, Andrei Turenko and Belinda Xie. 2021. "Evaluating prompts and a more intuitive layout in an online registration form." AEA RCT Registry. October 10. https://doi.org/10.1257/rct.8355-1.0
Sponsors & Partners

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information
Experimental Details

Interventions

Intervention(s)
Details of this intervention are kept private until the trial is complete.
Intervention Start Date
2021-07-28
Intervention End Date
2021-10-20

Primary Outcomes

Primary Outcomes (end points)
Transaction Accuracy
Primary Outcomes (explanation)
We will measure transaction accuracy using a proxy. We will cross-reference key information used to identify the ‘grantor’ with the Australian Business Register (ABR) and the Australian Securities Investment Commission (ASIC) databases. This is a binary measure; a registration will be either ‘correct’ or ‘incorrect’.

Secondary Outcomes

Secondary Outcomes (end points)
Perceived Ease of Use
Drop-Out Rates
Secondary Outcomes (explanation)
Perceived Ease of Use will be measured by a survey.
Drop-Out Rates will be measured by Google Analytics and/or admin data.

Experimental Design

Experimental Design
This trial is a field, clustered, randomised controlled trial.
Experimental Design Details
Not available
Randomization Method
Randomisation will be conducted by field partner, assigning accounts to treatment or control at a 1:1 ratio.
Randomization Unit
Randomisation will be clustered at the ‘Account’ level.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
1,500 accounts
Sample size: planned number of observations
3,375 PPSR registrations
Sample size (or number of clusters) by treatment arms
Approximately 750 accounts in the control condition, 750 accounts in the treatment condition.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Based on a historical ICC of 0.85, a sample size of around 1,500 users would allow for a minimum detectable effect size of about 4.5 percentage point change at a base accuracy rate of approximately 80%. The above calculation assumes conventional power of 0.8, but deviates from convention to an alpha of 0.1. We believe the practical risks associated with making a Type I error are small, therefore we have opted to increase alpha in order to achieve a reasonable level of statistical power.
IRB

Institutional Review Boards (IRBs)

IRB Name
Human Research Ethics Committee (HREC) Humanities and Social Sciences, Macquarie University
IRB Approval Date
2021-07-12
IRB Approval Number
520211034730302
Analysis Plan

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information