Evaluating prompts and a more intuitive layout in an online registration form

Last registered on March 27, 2022
View Trial History

Pre-Trial

Trial Information

General Information

Title
Evaluating prompts and a more intuitive layout in an online registration form
RCT ID
AEARCTR-0008355
Initial registration date
October 10, 2021

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 10, 2021, 9:53 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
March 27, 2022, 5:43 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country
Australia
Region
ACT

Primary Investigator

Name
BETA Team Registration
Affiliation
Behavioural Economics Team of the Australian Government
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Andrei Turenko
PI Affiliation
BETA
Contact Investigator
PI Name
Belinda Xie
PI Affiliation
BETA
Contact Investigator

Additional Trial Information

Status
Completed
Start date
2021-07-28
End date
2022-02-28
Keywords
Finance & Microfinance
Additional Keywords
behavioural economics, registries, forms, field experiments
JEL code(s)
C21, C93, D91, D80
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Behavioural Economics Team of the Australian Government (BETA) is evaluating the effect of presenting additional prompts/warnings and introducing a new layout in an online Government form.
External Link(s)

Registration Citation

Citation
Team Registration, BETA, Andrei Turenko and Belinda Xie. 2022. "Evaluating prompts and a more intuitive layout in an online registration form." AEA RCT Registry. March 27. https://doi.org/10.1257/rct.8355-2.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Details of this intervention are kept private until the trial is complete.
Intervention Start Date
2021-07-28
Intervention End Date
2021-10-20

Primary Outcomes

Primary Outcomes (end points)
Transaction Accuracy
Primary Outcomes (explanation)
We will measure transaction accuracy using a proxy. We will cross-reference key information used to identify the ‘grantor’ with the Australian Business Register (ABR) and the Australian Securities Investment Commission (ASIC) databases. This is a binary measure; a registration will be either ‘correct’ or ‘incorrect’.

Secondary Outcomes

Secondary Outcomes (end points)
Perceived Ease of Use
Drop-Out Rates
Secondary Outcomes (explanation)
Perceived Ease of Use will be measured by a survey.
Drop-Out Rates will be measured by Google Analytics and/or admin data.

Experimental Design

Experimental Design
This trial is a field, clustered, randomised controlled trial.
Experimental Design Details
This trial will be a two-arm clustered randomised field trial, in which users will complete the ‘business-as-usual’ registration form, or the ‘treatment’ registration form with additional prompts and an alternative layout. The unit of randomisation will be PPSR accounts (rather than individual registration forms).

Our population of interest is PPSR account holders, particularly account holders who do not regularly create registrations. Accordingly, trial participants will be PPSR account holders who create a registration during our trial period. We will exclude PPSR account holders that have ever created more than 10 registrations within a single month. All registrations made by new account holders will be included.
Randomization Method
Randomisation will be conducted by field partner, assigning accounts to treatment or control at a 1:1 ratio.
Randomization Unit
Randomisation will be clustered at the ‘Account’ level.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
1,500 accounts
Sample size: planned number of observations
3,375 PPSR registrations
Sample size (or number of clusters) by treatment arms
Approximately 750 accounts in the control condition, 750 accounts in the treatment condition.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Based on a historical ICC of 0.85, a sample size of around 1,500 users would allow for a minimum detectable effect size of about 4.5 percentage point change at a base accuracy rate of approximately 80%. The above calculation assumes conventional power of 0.8, but deviates from convention to an alpha of 0.1. We believe the practical risks associated with making a Type I error are small, therefore we have opted to increase alpha in order to achieve a reasonable level of statistical power.
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
Human Research Ethics Committee (HREC) Humanities and Social Sciences, Macquarie University
IRB Approval Date
2021-07-12
IRB Approval Number
520211034730302
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
October 20, 2021, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
October 20, 2021, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
1,567 account holders
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
4,940 transactions
Final Sample Size (or Number of Clusters) by Treatment Arms
2,561 transactions in business-as-usual condition, 2,379 in treatment condition
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials