Testing the Effect of Tax Office and Client Interactions on the Meeting of Employer Obligations

Last registered on June 01, 2017

Pre-Trial

Trial Information

General Information

Title
Testing the Effect of Tax Office and Client Interactions on the Meeting of Employer Obligations
RCT ID
AEARCTR-0000838
Initial registration date
July 14, 2016

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 14, 2016, 1:49 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
June 01, 2017, 1:51 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
Australian National University

Other Primary Investigator(s)

PI Affiliation
Australian National University

Additional Trial Information

Status
Completed
Start date
2016-02-29
End date
2016-12-31
Secondary IDs
Abstract
The objective of this trial is to improve internal procedures and client engagement strategies of the Business Area "Employer Obligations" (EO) within the Australian Taxation Office (ATO). Employers in Australia have tax, superannuation, and other government obligations that vary depending on whether workers are employees or contractors. For employees, employers may have obligations for pay-as-you-go (PAYG) withholding, superannuation, and fringe benefits tax. For contractors, employers may have superannuation obligations. In addition to these obligations, employers may have to meet other federal, state and territory obligations (such as occupational health and safety requirements).

This trial consists of two parts. The first part of the trial aims to assess the effect of changing internal procedures (by adopting the procedures of a different ATO Business Area, "Indirect Tax" (ITX)) on the debt collection rate, the duration of case cycles, and the quality of the interactions between EO field auditors and their clients. The analysis is based on de-identified administrative data provided by the ATO and data obtained from a survey of field auditors at the beginning and the end of the trial.

The second part of the trial intends to improve the interaction between EO desk auditors and their clients. The intervention focuses on studying the effect of changing the contents of letters that desk auditors send to their clients and the effect of changing the script that desk auditors use for phone conversations. The outcome measures are (1) the debt collection rate, (2) the propensity of clients to lodge their tax return, (3) the duration of case cycles, and (4) the quality of interaction between EO desk auditors and their clients (based on a survey of desk auditors at the beginning and the end of the trial).
External Link(s)

Registration Citation

Citation
Biddle, Nicholas and Mathias Sinning. 2017. "Testing the Effect of Tax Office and Client Interactions on the Meeting of Employer Obligations." AEA RCT Registry. June 01. https://doi.org/10.1257/rct.838-2.0
Former Citation
Biddle, Nicholas and Mathias Sinning. 2017. "Testing the Effect of Tax Office and Client Interactions on the Meeting of Employer Obligations." AEA RCT Registry. June 01. https://www.socialscienceregistry.org/trials/838/history/18187
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The trial consists of two parts:

- Part 1: Change in internal procedures used by field auditors of the ATO. Copies of the procedures are provided in Appendix A of the analysis plan.
- Part 2: (a) Change in the script that desk auditors use for phone conversations and (b) change in the contents of a letter that desk auditors send to their clients. Phone scripts are provided in Appendix B of the analysis plan. Sample letters are included in Appendix C of the analysis plan.

The treatment effect of each intervention will be measured by comparing average outcomes between treatment and control group.
Intervention Start Date
2016-02-29
Intervention End Date
2016-12-31

Primary Outcomes

Primary Outcomes (end points)
We will use the following outcome measures in our analysis:

1. Continuous:
- The duration of the case cycle
- The typical duration of the case cycle reported by the auditor (based on survey data, see Appendix F of the analysis plan)
- The duration until the current business activity statement (BAS) is lodged
- The amount owed by the taxpayer at the start of the case
- The amount collected during the audit
- The amount owed by the taxpayer after the case is closed (updates daily with general interest charge)
- The debt estimate raised by ATO during the audit

2. Binary:
- A variable indicating whether an activity statement has been lodged by the taxpayer during the audit
- A variable indicating the status of the BAS after the case is closed
- A variable indicating whether an arrangement has been made with the taxpayer during the audit
- A variable indicating whether the ATO lodged an overdue default assessment

3. Ordered:
- The payment conversations with my clients are easy to establish and maintain (based on survey data, see Appendix F of the analysis plan)
- The payment conversation procedures (e.g. letters sent to clients, telephone scripts, field audit guidelines) are easy for me to understand and implement (based on survey data, see Appendix F of the analysis plan)
- The payment conversation procedures (e.g. letters sent to clients, telephone scripts, field audit guidelines) are helpful in the process of obtaining payment of outstanding liabilities (based on survey data, see Appendix F of the analysis plan)
- Audit cases are referred to the Debt Business Line at an appropriate point in time, so that the chances of obtaining outstanding liabilities are maximised (based on survey data, see Appendix F of the analysis plan)
- It is easy to negotiate payment arrangements for outstanding liabilities (based on survey data, see Appendix F of the analysis plan)
- I encounter clients who are willing to pay outstanding liabilities (based on survey data, see Appendix F of the analysis plan)
- I feel rushed to finish audit cases in order to meet recommended time limits (based on survey data, see Appendix F plan)
- Negotiating payment arrangements with clients is stressful (based on survey data, see Appendix F of the analysis plan)
- I am given sufficient autonomy to make arrangements that will likely result in the payment of outstanding liabilities (based on survey data, see Appendix F of the analysis plan)

4. Survival data:
- The number of days until the current business activity statement (BAS) is lodged
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Our analysis is based on four sub-samples: (A) treatment cases of field auditors, (B) control cases of field auditors, (C) treatment cases of desk auditors, and (D) control cases of desk auditors. We will compare the members of sample A to the members of sample B; the members of sample C will be compared to the members of sample D. Moreover, we will compare the members of each treatment group (A or C) to all members of the two control groups (B and D). We will estimate separate regression models for each of the four comparisons: (Case I) A vs. B, (Case II) C vs. D, (Case III) A vs. B+D, and (Case IV) C vs. B+D.
Experimental Design Details
Randomization Method
Randomization is based on a random variable generator in Stata, using a random choice of the underlying seed. A copy of the Stata code that has been written to randomly assign field and desk auditors to treatment and control groups is included in Appendix D of the analysis plan.
Randomization Unit
Intervention 1: 5 sites; 30 EO field auditors; up to 600 clients. Intervention 2: 2 sites; 12 desk auditors; up to 240 clients.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
Intervention 1: 15 EO field auditors were randomly assigned to the Treatment Group; 15 EO field auditors were randomly assigned to the Control Group; it is expected that each team member will complete about 10 and no more than 20 cases.

Intervention 2: 6 EO desk auditors were randomly assigned to the Treatment Group; 6 EO desk auditors were randomly assigned to the Control Group; it is expected that each team member will complete about 10 and no more than 20 cases.
Sample size: planned number of observations
Intervention 1: 30 EO field auditors; about 300 clients. Intervention 2: 12 desk auditors; about 120 clients.
Sample size (or number of clusters) by treatment arms
Intervention 1: Treatment Group: 15 EO field auditors; about 150 clients; Control Group: 15 EO field auditors; about 150 clients.

Intervention 2: Treatment Group: 6 EO field auditors; about 60 clients; Control Group: 6 EO field auditors; about 60 clients.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Humanities and Social Sciences Delegated Ethics Review Committee of the Australian National University
IRB Approval Date
2016-07-13
IRB Approval Number
2016/375
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
July 14, 2016, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
July 14, 2016, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
37 auditors (27 field auditors, 10 desk auditors) working on 309 cases (215 cases of field auditors, 94 cases of desk auditors
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
309 cases
Final Sample Size (or Number of Clusters) by Treatment Arms
37 auditors (27 field auditors, 10 desk auditors) working on 309 cases (215 cases of field auditors, 94 cases of desk auditors
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Abstract
This paper presents the findings of two Randomized Controlled Trials (RCTs) that were conducted in collaboration with the Australian Taxation Office (ATO). The first trial tests the effect of changes to letters (timing, social norms, color, and provision of information about charitable donations) on response rates of businesses, the timing of payments and the amount of tax debt payments. The second trial consists of two parts. The first part aims to raise awareness of the relevance of tax debt payment by changing internal guidelines used by field auditors. The second part focuses on studying the effect of changing the phone script used by desk auditors to offer assistance with payment arrangements and simplifying a follow-up letter. The findings of the first trial indicate that none of the treatments had a significant effect on any of the outcome measures considered. In contrast, the results of the second trial indicate that changing the phone script of desk auditors and simplifying the follow-up letter reduced the proportion of default assessments raised by the ATO significantly, suggesting that businesses are responsive to certain types of nudges.
Citation
Biddle, Nicholas, Fels, Katja, and Mathias Sinning (2017): Behavioral Insights and Business Taxation: Evidence from Two Randomized Controlled Trials, Tax and Transfer Policy Institute (TTPI) Working Paper No. 2/2017, Australian National University.

Reports & Other Materials