Algorithmic Profiling and the Beliefs of Caseworkers and Jobseekers: a Field Experiment in Unemployment Insurance

Last registered on July 06, 2026

Pre-Trial

Trial Information

General Information

Title
Algorithmic Profiling and the Beliefs of Caseworkers and Jobseekers: a Field Experiment in Unemployment Insurance
RCT ID
AEARCTR-0019067
Initial registration date
June 29, 2026

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 06, 2026, 7:15 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Primary Investigator

Affiliation
University of Bristol (and IZA, CESifo)

Other Primary Investigator(s)

Additional Trial Information

Status
Completed
Start date
2012-10-01
End date
2019-07-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This RCT uses an algorithmic profiling prediction as an intervention to affect caseworker beliefs on their clients' (job seekers) chances of finding a job. The trial was conducted within unemployment insurance in Switzerland (at the public employment service agencies of the Canton of Fribourg). Based on an elaborate prediction model, an individual prediction of the expected unemployment duration of the job seeker was provided to the caseworker, in a randomized number of cases. This prediction was supposed to serve as a signal to the caseworker to revise and update her/his own expectation concerning her/his client's unemployment duration. (Earlier evidence has shown that caseworkers are on average too optimistic with respect to the their client's expected duration to finding a job.) The idea was that caseworkers may act on this corrective signal by adjusting their decisions and strategy how to treat their client (using their available instruments of counseling, job search requirements and active labor market policy measures). The final policy intent was that this revision of the treatment strategy should positively affect the job seekers' labor market outcomes.
These steps of expected reactions can be tracked by collected data on caseworkers and job seekers. Thus, this RCT provides a unique set of (linked) data tracing the caseworkers' and the job seekers' activities, behaviors and beliefs, as well as the individual labor market outcomes. A tool within the unemployment insurance register database was used to collect the mentioned data and to provide the algorithmic predictions. The collected behavioral data on job seekers can be used for two purposes: first, they provided important input for the profiling prediction model (in a calibration phase of the project); second, the variables on behaviors and personal characteristics are of analysis interest per se, to better understand job seeker's behaviors. The data is linked at the individual level to the unemployment insurance register data (covering job seeker demographics, all events in the unemployment spell and the use of caseworkers' instruments) and to social security data (covering earnings and employment status post-unemployment).

Registration Citation

Citation
Arni, Patrick. 2026. "Algorithmic Profiling and the Beliefs of Caseworkers and Jobseekers: a Field Experiment in Unemployment Insurance." AEA RCT Registry. July 06. https://doi.org/10.1257/rct.19067-1.0
Sponsors & Partners

Sponsors

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Algorithmic profiling prediction of the client's expected unemployment duration, released to the related UI caseworker
Intervention (Hidden)
The algorithmic profiling prediction of the client's expected unemployment duration, released to the related UI caseworker, was generated by a predicted hazard rate duration model covering a very broad set of detailed explanatory variables: on socio-demographics, past unemployment history and earnings, search behavioral variables (reservation wage, applications quantity and quality, wage expectations, etc) and psychological characteristics (motivation, reliability, self-confidence, etc.) -- the complete list of input variables is in Appendix 2 of the linked report. The model was separately estimated and calibrated for 12 socio-demographic groups of job seekers.
The profiling prediction is shown to the caseworker in two forms: as number of days of expected unemployment duration; and visualised as a "job chances barometer" indication on a relative scale, alongside with a textual statement "The risk of the job seeker realizing a long unemployment duration is: [low, below average, average, above average, high]". On the same screen the caseworker is presented as well her/his own expectation (in days). Thus, the caseworker sees the direct contrast between prediction and expectation, i.e. can see immediately whether s/he over- or underestimates the client's expected unemployment duration or whether s/he is in the same range as the prediction. Appendix 1 of the report describes in detail the tool that provided the profiling prediction, including visuals of the "barometer" and of the (forms for the) collected variables.
Intervention Start Date
2013-09-01
Intervention End Date
2014-04-30

Primary Outcomes

Primary Outcomes (end points)
by unemployment spell:
job seeker perspective: unemployment duration, post-unemployment earnings and employment stability
caseworker perspective: use of instruments (counseling, job search requirements, sanctions, ALMP measures like job search assistance, training and job offer referrals)
Primary Outcomes (explanation)
(the above outcomes are sourced from the UI registry database)

Secondary Outcomes

Secondary Outcomes (end points)
behavioral outcomes, by unemployment spell:
caseworker perspective: belief/expectation of client's unemployment duration -- incl. second measure (update) of belief after about 2 months
job seeker perspective: job-search-behavior variables: reservation wage, number of submitted applications, wage expectations, motivation, quality of applications -- incl. second measure after about 2 months
Secondary Outcomes (explanation)
(these behavioral outcomes were recorded by the caseworkers in the above-mentioned "barometer"/data collection tool)

Experimental Design

Experimental Design
Randomization within caseworker (in 50% of the cases/clients the prediction was shown, in other 50% not). Profiling prediction is shown in a tool within the official UI registry database system. In the tool, the caseworker first needs to record the mentioned data/variables for each case, then, on a next screen, the profiling prediction (and the "barometer", see above) is shown in the treated cases, otherwise not. The tool is used during the first meeting with the client (taking place about 10-14 days after registration at the PES). It is again used in the client meeting about 2 months later -- to collect second observations of the above-mentioned variables.
Experimental Design Details
Randomization Method
Randomization (whether to release the client's profiling prediction to the caseworker or not) is performed in real-time within the tool.
Randomization Unit
Unit of randomization is an individual job seeker spell
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
200 caseworkers in total
Sample size: planned number of observations
4000 job seeker spells in total
Sample size (or number of clusters) by treatment arms
2000 job seeker spells in treatment group, 2000 job seeker spells in control group
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Swiss State Secretariat of Economic Affairs SECO, Directorate of Labor, Department TC (and Labor statistics department for extensive data protection contract)
IRB Approval Date
2012-03-05
IRB Approval Number
N/A

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
April 30, 2014, 12:00 AM +00:00
Data Collection Complete
Yes
Data Collection Completion Date
July 31, 2019, 12:00 AM +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
Realized and recorded sample size (in final experimental phase): 1572 job seekers in treatment group, 1611 job seekers in control group (job seeker spells are unit of randomization). [86 caseworkers in treatment group, 86 caseworkers in control group involved]
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
Realized and recorded sample size (in final experimental phase): 3183 job seeker spells in total
Final Sample Size (or Number of Clusters) by Treatment Arms
Data Publication

Data Publication

Is public data available?
No

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials

Description
Official report of implementation and of outcomes of the RCT
Citation
Arni, P., & Schiprowski, A. (2016). Die Rolle von Erwartungshaltungen in der Stellensuche und der RAV-Beratung : Teilprojekt 2: Pilotprojekt Jobchancen-Barometer: Erwartungshaltungen der Personalberatenden, Prognosen der Arbeitslosendauern und deren Auswirkungen auf die Beratungspraxis und den Erfolg der Stellensuche. SECO Publikation Arbeitsmarktpolitik Nr 43. Staatssekretariat für Wirtschaft SECO.