Evaluation of the Utah Reemployment Services and Eligibility Assessment (RESEA) program: Process and impact evaluation

Last registered on December 16, 2023

Pre-Trial

Trial Information

General Information

Title
Evaluation of the Utah Reemployment Services and Eligibility Assessment (RESEA) program: Process and impact evaluation
RCT ID
AEARCTR-0012284
Initial registration date
December 05, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 06, 2023, 9:05 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
December 16, 2023, 12:07 AM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
University of Utah

Other Primary Investigator(s)

PI Affiliation
University of Utah
PI Affiliation
University of Utah
PI Affiliation
University of Utah
PI Affiliation
University of Utah
PI Affiliation
University of Utah

Additional Trial Information

Status
In development
Start date
2023-12-06
End date
2027-02-28
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The Reemployment Services and Eligibility Assessment (RESEA) program is a grant program administered by the Department of Labor, Employment and Training Administration to participating state workforce agencies. States implement the RESEA program to selected unemployment insurance (UI) claimants, with the goals of addressing reemployment needs and preventing improper payments through strengthened enforcement of UI eligibility requirements. Purposes of the RESEA program include reducing the duration that claimants receive UI benefits by improving employment outcomes; strengthening UI program integrity by detecting eligibility issues among claimants; and acting as an entry point for claimants to other workforce system partners. The primary aim of this evaluation is to assess the impact of Utah’s RESEA program in reducing UI duration and increasing the likelihood of reemployment.

Utah's RESEA program is a statewide intervention for UI claimants administered by the Utah Department of Workforce Services Unemployment Insurance Division (DWS UI). Every week, around 300 to 400 claimants are selected for the RESEA program, with approximately 70% of selected claimants participating. Selected claimants are required to complete an eligibility review and to schedule and participate in a one-on-one meeting with an employment counselor (i.e., the RESEA meeting). The mandatory eligibility review (ER) requires claimants report recent job search activities and ongoing UI eligibility. In the RESEA meeting, claimants meet with the counselor who provides a range of tailored reemployment services. These services include presenting informational resources, discussing job search strategies, reviewing best practices for resumes and interviewing, teaching how to conduct a demand-driven job search and developing an individualized employment plan. Failure to participate in the ER or RESEA meeting can result in denial of UI benefits.

The primary aim of this evaluation is to identify the impact of RESEA on (i) UI duration and (ii) likelihood of reemployment. Secondary aims include estimating its impact on UI benefits, claimant earnings, and multiple process-related outcomes, such as likelihood of denial of benefits and use of reemployment services at employment centers. This evaluation will also examine heterogeneity in the impact of RESEA across claimant socio-demographic characteristics, across counselors, and by the industry-specific unemployment rate (given claimants' employment history).

The impact will be identified using random assignment to the RESEA program or a control group receiving the regular UI program. The randomization will involve two steps: (a) random selection of claimants from the pool of evaluation-eligible claimants, done on a weekly basis as determined by the capacity of the Utah DWS UI; (b) randomization into the RESEA or control groups on a weekly basis. This latter randomization will enable estimation of the impact of RESEA as the difference by assignment to RESEA relative to the control group. RESEA program eligibility criteria include receipt of at least one UI payment and no job deferral. As an additional criterion for the evaluation, only claimants scoring in the 1st through 90th percentile for likelihood to exhaust UI benefits will be eligible for randomization; claimants with the top decile of profiling scores for exhausting UI benefits will be assigned to RESEA and excluded from the evaluation. The randomization process is scheduled to start in December 2023 and end in approximately December, 2025. A randomization ratio of 2:1 for RESEA relative to the control group will be maintained throughout the evaluation. The randomization will continue until the desired sample sizes are obtained (30,000 claimants in treatment group and 15,000 in control group).

Analysis will be conducted using linear regression models with treatment assignment on the right-hand side along with a vector of covariates (including gender, race/ethnicity, education, age, disability status, US citizenship, month of UI filing, UI claim filing time-lapse, number of previous UI claims, years of tenure, severance, industry unemployment rates, number of employers, wages prior to most recent UI claim, country indicators). Furthermore, we intend to analyze heterogeneity in the impact of the RESEA program by interacting treatment assignment with relevant moderators. Appropriate sensitivity tests will be conducted to test the robustness of the estimated effects.
External Link(s)

Registration Citation

Citation
Ahonen, Emily et al. 2023. "Evaluation of the Utah Reemployment Services and Eligibility Assessment (RESEA) program: Process and impact evaluation." AEA RCT Registry. December 16. https://doi.org/10.1257/rct.12284-2.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The Utah Reemployment Services and Eligibility Assessment (RESEA) program involves two main components: (1) review of eligibility for the Unemployment Insurance program; and (2) provision of reemployment services. The first component of the intervention requires that claimants complete an eligibility review where they report recent work search activities and their availability and ability to accept employment. Potential eligibility issues are sent for adjudication and could affect receipt of Unemployment Insurance benefits. The second component involves the provision of a bundle of reemployment services to participants as part of a one-on-one meeting with an employment counselor. These services include a customized reemployment plan, referrals to relevant workshops, information on job search best practices, resume review, and provision of labor market information.
Intervention Start Date
2023-12-06
Intervention End Date
2025-12-31

Primary Outcomes

Primary Outcomes (end points)
Duration of unemployment insurance
Employment status
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Total unemployment insurance benefits received
Probability of exhausting unemployment insurance claim
Probability of filing a new unemployment insurance claim (long-term)
Quarterly wages
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
This study employs a randomized controlled design wherein participants are randomized into treatment group (those who receive the RESEA program) or control group (those who do not receive the RESEA program but continue to participate in the regular unemployment insurance program). We plan to maintain a randomization ratio of 2:1 with twice the number of participants in the treatment group than in the control group.
Experimental Design Details
Not available
Randomization Method
Randomization done in administrative database using random number generator
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
Not applicable
Sample size: planned number of observations
45,000 individuals who are claiming unemployment insurance in Utah
Sample size (or number of clusters) by treatment arms
30,000 individuals treatment (RESEA)
15,000 individuals control
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials

Documents

Document Name
Impact Evaluation Design
Document Type
proposal
Document Description
This document contains the impact evaluation design and plan for the Utah RESEA program. It includes the policy background, research questions, data, sample, methods and threats to validity.
File
Impact Evaluation Design

MD5: 0ea2aba1c7418559a7297b9bb3650bca

SHA1: 4331a6ff48a737ff41ae88c6c1fe3885b6b751fd

Uploaded At: December 05, 2023

Document Name
Process Evaluation Design
Document Type
proposal
Document Description
This document contains the process evaluation design for the Utah RESEA program. It includes sections on background, prior literature, research questions, data, methodological approaches and confidentiality and privacy measures.
File
Process Evaluation Design

MD5: e5d96fe092789cb549b49435267a3fa7

SHA1: 1352b5ec2a947947895e1e1fb21217cc2a09bcab

Uploaded At: December 05, 2023

IRB

Institutional Review Boards (IRBs)

IRB Name
University of Utah Institutional Review Board (this trial received an exemption determination)
IRB Approval Date
2023-12-08
IRB Approval Number
IRB 00166268