The effect of framed labor market messages on training behavior: exploring the role of emotions, beliefs and expectations as well as economic preferences

Last registered on December 20, 2024

Pre-Trial

Trial Information

General Information

Title
The effect of framed labor market messages on training behavior: exploring the role of emotions, beliefs and expectations as well as economic preferences
RCT ID
AEARCTR-0015036
Initial registration date
December 16, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 20, 2024, 1:38 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Maastricht University

Other Primary Investigator(s)

PI Affiliation
ROA
PI Affiliation
ROA

Additional Trial Information

Status
In development
Start date
2024-12-18
End date
2025-01-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
In today’s fast-changing job market, driven by technological advancements and economic shifts, it is more important than ever for people to update their skills throughout their careers. However, many individuals don’t take part in lifelong learning and training, even though it can increase their earnings and improve their overall quality of life. This research aims to understand whether the way labor market information is framed can motivate people to engage in work-related training. We focus on two types of messages: one highlights the benefits of training (gain framing), and the other emphasizes the consequences of not training (loss framing). Using an online information experiment with 1,200 Dutch-speaking participants, we examine how these messages impact people’s emotions (like hope and fear), beliefs, expectations, as well as their attitudes toward training and training behavior. We also explore how personal characteristics—like time and risk preferences, loss aversion, procrastination and self-efficacy - might shape how people respond to these messages.
External Link(s)

Registration Citation

Citation
Kuenn-Nelen, Annemarie, Raymond Montizaan and Anna-Lena Wittich. 2024. "The effect of framed labor market messages on training behavior: exploring the role of emotions, beliefs and expectations as well as economic preferences." AEA RCT Registry. December 20. https://doi.org/10.1257/rct.15036-1.0
Sponsors & Partners

Sponsors

Experimental Details

Interventions

Intervention(s)
The information experiment will be conducted online, utilizing a randomized experimental design with one control group and two treatment groups, as detailed below. Participants will be randomly assigned to one of the groups and receive a tailored information intervention as part of the survey:

Control group: no information

Treatment group 1: General labour market information + more specific labour market information highlighting the benefits of engaging in training (gain-framed message)

Treatment group 2: General labour market information + more specific labour market information highlighting the costs of not engaging in training (loss-framed message)

Specifically, in both treatment groups, we provide information on the changes in the labour market. Following this, each treatment group receives framed information on the potential outcomes of training (see Appendix of additional document for detailed framing information).

Gain-framed message (Treatment Group 1):
Highlights the benefits of engaging in training, such as the opportunity to deepen or update knowledge, the chance to work in a different occupation, the prospects for a future wage increase, the potential for increased job satisfaction, and the opportunity to secure a new job.

Loss-framed message (Treatment Group 2):
Emphasizes the costs of not engaging in training, such as missing the chance to expand knowledge, missing opportunities to work in a different occupation, losing the potential for a future salary increase, missing out on the possibility of greater job satisfaction, and the risk of losing the chance for a new job.
Intervention (Hidden)
Intervention Start Date
2024-12-23
Intervention End Date
2025-01-31

Primary Outcomes

Primary Outcomes (end points)
• The direct effects of the framed labour market information on emotions (e.g., hope, fear), as well as training attitudes and behaviour
• The (mediating) role of labor market beliefs and expectations
Primary Outcomes (explanation)
Emotional Responses
Literature on message framing suggests that emotional reactions, such as fear or hope, can serve as critical pathways through which interventions influence behaviour (Keller et al., 2003). The survey captures both positive and negative emotional responses:
• Positive emotion: three items measuring feelings of hope (Lu, 2016; Nabi & Myrick, 2019; Tao et al., 2023)
• Negative emotion: three items measuring feelings of fear (Tao et al., 2023; Zheng et al., 2022)

Building on research that emphasizes the importance of cognitive mediators in behavior change, the survey measures beliefs and expectations related to training and the labor market:
• Beliefs about training (perceived need for training (need to update skills), benefits of training, cost-benefit ratio of training, concerns about technological change)
• Labor market expectations (including self-perceived employability, the risk of job loss, the likelihood of voluntarily leaving a position, exiting the workforce, pursuing a career change to an entirely different field or profession, or opting for early retirement)

These constructs are included to explore whether the intervention changes perceptions and whether these shifts mediate behavioral intentions.

Outcome measures focus on the core behavioral and intention-based variables of interest:
• Training information acquisition:
- Participants indicate how likely they are to engage information acquisition about training within the 12 months
- Participants indicate how likely they are to take active steps to explore available training options
- Participants indicate whether they would like to be redirected to a website that gives more information about training
• Training intentions: Participants indicate how likely they are to engage in training activities within the next year.
• Overcome training barriers:
- Willingness to invest time: Participants indicate how likely they are to spend additional time outside of working hours on a training program they consider important.
- Willingness to bear costs: Participants indicate how likely they are to personally cover the costs of a training program.
- Willingness to seek employer support: Participants indicate how likely they are to request the necessary time and support from their employer, even if such support is not typically provided.



Secondary Outcomes

Secondary Outcomes (end points)
The moderating influence of economic preferences (including self-efficacy, loss aversion, time and risk preferences, procrastination)
Secondary Outcomes (explanation)
Personality and Economic Preferences
To examine potential moderators, the survey includes validated scales to measure individual traits and preferences that may influence how participants respond to the intervention. These include:
• Self-efficacy (Doll et al., 2021)
• Loss aversion (Cabedo-Peris et al., 2024; Duong et al., 2024)
• Time and risk preferences (Falk et al., 2023)
• Procrastination (Börsch-Supan et al., 2023; Tuckman, 1991)

Experimental Design

Experimental Design
The proposed information experiment will target a sample of 1,200 Dutch-speaking individuals focusing on low- to medium-educated participants who are either employed, seeking employment, or open to job change and development opportunities. Participants will be randomized into three groups (control, gain-framed and loss-framed information treatment), with 400 individuals assigned to each group. Randomization will take place at the individual level to ensure balanced group allocation, and the survey will be administered online to minimize potential spillover effects. The information treatment will be delivered through the survey.

Please note:
- The survey information experiment will run via a Panel Agency.
- Unlike the previous study using the same information intervention (the field experiment) which was conducted within a large employment agency targeting flexible workers, this study will use a broader panel to assess the generalizability of the results to a new population.
Experimental Design Details
Randomization Method
Randomization via Survey Software (Qualtrics)
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
no clusters
Sample size: planned number of observations
1200 individuals (400 per group, 3 groups)
Sample size (or number of clusters) by treatment arms
no clusters - 400 per group
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
Ethical Review Committee Inner City faculties (ERCIC) at Maastricht University
IRB Approval Date
2023-08-16
IRB Approval Number
ERCIC_467_22_06_2023
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials