From Annual Measurements to Daily Improvements: Evaluation of a Method for Improving Systematic Work Environment Management

Last registered on March 26, 2025

Pre-Trial

Trial Information

General Information

Title
From Annual Measurements to Daily Improvements: Evaluation of a Method for Improving Systematic Work Environment Management
RCT ID
AEARCTR-0015582
Initial registration date
March 17, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 26, 2025, 8:16 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Mälardalen University

Other Primary Investigator(s)

PI Affiliation
The National Research Centre for the Working Environment (NFA)
PI Affiliation
Mälardalen university
PI Affiliation
Mälardalen univesity
PI Affiliation
Karolinska institute

Additional Trial Information

Status
In development
Start date
2025-03-26
End date
2027-10-06
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This project aims to test and evaluate a practical method for enhancing systematic work environment management (SAM), shifting the focus from identifying deficiencies to achieving goals centered on health-promoting factors. Competence supply is one of the greatest challenges for Swedish municipalities, and deficiencies in organizational and social work environments contribute significantly to sickness absence, poor mental health, and well-being. This issue threatens municipalities' ability to fulfill their responsibilities to citizens. Active systematic work environment management (SAM) has been identified as a potential solution, yet many municipalities rely on annual assessments focused on shortcomings, without providing indicators for concrete solutions, goal achievement, or measurable progress.
There is a lack of knowledge on how SAM should be designed to prioritize health-promoting factors (i.e., workplace conditions that support employee health and sustainable employment) at an organizational level. Additionally, there is a need for goal indicators that are motivating, measurable, and applicable at both unit and organizational levels.

To address these pressing needs, we propose applying the Goal Attainment Scaling (GAS) method. GAS serves as both a goal-setting and evaluation methodology, previously applied successfully at the individual level. We suggest that GAS can help organizations formulate concrete and tailored desired states related to specific interventions, thereby enhancing improvements in health-promoting factors.
GAS offers several advantages for enhancing SAM. First, goal-setting theory suggests that GAS facilitates the establishment of achievable and relevant goals. A participatory design is crucial, fostering a shared mental model of objectives. Second, GAS promotes data-driven decision-making and accountability within SAM, enabling workplaces to systematically assess progress and the impact of work environment initiatives. Third, GAS is versatile and universal, serving as a general framework adaptable to different organizations and their specific contexts and objectives.

The project will address the following research questions:

1. Which health-promoting factors are prioritized, and what organizational-level initiatives are generated to address them?
2. How does the application of GAS (as part of SAM) influence the achievement of goals related to health-promoting factors?
3. How is the use of GAS perceived by different stakeholders (employees, managers, HR representatives)?
4. What facilitators and barriers influence the implementation of GAS and the attainment of goals?

The project will identify and highlight prioritized organizational-level health-promoting factors while mapping successful strategies and practices for addressing them. The expected outcome is the development of a systematic, participatory, and practical method that fosters local engagement in initiative development, goal setting, and follow-up of health-promoting factors within SAM. This work will contribute to the development of measurement methods and outcome metrics for organizational-level health-promoting factors. The resulting knowledge and tools can support the creation of long-term healthy, sustainable, and attractive workplaces within the municipal sector
External Link(s)

Registration Citation

Citation
Heikkilä, Sebastian et al. 2025. "From Annual Measurements to Daily Improvements: Evaluation of a Method for Improving Systematic Work Environment Management ." AEA RCT Registry. March 26. https://doi.org/10.1257/rct.15582-1.0
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The intervention involves the systematic redesign of Goal Attainment Scaling (GAS) in collaboration with municipal partners, structured according to the IGLO framework (Nielsen et al., 2018). This framework encompasses four levels of organizational engagement: individual, group, leadership, and organizational.

The redesign process is initiated through a series of three workshops conducted with key organizational stakeholders at each of these levels. These workshops facilitate the co-development of materials to support the implementation of GAS in workplace settings. Following this phase, the developed materials—comprising worksheets and brochures—are refined in collaboration with our municipal partners. These resources are designed to support the application of GAS in workgroups during monthly workplace meetings.

In the next phase, all managers randomized into the intervention group will participate in structured training sessions on the GAS method during the autumn. The implementation phase will subsequently commence, aligning with the administration of the annual employee survey, which serves as the baseline measure for this study. The impact of the intervention will be evaluated based on outcomes derived from this survey.
Intervention Start Date
2025-10-01
Intervention End Date
2027-10-06

Primary Outcomes

Primary Outcomes (end points)
The results will be derived from the annual employee survey, which will be expanded to include newly implemented questions. These additions will specifically focus on "health factors" rather than traditional risk factors, aligning with a preventive and resource-oriented approach to workplace well-being.







Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Sickness absence data (short and long term), turnover intention
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
This study employs a block randomization procedure across three distinct municipal sector businesses. Following randomization, managers assigned to the experimental group will participate in workshops aimed at collaboratively redesigning the Goal Attainment Scaling (GAS) method. Subsequently, the revised method will be refined in consultation with key organizational stakeholders.

Prior to full-scale implementation, a pilot study will be conducted with three units to calibrate and optimize the method. In the autumn, all managers in the experimental group will receive structured training on the finalized GAS method. Implementation will commence following the training, aligning with the administration of the annual employee survey, which serves as the baseline measurement for this study.

The study consists of 80 units, with 40 units assigned to the experimental group and 40 to the control group. Data collection will be conducted exclusively at the group level, ensuring that only aggregated data from groups consisting of more than five individuals (>5) will be analyzed
Experimental Design Details
Not available
Randomization Method
The study employs a block randomization procedure using R Studio and the Blockrand package.
Randomization Unit
Group level randomization (elderly care, disability, and food sectors).
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
80 units
Sample size: planned number of observations
Approximately 600 pupils.
Sample size (or number of clusters) by treatment arms
18 elderly care, 2 areas food, 18 disability
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Etikprövningsmyndigehten
IRB Approval Date
2024-10-09
IRB Approval Number
2024-05843-01