Experimental Design Details
This study involves a two-wave survey targeting workers aged 18 to 69 who work as regular employees at large-sized firms in Japan. In Wave 1, workplace norms are elicited from them, and in Wave 2, another set of workers guesses the norms. The details will be summarized as follows:
A. Conducting Survey:
Wave 1:
We will survey 1,000 regular employees at large-sized firms in Japan. The gender distribution of the recruiting sample will reflect that of regular employees at large-sized firms, based on the Employment Status Survey in Japan. Participants will be asked whether they agree or disagree with the following statements:
(i) “Workplace norms in Japan are toxic for employees”
(ii) “Some actions urgently need to be taken to improve workplace norms in Japan for the sake of improving worker welfare and well-being.”
Wave 2:
We will conduct a randomized controlled survey experiment with two conditions (treatment condition and control condition). A total of 4,000 regular employees at large-sized firms will be recruited, with the following breakdowns:
# Treatment group: 2,000 workers consisting of 1,000 female and 1,000 male workers.
# Control group: 2,000 workers consisting of 1,000 female 1,000 male workers.
To allow for an analysis of gender effects, we recruit workers so that each group will be gender balanced. No participants from Wave 1 will be included in Wave 2.
Participants in both conditions will be asked about whether they agree with the same two statements from Wave 1. This question is identical to those in Wave 1. Immediately after this, they will be asked, in a free-form format, what they think are the most important actions that should be taken. Also, Unlike in Wave 1, they will be asked to guess the percentage of workers agreeing with each statement in Wave 1. These guesses are incentivized based on whether their answers are closest to the actual percentage.
The key difference between the treatment and control conditions lies in the information intervention. After providing their opinions and guesses, participants in the treatment group will be informed about the actual results from Wave 1. Control group participants will not receive this information. The rest of the experiment is identical for the treatment and control groups: They will have the following sections in the survey:
1. Questions about their actions or intentions regarding toxic workplace norms and job search
2. Questions about government initiatives supporting family and childcare (i.e., “Kurumin certification” and “Eruboshi certification”)
3. Questions about Japan’s “Work Style Reform Related Laws”
4. Questions to guess workers’ perceptions towards workplace norms and demand for change by gender
5. Questions about perceived social appropriateness on specific workplace behavior (using the method by Krupka and Weber 2013 in JEEA).
# Related to Point 4, we will ask respondents whether they are willing to support the research group in submitting a report—based on the survey results—that summarizes problems in the Japanese workplace environment and encourages improvements, to a newspaper or magazine. This will be done on the condition that the group proceeds only if at least 50% of respondents agree. We will also ask whether they support submitting a petition to the Japanese government, under the same condition.
Note: In both Waves, we will also collect information on demographics (e.g., age, education level, marital status), work experience, tenure, general well-being, and levels of stress.
B. Exclusion Criteria for Fraud Answer/Outliers
To ensure data quality, we will exclude participants from analysis based on the following information:
- Too short or too long survey completion times.
- Too small or too long average LongString index (i.e., the maximum number of consecutive identical responses in matrix-style questions).
- Reported age outside the eligible range (18–69 years old).
- Reported overtime exceeding 168 hours per week (the total number of hours in a week).
In addition, we will perform robustness checks by analyzing the data both including and excluding respondents who fail attention check questions.
C. Hypotheses
H1: Pluralistic ignorance exists regarding (a) workers’ perceptions about toxic workplace norms and (b) demand for changes in Japan.
H1’: The degree of pluralistic ignorance differs by gender.
H2: Providing information about others’ actual opinions breaks the pluralistic ignorance, i.e., increases (i) their tendency to evaluate toxic workplace behaviors as inappropriate, and/or (ii) their willingness to take action to change such norms.
H2’: The effects of the information intervention differ by gender.