The Effect of Gendered Language on Perceived Gender Suitability of Occupations: Evidence from an Experiment with Middle School Students

Participants are presented with a list of 25 occupations and sports and asked to indicate whether each is more suitable for men, for women, or for both. The list includes STEM occupations (e.g., engineer, biologist), non-STEM occupations (e.g., lawyer, photographer), and sports (e.g., skiing, cycling). Items are further classified as grammatically declinable — i.e., occupational titles that have distinct masculine and feminine forms in Italian (e.g., ingegnere/ingegnera) — or grammatically invariable — i.e., titles whose form does not vary by gender (e.g., farmacista). Participants are randomly assigned at the individual level to one of three language conditions in which the items are presented: in Condition 1 (generic masculine), all items are presented using masculine grammatical forms; in Condition 2 (pair form), declinable items are presented with both masculine and feminine forms; in Condition 3 (professional domain), items are replaced by their corresponding disciplinary or professional domain labels. To illustrate how the three language conditions work, consider the item "Engineer": in Condition 1 it appears as ingegnere (generic masculine), in Condition 2 as ingegnere/ingegnera (pair form), and in Condition 3 as ingegneria (professional domain). For invariable items such as "Data analyst", the form is identical across Conditions 1 and 2 (analista dati), while Condition 3 uses the domain label (analisi dati).

2026-05-20

2026-06-19

A binary indicator (1 = suitable for both genders, 0 otherwise) for each item × student observation, estimated separately for boys and girls. The main model uses the sample of grammatically declinable items (19 items) for hypotheses H1, H2,H3, and H5. A separate model on grammatically invariable items (6 items) tests hypothesis H4.

For each occupation and sport in the list, participants indicate whether they consider it more suitable for men, for women, or for both. The outcome is a dummy variable equal to 1 if the participant responded "both" for a given item, and 0 otherwise. The estimand is therefore a vector of binary responses per student, estimated separately for boys and girls. Higher values indicate more egalitarian perceptions.
Item categories are captured by a categorical variable with three mutually exclusive values — STEM, non-STEM, and Sport — coded as two dummies with non-STEM as the reference category (D_STEM and D_Sport). The language condition is coded as two dummies (D_pair and D_domain) with generic masculine as the reference category.
Hypotheses H1, H2, H3, and H5 (see below) are tested in the main regression on declinable items. Hypothesis H4 is tested in a separate regression on invariable items only.

The secondary outcome examines whether the effect of linguistic framing on gender suitability perceptions differs between students who participated in the SPARKLE education program and those who did not.

We examine whether participation in SPARKLE, an education program evaluated through an RCT aimed at introducing middle school students to STEM through hands-on laboratory activities and at building awareness of gender stereotypes and self-confidence, moderates the effect of language condition on the primary outcome. This analysis uses the full sample (SPARKLE treated and control students). This analysis is exploratory, given uncertainty about the magnitude of the shift in gender stereotype levels produced by the SPARKLE intervention. The analysis is operationalized as two interaction terms between language condition dummies (D_pair and D_domain) and SPARKLE treatment assignment in an OLS regression, estimated separately for boys and girls. These estimands are complementary to — and do not overlap with — the main SPARKLE pre-registration, which estimates the main effect of SPARKLE on gender suitability perceptions, among other outcomes (for details, see the pre-registration titled "SPARKLE - STEM Practical Activities to Raise Knowledge Learning and Exploration: a cluster-randomised evaluation of a multi-component STEM, gender, and AI educational intervention in Italian middle schools. "); here, the object of interest is the interaction between SPARKLE and linguistic framing.

This is a three-arm between-subjects experiment embedded in the follow-up questionnaire of the SPARKLE RCT. The primary analytic sample is restricted to the control group of the SPARKLE RCT to obtain an uncontaminated estimate of the effect of linguistic framing. Students are randomly assigned at the individual level to one of three language conditions for a survey question presenting a list of 25 occupations and sports and asking whether each is more suitable for men, for women, or for both. The three conditions differ only in how the occupational items are linguistically framed: generic masculine job title, pair form (both masculine and feminine), or the profession name. Randomization to language condition is independent of prior assignment to the SPARKLE treatment.

Not available

Individual-level randomization using a computer-generated random assignment algorithm (python within oTree) at the time of questionnaire administration.

Individual student

No

Standard errors are clustered at the individual level to account for the multiple observations per student (one per item). 785 students (assuming no absenteism during the day of the survey).

19 (professions) x 785 (pupils) = 14,915

Condition 1 (generic masculine): approx. 261
Condition 2 (pair form): approx. 261
Condition 3 (professional domain): approx. 261

Based on results from the baseline (which included only Condition 3) and had a different list of professions (with some overlap), we estimate a within individual ICC of 0.28. This implies an MDES with no covariates of 0.14 SD which based on the baseline data SD, corresponds to 6.9 percentage points. Including covariates, which are expected to be highly predictive of outcomes (assuming an R2 of 0.5), the MDES is lowered to roughly 0.10SD or 5 percentage points.