Students' Preferences Over Penalties for Wrong Answers

Last registered on April 30, 2025

Pre-Trial

Trial Information

General Information

Title
Students' Preferences Over Penalties for Wrong Answers
RCT ID
AEARCTR-0015574
Initial registration date
April 24, 2025

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
April 30, 2025, 9:11 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
University of Verona

Other Primary Investigator(s)

PI Affiliation
University of Verona
PI Affiliation
University of Verona

Additional Trial Information

Status
In development
Start date
2025-04-29
End date
2026-05-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Multiple-choice exams are widely used in educational settings, whether during course exams or university admissions, carrying important implications on how students are evaluated. A critical evaluators’ dilemma is whether or not to impose penalties for wrong answers. On the one hand, penalties can discourage students from guessing; on the other hand, they tend to disproportionately disadvantage female test-takers, who are found to be more loss-averse than males. The latter finding has been conducive to policy proposals aimed to address and reduce the gender gap in questions skipped. However, little is known about students’ preferences regarding exam penalties, specifically related to both competitive and non-competitive environments, and about how these preferences depend on relevant personal characteristics such as ability, confidence, and gender. To address these questions, we propose a novel experimental design in which we elicit students’ preferences over imposing penalties for wrong answers. We will assess these preferences in both competitive and non-competitive environments.
External Link(s)

Registration Citation

Citation
Castagnetti, Alessandro, Vittoria Levati and Luca Zarri. 2025. "Students' Preferences Over Penalties for Wrong Answers." AEA RCT Registry. April 30. https://doi.org/10.1257/rct.15574-1.0
Experimental Details

Interventions

Intervention(s)
Intervention Start Date
2025-04-29
Intervention End Date
2026-05-01

Primary Outcomes

Primary Outcomes (end points)
Willingness to pay/accept over penalties for wrong answers
Primary Outcomes (explanation)
We want to study students' preferences over penalties for wrong answers and how these are shaped by:
1. Gender.
2. Confidence and ability.
3. Competitive environment.
4. Risk preferences and loss aversion.

Secondary Outcomes

Secondary Outcomes (end points)
1. Belief updating.
2. IQ score and number of questions left unanswered.
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The main goal of the research is to analyze students' preferences regarding penalties for incorrect answers, taking into account relevant factors, namely:
1. The rules of the environment (competition vs. no competition) during the test.
2. The difficulty level of the test.
Therefore, we will examine how these factors influence students' preferences for penalties on wrong answers.
Experimental Design Details
Not available
Randomization Method
Otree software
Randomization Unit
Individual level.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
400 individuals
Sample size: planned number of observations
400 individuals
Sample size (or number of clusters) by treatment arms
400 individuals:
100 Competition, Difficult version IQ
100 Competition, Easy version IQ
100 No competition, Difficult version IQ
100 No competition, Easy version IQ
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Comitato per le Ricerche con Dati sull'Individuo (CORDI) - Dipartimento di Scienze Economiche, Università di Verona
IRB Approval Date
2024-10-22
IRB Approval Number
prot. 0456832 - rep. 2548/2024