x

Please fill out this short user survey of only 3 questions in order to help us improve the site. We appreciate your feedback!
Normatively Framed Relative Performance Feedback in Higher Education
Last registered on April 11, 2021

Pre-Trial

Trial Information
General Information
Title
Normatively Framed Relative Performance Feedback in Higher Education
RCT ID
AEARCTR-0007442
Initial registration date
March 30, 2021
Last updated
April 11, 2021 4:30 AM EDT
Location(s)

This section is unavailable to the public. Use the button below to request access to this information.

Request Information
Primary Investigator
Affiliation
University of Goettingen, University of Erfurt
Other Primary Investigator(s)
PI Affiliation
Nuremberg Institute of Technology
PI Affiliation
University of Erfurt, Max Planck Institute for Research on Collective Goods
Additional Trial Information
Status
On going
Start date
2020-10-01
End date
2026-09-30
Secondary IDs
Abstract
Little is known about how relative performance feedback in higher education based on performance measures such as obtained credits can be designed in order to increase academic achievement of students across the entire performance distribution. In addition, past research was often conducted with students from specific study programs. Against this background, we will assign students from 21 different study programs to different types of relative performance feedback and track their study progress in the short and in the long run.
External Link(s)
Registration Citation
Citation
Brade, Raphael, Oliver Himmler and Robert Jäckle. 2021. "Normatively Framed Relative Performance Feedback in Higher Education." AEA RCT Registry. April 11. https://doi.org/10.1257/rct.7442-2.0.
Experimental Details
Interventions
Intervention(s)
The intervention will be conducted with a cohort of university students studying towards 21 different degrees, who are still enrolled in their initial study program at the beginning of the second term. In all experimental groups, students will be eligible to receive feedback twice per semester.
Intervention Start Date
2021-03-31
Intervention End Date
2024-03-14
Primary Outcomes
Primary Outcomes (end points)
We will study effects on academic achievement in the short and the long run, leading to two sets of primary outcomes.

Short run outcomes: We measure academic achievement on the dimension that we give performance feedback on, i.e., we will study effects on obtained credits at the end of the first treatment semester. In addition, we will measure demand for and avoidance of further feedback as well as the effects of repeated treatment on obtained credits in the second treatment semester.

Long run: Because credit accumulation is directly linked to degree attainment, in the long run, we plan to study whether our treatments raise graduation rates and/or lower the time to degree.
Primary Outcomes (explanation)
We plan to study whether effects on academic achievement after the first treatment semester depend on the demand for and avoidance of further feedback.
Secondary Outcomes
Secondary Outcomes (end points)
Both in the short and the long run we plan to study whether students trade off performance increases on the primary outcome dimension with decreases on other outcome dimensions.

Short run: Other short-run outcomes are the grade point average (GPA), dropout, and non-cognitive outcomes measured by online surveys.

Long run: Other long-run outcomes are credit accumulation, dropout, GPA, and non-cognitive outcomes measured by online surveys.
Secondary Outcomes (explanation)
Both in the short and the long run we plan to study effects on students’ beliefs about their relative performance measured by online surveys.
Experimental Design
Experimental Design
Students will be randomly allocated to control and four treatment groups.
Experimental Design Details
Not available
Randomization Method
Randomization was performed with the software Stata using stratification and re-randomization.
Randomization Unit
Student-level
Was the treatment clustered?
No
Experiment Characteristics
Sample size: planned number of clusters
2370 students
Sample size: planned number of observations
2370 students
Sample size (or number of clusters) by treatment arms
Group 1: 597
Group 2a: 591
Group 2b: 295
Group 3a: 592
Group 3b: 295
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information
IRB
INSTITUTIONAL REVIEW BOARDS (IRBs)
IRB Name
Ethics Committee of the University of Erfurt
IRB Approval Date
2021-02-24
IRB Approval Number
N/A
Analysis Plan

There are documents in this trial unavailable to the public. Use the button below to request access to this information.

Request Information