The Impact of a Peer-to-Peer Mentoring Program on University Choices and Performance

Last registered on October 18, 2024

Pre-Trial

Trial Information

General Information

Title
The Impact of a Peer-to-Peer Mentoring Program on University Choices and Performance
RCT ID
AEARCTR-0014537
Initial registration date
October 10, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 18, 2024, 4:48 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
University of Bologna

Other Primary Investigator(s)

PI Affiliation
University of Bologna

Additional Trial Information

Status
Completed
Start date
2021-10-01
End date
2024-10-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
Decisions about investing in human capital, including the choice of tertiary education enrollment and field of study, significantly influence future job prospects, career paths, and earnings. However, evidence overwhelmingly suggests that individuals do not strictly maximize income in these decisions. We focus on the selection of the field of study, rather than the decision to enroll in tertiary education. This distinction is important not only because different fields of study have widely varying expected returns, but also because choosing the wrong field may lead to dissatisfaction or increase the likelihood of dropping out. In Italy, where we conduct our study, an astonishing 30% of graduates report that, if given the chance to go back in time, they would not enroll in the same degree program. The high dropout rate and dissatisfaction with chosen programs highlight concerns about insufficient information or guidance during the transition from high school to university. We implement an RCT to study the impact of a personalized mentoring program on university enrollment choices and academic outcomes.
External Link(s)

Registration Citation

Citation
Bortolotti, Stefania and Annalisa Loviglio. 2024. "The Impact of a Peer-to-Peer Mentoring Program on University Choices and Performance." AEA RCT Registry. October 18. https://doi.org/10.1257/rct.14537-1.0
Experimental Details

Interventions

Intervention(s)
We design an intervention facilitating encounters between high school students and successful university students enrolled in a quantitative
field and volunteering as mentors. The one-to-one online meetings were designed to be open-ended, allowing mentors to encourage mentees to pose questions. This approach aimed to personalize the mentorship experience, ensuring it met the individual needs of the
students. Mentor-mentee pairs were encouraged to met two or three times in the months leading up to the selection of a university degree program.
Intervention (Hidden)
We designed the intervention to study the effect of mentorship on university choices, particularly the choice of the field of study, among last year high school students. We matched motivated and successful undergraduate and graduate students from the host university (mentors) with high school students (mentees) for one-on-one online orientation mentorship sessions. High school students had the opportunity to ask questions during the sessions, and the interactions were unrestricted to ensure that the mentorship was tailored to the needs of the mentees. While we encouraged mentors to prompt their mentees to ask questions, we also provided university students with guidance to facilitate discussions and cover a wide range of topics. Meetings were scheduled via a dedicated platform, where mentors could indicate their availability and mentees could book meetings. One-to-one meetings were mostly conducted via the MS-Teams platform, and we encouraged participants to use only official channels (the dedicated platform, institutional email, and MS-Teams), especially for the first meeting. Each mentor-mentee pair was encouraged to schedule 2 or 3 half-hour meetings.
Intervention Start Date
2022-01-08
Intervention End Date
2022-09-15

Primary Outcomes

Primary Outcomes (end points)
Dummy variable taking value 1 if students choose the same field of study of the matched mentor
Primary Outcomes (explanation)
We mostly rely on answers to the endline survey. For a subsample, data are validated using administrative data on university performance from the host institution.

Secondary Outcomes

Secondary Outcomes (end points)
Enrollment in STEM/Econ fields; Prospective wages; Academic performance (grades and study credits) by the end of the first year
Secondary Outcomes (explanation)
Enrollment in STEM/Econ fields: variable based on answers to endline questionnaires, pooling together quantitative fields.
Prospective wages: based on AlmaLaurea data.
Academic performance: based on administrative data from the host institution (only for the subsample available in the data)

Experimental Design

Experimental Design
The mentoring program was mostly advertised during large online orientation events organized by the host institution -- a large public university located in Italy -- with a participation of roughly 20,000 students. To enroll in the mentoring program, students had to complete a baseline questionnaire where we collected background information and their ranked list of fields of study they were interested in. We used this information to match each applicant with a mentor; randomization into Control and Treatment group relied on program oversubscription, and only students in the Treatment group were informed about the assignment. A few months after the intervention, and right before the start of the academic year, we run the endline survey where we collected the enrollment choices of our participants. We complement and validate these self-reported measures with administrative data about student’s enrollment and performance from the host university
Experimental Design Details
High school students applied to the program between January and February 2022, a few months prior to the closure of the first intake. The final intake available for enrollment in a degree program was in September 2022. Personalized meetings were conducted between March and July 2022, with a higher frequency of meetings occurring in the initial months of the intervention while high school was still in session. We contacted all students for an endline survey just before the start of the academic year 2022/23. To account for the medium-term effects of the intervention, we collected administrative data regarding credits and grades at the end of the first year of university (December 2023). These data are only available for students who enrolled at the host university.

Mentors were recruited from second and third-year bachelor’s students and first and second-year master’s students across nine fields: Accounting Business and Management; Agricultural and Food Sciences; Architecture and Industrial Design; Biology and Environmental Sciences; Chemistry Physics and Mathematics; Computer Sciences; Economics and Finance; Engineering; and Statistics. We specifically targeted quantitative fields which are known for having higher returns in the labour market.

Baseline and endline survey:
• Background information: We collected information on gender, year of birth, education level of parents, type of high school, county of the high school, mathematics and Italian grades (in the previous school year).
• Ranking of fields and degree programs: Each prospective participant had to choose two or three fields of interest and rank them from the most preferred to the least preferred. For each chosen field, they could select up to 4 specific degree programs. The list of courses was based on the degrees available at the host university. After selecting all programs of interest, they were asked to rank them from the most to the least preferred.
The survey included also questions about the motives that might drive the choice of a university program and their subjective expectations similar to Boneva and Rauh (2017).

The treatment assigned is stratified at the mentor level using a serial dictatorship mechanism to form mentor-mentee pairs. First, all eligible students were matched with a mentor. Subsequently, students matched with a particular mentor were randomly assigned to either the Treatment or the Control group. Treated students were introduced to their mentors, while control students did not receive any communication about the matching procedure.
Randomization Method
Randomization done in office by a computer
Randomization Unit
Randomization at the individual level, stratified by matched mentor
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
The randomization is stratified at the mentor level. Number of mentors: 82
Sample size: planned number of observations
Number of students: 337
Sample size (or number of clusters) by treatment arms
168 students assigned to the Control group and 169 assigned to the Treatment group.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Considering the full sample, the MDE for the primary outcome is 0.18 standard deviation (approximately 9 percentage points) Considering the final sample of respondents, the MDE is 0.28 (approximately 14 percentage points)
IRB

Institutional Review Boards (IRBs)

IRB Name
Comitato di Bioetica - Università di Bologna
IRB Approval Date
2021-05-04
IRB Approval Number
No. 109165

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
September 15, 2022, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
January 31, 2024, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
169 participants answered the endline survey; 144 participants retrieved in the administrative data (i.e. enrolled in the host university in 2022/2023)
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
In the main analysis: 148 or 169, depending on the specification; in other analyses, it ranges from 111 to 215
Final Sample Size (or Number of Clusters) by Treatment Arms
74 control + 74 treated=148 85 control + 84 treated=169
Data Publication

Data Publication

Is public data available?
No

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials