|
Field
Trial Start Date
|
Before
July 03, 2024
|
After
October 01, 2024
|
|
Field
Last Published
|
Before
July 01, 2024 12:14 PM
|
After
September 23, 2024 03:28 PM
|
|
Field
Intervention (Public)
|
Before
The intervention will involve providing information and mentorship to secondary school students in the UK, with the treatment arms varying the content and nature of each.
|
After
The intervention will involve providing secondary school students in the UK with information, mentorship, and subsidized in-person visits to universities, with the treatment arms varying the content and nature of each.
|
|
Field
Intervention Start Date
|
Before
July 03, 2024
|
After
October 01, 2024
|
|
Field
Primary Outcomes (End Points)
|
Before
Short-run outcomes (collected at endline survey):
- Interest in mentorship / further exposure to researcher-assigned universities*
- Stated interest in applying to researcher-assigned universities*
Long-run outcomes (collected by schools after university applications are submitted):
- Applications / attendance to researcher-assigned universities*
- Applications / attendance to mentor's university
*Note: researcher-assigned universities are sets of universities that are suitable for the student based on their grade profiles (universities to which students with similar grades have attended based on national data). Researcher-assigned universities will exclude universities already familiar to the students such as the universities their parents and/or siblings have attended as well as universities that are commonly attended by students at their school.
|
After
Short-run outcomes (collected at midline and endline surveys):
- Interest in mentorship / further exposure to researcher-assigned universities*
- Stated interest in applying to researcher-assigned universities*
Long-run outcomes (collected by schools after university applications are submitted):
- Applications / attendance to researcher-assigned universities*
- Applications / attendance to mentor's university
- Applications / attendance to university with subsidized visit
*Note: researcher-assigned universities are sets of universities that are suitable for the student based on their grade profiles (universities to which students with similar grades have attended based on national data). Researcher-assigned universities will exclude universities already familiar to the students such as the universities their parents and/or siblings have attended as well as universities that are commonly attended by students at their school.
|
|
Field
Experimental Design (Public)
|
Before
The experimental design consists of two treatment arms and a control group with randomization at the individual student level. All students will complete baseline and endline surveys before and after the intervention.
|
After
The experimental design consists of two treatment arms and a control group with randomization at the individual student level. All students will complete baseline, midline, and endline surveys before and after the intervention.
|
|
Field
Randomization Method
|
Before
Randomization will be conducted on a computer. Within each participating school, we will receive a list of participating students, and then randomly assign students to either the control arm, treatment 1, or treatment 2. Students in treatment 2 will then be randomized into 2A and 2B following the workshop and assigned mentors.
|
After
Randomization will be conducted on a computer. Within each participating school, we will receive a list of participating students, and then randomly assign students from this list to either the control arm C, treatment T1, or treatment T2.
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
We plan to randomize students to workshops in fixed proportions: ¼ of the sample in each school that we recruit will be randomized to the control group and to treatments 1, 2A, and 2B respectively, so we will have 500 students in each under our target sample size of 2000 individuals. However, we may not be able to find mentor matches for as much as a quarter of the sample, in which case we will reduce the assignment of students to arm 2B and correspondingly increase the assignment of students to 2A.
|
After
Given budgetary constraints, we plan to assign 100 students to treatment arm T2, 400 to arm T1, and the remainder to arm C. Under our central estimate of 2000 students, we will thus have 1500 students in arm C.
|
|
Field
Power calculation: Minimum Detectable Effect Size for Main Outcomes
|
Before
Our primary outcomes are all binary / probability outcomes, so for power calculations we use the standard formula for the variance of a proportion. The minimum detectable effect size then depends on the baseline probability of the outcome and the sample size in each arm. We have limited information about the baseline probabilities for most primary outcomes, but we expect many to fall between 0.05 and 0.2. Below we present power under baseline probabilities of 0.05, 0.1, and 0.2.
Our primary comparison compares the control group pooled with arm 1 against arm 2 (pooling 2A and 2B). For this comparison, at our central sample size estimate of 2000 individuals, with individual-level randomization, and given the baseline probabilities defined above, our minimum detectable effect sizes are:
Baseline 0.2: 5.0 percentage points
Baseline 0.1: 3.8 percentage points
Baseline 0.05: 2.7 percentage points
We will also compare each of the individual arms against each other. Power for these comparisons is smaller as we are comparing the 500 students in each arm against each other, as opposed to the 1000 students in each group that result once we pool arms as pre-specified above. For these comparisons, we have power of:
Baseline 0.2: 7.1 percentage points
Baseline 0.1: 5.3 percentage points
Baseline 0.05: 3.9 percentage points
The figure in the attached supporting documents and materials illustrates power under different assumptions about sample size and the baseline outcome level.
|
After
Our primary outcomes are all binary / probability outcomes, so for power calculations we use the standard formula for the variance of a proportion. The minimum detectable effect size then depends on the baseline probability of the outcome and the sample size in each arm. We have limited information about the baseline probabilities for most primary outcomes, but we expect many to fall between 0.05 and 0.2. Below we present power under baseline probabilities of 0.05, 0.1, and 0.2. We assume assignment of 1500 students to C, 400 to T1, and 100 to T2, as in our central estimate for sample size described above.
For comparisons of arm T1 against C, we have the following MDEs:
Baseline 0.05: 3.4 pp
Baseline 0.1: 4.7 pp
Baseline 0.2: 6.3 pp
For comparisons of arm T2 against C, we have the following MDEs:
Baseline 0.05: 6.3 pp
Baseline 0.1: 8.7 pp
Baseline 0.2: 11.6 pp
|
|
Field
Intervention (Hidden)
|
Before
Low-income students in the UK “undermatch”, attending lower-ranked universities despite good academic credentials and uniform tuition fees. This project looks into whether and how social exposure to individuals who attend high-ranked universities shapes university aspirations. Using administrative data, we document that school-to-university pipelines are persistent and dense; on average, 32% of students attend the modal university attended by students in the prior cohort at their school. These effects are more pronounced in economically disadvantaged schools, where students who attend pipeline universities are also more likely to undermatch. Additionally, students are more likely to attend a university their schoolmates have historically attended, even when they have offers from higher-ranked universities. In light of these patterns, we propose learning about university opportunities through schoolmates as one driver of undermatching. To obtain causal evidence and disentangle mechanisms of this type of social learning, we will run an RCT on ~2,000 students in the UK applying to university. Mechanisms we will test include the effectiveness of social exposure compared to standard information interventions, whether students respond more to information from individuals who are demographically similar, and the importance of coordination within friend groups.
The intervention will involve in-person workshops in secondary schools in the UK providing information about the university application process to participants, video clip anecdotes from current university students, and matching participants with current university student mentors to discuss life at university and the application process. Our treatment arms will vary the content and nature of the workshops and whether students are matched to mentors. The target population is Year 12 and/or Year 13 secondary school students in the UK in the year before they apply to university (typically October - January of Year 13). We plan on conducting the intervention in multiple waves in order to maximize the number of schools that can be included in the study. The first wave will take place in June and July 2024, the second wave will take place in September through November 2024, and the third wave will take place sometime between April through September 2025.
|
After
Low-income students in the UK “undermatch”, attending lower-ranked universities despite good academic credentials and uniform tuition fees. This project looks into whether and how social exposure to individuals who attend high-ranked universities shapes university aspirations. Using administrative data, we document that school-to-university pipelines are persistent and dense; on average, 32% of students attend the modal university attended by students in the prior cohort at their school. These effects are more pronounced in economically disadvantaged schools, where students who attend pipeline universities are also more likely to undermatch. Additionally, students are more likely to attend a university their schoolmates have historically attended, even when they have offers from higher-ranked universities. In light of these patterns, we propose learning about university opportunities through schoolmates as one driver of undermatching. To obtain causal evidence and disentangle mechanisms of this type of social learning, we will run an RCT on ~2,000 students in the UK applying to university. Mechanisms we will test include the effectiveness of social exposure compared to standard information interventions, whether students respond more to information from individuals who are demographically similar, and the importance of coordination within friend groups.
The intervention will involve in-person workshops in secondary schools in the UK providing information about the university application process to participants, video clip anecdotes from current university students, matching participants with current university student mentors to discuss life at university and the application process, and subsidized in-person visits to universities. Our treatment arms will vary whether students see videos, are matched to mentors, and are subsidised for visits. The target population is Year 12 and/or Year 13 secondary school students in the UK in the year before they apply to university (typically January of Year 13). We plan on conducting the intervention in multiple waves in order to maximize the number of schools that can be included in the study. The first wave will take place in October through November 2024, and the second wave will take place between April through July 2025.
|
|
Field
Secondary Outcomes (End Points)
|
Before
We will look into heterogeneity of treatment effects on the primary outcomes by demographic similarity between participating students mentors (where demographics include socioeconomic status, ethnicity, gender, and location). For instance, we will examine whether female students matched with female mentors were more likely to apply to their mentor's university compared to female students matched to male mentors.
|
After
We will look into heterogeneity of treatment effects on the primary outcomes by demographic similarity between participating students and mentors (where demographics include socioeconomic status, ethnicity, gender, and location). For instance, we will examine whether female students matched with female mentors were more likely to apply to their mentor's university compared to female students matched to male mentors.
|