Back to History Current Version

Examining the Effects of Outside Options on Matching Outcomes in the DA Mechanism: An Experimental Approach

Last registered on October 07, 2024

Pre-Trial

Trial Information

General Information

Title
Examining the Effects of Outside Options on Matching Outcomes in the DA Mechanism: An Experimental Approach
RCT ID
AEARCTR-0014481
Initial registration date
September 26, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 07, 2024, 7:03 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
NRU Higher School of Economics

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2024-09-30
End date
2025-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
In countries with centralized admission systems, some applicants have access to outside options, also known in the literature as off-platform or out-of-system options. These outside options may include private educational institutions, study abroad programs, online education, and the opportunity to postpone education to explore alternative activities.
The presence of outside options for some applicants has been shown to result in inefficient allocations and reduced welfare for applicants, due to centralized offers being rejected by some applicants in favor of outside options and the subsequent reallocation of vacant places in the aftermarket being hampered by frictions (Kapor et al. (2024)). Additionally, the presence of outside options could reduce the efficiency and welfare of some applicants due to the distortions it may introduce in their decisions within the centralized system.
This study aims to analyze how the presence of outside options for some applicants affects the decisions of all applicants in a centralized admission system under the deferred acceptance (DA) mechanism. I consider two cases: 1) when the length of the ranked ordered list (ROL) of educational programs that applicants can submit is unconstrained, and 2) the case of constrained ROLs. For each of these cases, I also examine whether embedding the outside option into the centralized admissions system affects the decisions of applicants, as well as the characteristics of the resulting matchings.
External Link(s)

Registration Citation

Citation
Yurko, Anna. 2024. "Examining the Effects of Outside Options on Matching Outcomes in the DA Mechanism: An Experimental Approach." AEA RCT Registry. October 07. https://doi.org/10.1257/rct.14481-1.0
Experimental Details

Interventions

Intervention(s)
Participants in the experiment will be assigned to groups of 24 individuals. Each group will compete for one of three prize types:

1) Prize A: 600 rubles (approximately $6.50 at current exchange rate)
2) Prize B: 400 rubles ($4.33)
3) Prize C: 200 rubles ($2.17)

In each group, a total of 6 prizes of each type will be awarded. Consequently, no more than 18 participants per group will receive a prize. The language used is neutral and not tied to the university admissions context.

Whether a participant receives one of the prizes depends on their own decisions, the decisions made by the other group members, and a random component. The prizes will be distributed according to the following process:
1. Each participant in the experiment submits a rank-ordered list of the prizes, with their most preferred prize listed first and their least preferred prize listed last.
2. Participants in the experiment are randomly assigned numbers from 1 to 24. A lower participant number indicates higher priority eligibility for the prizes.
3. The prizes are distributed according to the deferred acceptance algorithm.

The goal of the study is to analyze how participants' decisions on what ROLs to submit depend on their access to an outside option, and for those without access, how their decisions depend on knowing that other participants have access to an attractive outside option. Therefore, in the treatment groups, some participants will have access to an outside option of 500 rubles ($5.41).

Another goal is to investigate how integrating the outside option into the centralized prize distribution system affects participants' decision-making, in comparison to the control group and the treatment group with the non-integrated outside option.
In treatment groups where the outside option is not integrated into the centralized prize distribution system, participants with an outside option (call it prize O) will receive 500 rubles if they do not win Prize A at the conclusion of the algorithm. Prizes B and C that are vacated will be redistributed to other participants without outside options, based on their submitted ROLs and priority numbers assigned in the second stage.
In treatment groups where the outside option is integrated into the centralized prize distribution system, participants with access to the outside option Prize O will need to include it in their ROLs in order to be considered for that option.
Intervention Start Date
2024-09-30
Intervention End Date
2024-12-31

Primary Outcomes

Primary Outcomes (end points)
Unconstrained ROLs:
1) Fraction of rounds in which participants report truthful and complete ROLs
Constrained ROLs:
2) Fraction of rounds in which participants submit partially truthful ROLs of the maximum allowed length
3) Fractions of each type of partially truthful ROL of the maximum allowed length
Primary Outcomes (explanation)
Unconstrained ROLs:
1) Fraction of rounds in which participants report truthful and complete ROLs
Hypothesis: The fraction of rounds in which participants report their true preferences over prizes, listing all prizes, is 1 for all participants, and this does not depend on whether the participant or their competitors have access to the outside options, regardless of whether the outside option is integrated into the centralized system.

Constrained ROLs:
2) Fraction of rounds in which participants submit partially truthful ROLs of the maximum allowed length
Hypothesis: The fraction of rounds in which participants submit partially true ROLs (with no preference reversals) of the maximum allowed length is 1 for all participants, regardless of whether they or their competitors have access to the outside option, and regardless of whether the outside option is integrated into the centralized prize distribution system.
In experimental groups where the outside option is integrated into the centralized system, participants who are highly likely to have access to the outside option will truthfully list it in all their submitted ROLs.

3)Fractions of each type of partially truthful ROL of the maximum allowed length
Explanation: The theoretical model predicts that the fractions of each type of partially true ROL of the maximum allowed length will vary between the control and various treatment groups for participants without access to the outside option. These participants should recognize that the competition for programs less attractive than the outside option is relatively lower, as those with access to the outside option will not be competing for them.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The main experiment will be conducted in a total of seven versions:

I. Unconstrained ROLs:
I.1) Control condition: no outside option for any participants;
I.2) Treatment: outside option is integrated (embedded) into the centralized system, available for 1/3 of participants;
I.3) Treatment: outside option is available for 1/3 of participants, but not integrated into the centralized system.
II. Constrained ROLs, participants can list only two out of the three available prize types:
II.1) Control condition: no outside option for any participants;
II.2) Treatment: outside option is integrated into the centralized system, available for 1/3 of participants;
II.3) Treatment: outside option is integrated into the centralized system, available for 2/3 of participants;
II.4) Treatment: outside option is available for 1/3 of participants, but not integrated into the centralized system.

The experiment will be conducted on paper. Each participant will take part in two versions of the experiment. For each version, participants will be required to submit 12 separate ROLs. The final winnings will be randomly determined based on one of the 12 submitted lists.

All participants will receive detailed instructions on the rules of the prize draw and an example of the DA algorithm. Following the instructions, the participants will take a quiz on the structure of the experiment and the DA algorithm. Since nearly all of the participating students are enrolled in the Principles of Microeconomics course, their quiz performance will earn bonus points towards their final Microeconomics course grade. Non-enrolled participants will be provided monetary incentives for successfully answering the quiz questions (up to 400 rubles or approximately $4.33).

Following the main experiment, participants will also complete a bomb risk elicitation task designed to assess their risk preferences. This additional task is included because the degree of risk aversion can influence the optimal strategies of the participants in the main experiment. The bomb risk elicitation task will be accompanied by financial incentives, with an expected average payout of 250 rubles ($2.71) per participant.
Experimental Design Details
Not available
Randomization Method
By computer.
Randomization Unit
Participants will be recruited from first-year Bachelor's degree students at the International College of Economics and Finance and the Faculty of Economics (NRU HSE).

First-year BSc students are organized into academic groups of 25-30 for their studies, and the experimental sessions will be conducted separately for each academic group. Randomization (by computer) of students into the different versions of the experiment occurs at the academic group level: as the instructions for each version vary slightly, it is more convenient for all participants in a session to follow the same set of instructions.

However, since there are more academic groups (14 in total) than versions of the experiment, and each participating student takes part in two versions of the experiment, each group of 24 participants for each version is composed of randomly drawn (by computer) participants from all academic groups participating in the same version of the experiment. Participants are informed that they are not necessarily competing for prizes with the people in the same room, but potentially with any other 23 out of all participating students.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
330 individuals
Sample size: planned number of observations
330*2*12 = 7,920 individual-rounds observations. Each of the 330 participants will take part in 2 versions of the experiment and submit 12 ROLs for each version.
Sample size (or number of clusters) by treatment arms
On average, there will be 47 participants per treatment group per round. As each individual will take part in two different versions of the experiment, this should result in an average of 94 individuals per treatment.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Institutional Review Board of the NRU Higher School of Economics, Committee on Interuniversity Surveys and Ethical Assessment of Empirical Research
IRB Approval Date
2024-09-26
IRB Approval Number
N/A