Back to History Current Version

Examining the Effects of Outside Options on Matching Outcomes in the DA Mechanism: An Experimental Approach

Last registered on January 07, 2025

Pre-Trial

Trial Information

General Information

Title
Examining the Effects of Outside Options on Matching Outcomes in the DA Mechanism: An Experimental Approach
RCT ID
AEARCTR-0014481
Initial registration date
September 26, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 07, 2024, 7:03 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 07, 2025, 2:37 AM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
NRU Higher School of Economics

Other Primary Investigator(s)

Additional Trial Information

Status
In development
Start date
2024-09-30
End date
2025-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
In countries with centralized admission systems, some applicants have access to outside options. This study aims to analyze how the presence of outside options for some applicants affects the decisions of all applicants in a centralized admission system under the deferred acceptance (DA) mechanism. I consider two cases: 1) when the length of the ranked ordered list (ROL) of educational programs that applicants can submit is unconstrained, and 2) the case of constrained ROLs. For each of these cases, I also examine whether integrating the outside option into the centralized admissions system affects the decisions of applicants, as well as the characteristics of the resulting matchings.

Preliminary results are as follows. I find that, consistent with theoretical predictions, when the length of ROLs is constrained and the outside option is not integrated into the admissions system, participants without access to the outside option adopt a more cautious application strategy compared to those with such access, and are less inclined to truthfully list their top-ranked choice. However, contrary to theory, the incorporation of outside options into the system significantly alters the strategies and matching outcomes of the participants, even if the aftermarket is frictionless when the outside option is not integrated.
External Link(s)

Registration Citation

Citation
Yurko, Anna. 2025. "Examining the Effects of Outside Options on Matching Outcomes in the DA Mechanism: An Experimental Approach." AEA RCT Registry. January 07. https://doi.org/10.1257/rct.14481-1.1
Experimental Details

Interventions

Intervention(s)
Participants in the experiment will be assigned to groups of 24 individuals. Each group will compete for one of three prize types:

1) Prize A: 600 rubles (approximately $6.50 at current exchange rate)
2) Prize B: 400 rubles ($4.33)
3) Prize C: 200 rubles ($2.17)

In each group, a total of 6 prizes of each type will be awarded. Consequently, no more than 18 participants per group will receive a prize. The language used is neutral and not tied to the university admissions context.

Whether a participant receives one of the prizes depends on their own decisions, the decisions made by the other group members, and a random component. The prizes will be distributed according to the following process:
1. Each participant in the experiment submits a rank-ordered list of the prizes, with their most preferred prize listed first and their least preferred prize listed last.
2. Participants in the experiment are randomly assigned numbers from 1 to 24. A lower participant number indicates higher priority eligibility for the prizes.
3. The prizes are distributed according to the deferred acceptance algorithm.

The goal of the study is to analyze how participants' decisions on what ROLs to submit depend on their access to an outside option, and for those without access, how their decisions depend on knowing that other participants have access to an attractive outside option. Therefore, in the treatment groups, some participants will have access to an outside option of 500 rubles ($5.41).

Another goal is to investigate how integrating the outside option into the centralized prize distribution system affects participants' decision-making, in comparison to the control group and the treatment group with the non-integrated outside option.
In treatment groups where the outside option is not integrated into the centralized prize distribution system, participants with an outside option (call it prize O) will receive 500 rubles if they do not win Prize A at the conclusion of the algorithm. Prizes B and C that are vacated will be redistributed to other participants without outside options, based on their submitted ROLs and priority numbers assigned in the second stage.
In treatment groups where the outside option is integrated into the centralized prize distribution system, participants with access to the outside option Prize O will need to include it in their ROLs in order to be considered for that option.
Intervention Start Date
2024-09-30
Intervention End Date
2024-12-31

Primary Outcomes

Primary Outcomes (end points)
Unconstrained and constrained ROLs:
1) Proportion of participants who truthfully reported their preferences in all 12 of their submitted ROLs
2) Average share of truthful ROLs submitted by participants
3) Average share of ROLs with the top prize type A as first priority (out of 12)
Constrained ROLs only:
4) Average share of ROLs with top prize type A (out of 12): lack of A in ROL indicates more cautious strategy
Primary Outcomes (explanation)
The primary outcomes are used to test the following hypotheses.

Unconstrained ROLs:
Hypothesis 1: The fraction of rounds in which participants report their true preferences over prizes, listing all prizes, is 1 for all participants, and this does not depend on whether the participant or their competitors have access to the outside option prize, regardless of whether the outside option is integrated into the centralized system.
Hypothesis 2: Participants without access to the outside option prize should employ the same strategies across all unconstrained ROLs versions of the model, as they are expected to submit truthful ROLs of three prize types in each version. Similarly, participants with access to the outside option prize should not exhibit any differences in strategies across the unconstrained ROLs versions, as they should rank all the prizes available to them in the system truthfully and completely in every version.
Hypothesis 3: The resulting matchings are stable.

Constrained ROLs:
Hypothesis 4: The fraction of rounds in which participants submit partially true ROLs (preserving the original ranking of prizes from highest to lowest) of the maximum allowed length is 1 for all participants, regardless of whether they or their competitors have access to the outside option, and regardless of whether the outside option is integrated into the centralized prize distribution system.

In experimental groups where the outside option is integrated into the centralized system, participants who have access to the outside option will truthfully list it in all their submitted ROLs.

Hypothesis 5.1: In versions II.5) and II.7) of the model, where one-third of participants have access to the outside option prize, participants without the outside option are expected to submit a lower proportion of ROLs that include the top prize type A, compared to participants in the baseline model without the outside option.

Hypothesis 5.2: Integrating the outside option prize into the centralized system does not affect the mixing probabilities of various types of partial ROLs for participants without the outside option. That is, there are no expected differences in the share of ROLs that include the top prize type A for the participants without access to the outside option in versions II.5) and II.7) of the model.

Hypothesis 6: Participants with access to the outside option are more likely to list the top prize A as first priority on their ROLs compared to participants without access to the outside option.

Hypothesis 7: The percentage of stable matchings is less than 100%. Unlike the participants without the outside option, those with the outside option are never undermatched.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The main experiment is conducted in a total of seven versions:

I. Unconstrained ROLs:
I.1) Control condition: no outside option for any participants;
I.2) Treatment: outside option is integrated (embedded) into the centralized system, available for 1/3 of participants;
I.3) Treatment: outside option is available for 1/3 of participants, but not integrated into the centralized system.
II. Constrained ROLs, participants can list only two out of the three available prize types:
II.4) Control condition: no outside option for any participants;
II.5) Treatment: outside option is integrated into the centralized system, available for 1/3 of participants;
II.6) Treatment: outside option is integrated into the centralized system, available for 2/3 of participants;
II.7) Treatment: outside option is available for 1/3 of participants, but not integrated into the centralized system.

The experiment is conducted on paper. Each participant takes part in two versions of the experiment. For each version, participants are required to submit 12 separate ROLs. The final winnings are randomly determined based on one of the 12 submitted lists. No feedback occurs between versions or rounds.

A simple example with two prize types (one prize of each type) and three participants is used to illustrate the workings of the algorithm. The example prizes are renamed (X and Y instead of A, B, and C), and the task focuses on the optimal decisions of the three example participants, using neutral language and avoiding direct advice to the participants themselves to prevent experimenter demand effects. Nevertheless, the logic and intuitions gained from this simpler context are emphasized as directly applicable to the one the participants would be part of during the main part of the experiment.

Following the instructions, the participants are tested to assess their understanding of the mechanism and optimal choices in the different versions of the experiment. Since nearly all the participating students are enrolled in the Principles of Microeconomics course, their test performance is incentivized with bonus points towards their final Microeconomics course grade. Non-enrolled participants are provided monetary incentives for successfully answering the quiz questions (up to 400 rubles or approximately $4.33).

Following the main experiment, participants also complete a bomb risk elicitation task designed to assess their risk preferences. This additional task is included because the degree of risk aversion can influence the optimal strategies of the participants in version II.6) of the experiment. The bomb risk elicitation task is accompanied by financial incentives, with an expected average payout of 250 rubles ($2.71) per participant.
Experimental Design Details
Not available
Randomization Method
By computer.
Randomization Unit
Participants will be recruited from first-year Bachelor's degree students at the International College of Economics and Finance and the Faculty of Economics (NRU HSE).

First-year BSc students are organized into academic groups of 25-30 for their studies, and the experimental sessions will be conducted separately for each academic group. Randomization (by computer) of students into the different versions of the experiment occurs at the academic group level: as the instructions for each version vary slightly, it is more convenient for all participants in a session to follow the same set of instructions.

However, since there are more academic groups (14 in total) than versions of the experiment, and each participating student takes part in two versions of the experiment, each group of 24 participants for each version is composed of randomly drawn (by computer) participants from all academic groups participating in the same version of the experiment. Participants are informed that they are not necessarily competing for prizes with the people in the same room, but potentially with any other 23 out of all participating students.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
330 individuals
Sample size: planned number of observations
330*2*12 = 7,920 individual-rounds observations. Each of the 330 participants will take part in 2 versions of the experiment and submit 12 ROLs for each version.
Sample size (or number of clusters) by treatment arms
On average, there will be 47 participants per treatment group per round. As each individual will take part in two different versions of the experiment, this should result in an average of 94 individuals per treatment.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Institutional Review Board of the NRU Higher School of Economics, Committee on Interuniversity Surveys and Ethical Assessment of Empirical Research
IRB Approval Date
2024-09-26
IRB Approval Number
N/A