|
Field
Abstract
|
Before
We look at data acquired during the 2020 applications cycle to Master's programs in Psychology in Israel. The data is obtained from the matching system that governs the market (the Israeli Psychology Master's Match, or IPMM). Starting from 2020, rank-order lists (ROL) were collected both before and after the interviewing period, and we can look at the evolution of preference between these two periods. We also examine the result of an A/B testing procedure that randomized which of the applicants will be presented with their original ROLs. We show a significant anchoring effect induced by displaying the previously inputted preference. We also show a correlation between being ranked highly by a program and increasing its rank compared to the previously inputted rank, and that this correlation is higher for people who were not shown their original ranking. We also link these results with the applicants' responses to a post-match survey regarding their motivation to change their preferences because of the interviews.
|
After
We look at data acquired during the 2020 applications cycle to Master's programs in Psychology in Israel. The data is obtained from the matching system that governs the market (the Israeli Psychology Master's Match, or IPMM). Starting from 2020, rank-order lists (ROL) were collected both before and after the interviewing period, and we can look at the evolution of preference between these two periods. We show a correlation between being ranked highly by a program and increasing its rank compared to the previously inputted rank. We also link these results with the applicants' responses to a post-match survey regarding their motivation to change their preferences because of the interviews.
|
|
Field
Last Published
|
Before
June 04, 2020 02:29 PM
|
After
June 04, 2020 03:52 PM
|
|
Field
Experimental Design (Public)
|
Before
Applicants were asked to submit pre-interviewing ROLs that will be used in case they do not input their ROLs during the ranking period (it was made clear to applicants that this is a common phenomenon, and that starting from 2020 they are required to input "default ROLs" until April 19). It was confirmed with the participating institutions that no interviews were conducted prior to April 19. During the regular ranking period (June 7 to June 21) applicants will input their final ROLs. Half of those that previously reported their default ROLs would be presented with their default ROLs, and half would not be presented with them. In both cases, the applicants will actively submit their final ROL. This data, together with programs' ROLs will be provided to the researchers by the IPMM. In addition, the researchers will run a survey through the IPMM website.
|
After
Applicants were asked to submit pre-interviewing ROLs that will be used in case they do not input their ROLs during the ranking period (it was made clear to applicants that this is a common phenomenon, and that starting from 2020 they are required to input "default ROLs" until April 19). It was confirmed with the participating institutions that no interviews were conducted prior to April 19. During the regular ranking period (June 7 to June 21) applicants will input their final ROLs. Applicants will actively submit their final ROL. This data, together with programs' ROLs will be provided to the researchers by the IPMM. In addition, the researchers will run a survey through the IPMM website.
|
|
Field
Intervention (Hidden)
|
Before
We do not intervene ourselves, but look at A/B testing conducted by the IPMM. That intervention paired applicants who submitted pre-interviewing preferences according to personal traits, and randomly chose one person of each pair to be displayed her pre-interviewing ROL during the ranking period, and one person who will not be displayed her pre-interviewing ROL during the ranking period.
Applicants will be asked to fill a survey with questions related to the effect of interviewing on their ranking following the end of the ranking period, and until receiving their outcomes.
|
After
We do not intervene ourselves, but we look at A/B testing conducted by the IPMM. That intervention paired applicants who submitted pre-interviewing preferences according to personal traits, and randomly chose one person of each pair to be displayed her pre-interviewing ROL during the ranking period, and one person who will not be displayed her pre-interviewing ROL during the ranking period.
Applicants will be asked to fill a survey with questions related to the effect of interviewing on their ranking following the end of the ranking period, and until receiving their outcomes.
|