Back to History

Fields Changed

Registration

Field Before After
Last Published October 22, 2021 01:03 AM October 25, 2021 02:08 AM
Intervention (Public) Baseline: No affirmative action for the minority group in selecting the candidate pool. Baseline – Type (2): No affirmative action for the minority group in selecting the candidate pool. No ethnic type informed. Treatment (Intervention): There is a soft AA for minority in selecting the candidate pool. Ethnic type informed. Soft AA – Lucky (4): There is a soft AA for a random group (to have priority) in selecting the candidate pool. No ethnic type informed but the priority status will be informed. 1) Baseline: No affirmative action for the minority group in selecting the candidate pool. 2) Baseline – Type (2): No affirmative action for the minority group in selecting the candidate pool. No ethnic type informed. 3) Treatment (Intervention) - AA policy - minority (3): There is a soft AA for minorities in selecting the candidate pool. Ethnic type informed. 4) Controlled- AA policy – Lucky (4): There is a soft AA for a random group (to have priority) in selecting the candidate pool. No ethnic type informed but the priority status will be informed.
Primary Outcomes (End Points) 1) Outcome 1: Large unfairness impact - hired less but estimated same 2) Outcome 2: Small unfairness impact - hired more or indifferent but estimated less Hiring decisions: 1) percentage % of minorities candidates being hired 2) probability of a minority candidate being hired, controlled by ethic type, scores(rank), age(different from the employer's age). We compare these two outcome variables in different treatments. Estimation decisions: conditional predicted scores in Task C on the given scores in Task B, ethnic type and age. We compare differences between conditional estimated scores for majority candidates and minority candidates in different treatments (differences include 1) the difference in average conditional predicted scores; 2) the marginal effects of ethnic type(minority) in (different treatments) on multiplier (multiplier = estimated scores/given scores). If multiplier < 1, a smaller multiplier means greater differences between estimated scores and given scores. If multiplier >1, a greater multiplier means greater differences between estimated scores and given scores.
Primary Outcomes (Explanation) 1) Expected outcome 1: Behaviour story (Large unfairness impact (Petters & Schröder, 2020) – hired less but estimated same) (a) In the hiring decision: The negative spillover effect is much larger in the soft AA policy – minority treatment (3) than in the soft AA policy – lucky treatment (4). Because employers belong to the unaffirmed group in treatment (3) but not in treatment (4), which are expected to generate extra bias for employers. (b) In the output predictions: Expect no different in soft AA policy – minority treatment (3) and in the soft AA policy – lucky treatment (4) because the feelings of unfairness are expected not to affect employers’ belief in productivity. 2) Expected outcome 2: Rational story (Small unfairness impact – hired more or indifferent but estimated less – consistent with the empirical case – “Rooney Rule” in National Football league (DuBois, 2015; Fershtman & Pavan, 2020)) (a) In the hiring decision: Exposure and frequency effects (positive spillover) dominate the signal effects (negative spillover) because signal effects mainly weaken the positive signals of the affirmed group, resulting in a negative impact on belief rather than hiring. (b) In the output prediction: Signal effects (negative spillover) dominate the exposure and frequency effects (positive spillover) because signal effects mainly weaken the positive signals of the affirmed group, resulting in a negative impact on belief rather than hiring. We plan to detect four effects through the outcome variables in Soft AA minority(3) vs. Baseline Type(2). (see primary outcomes). 1) Hiring decisions: 1) (positive) Frequency effects: The introduction of AA policy for minorities will increase the proportion of minority candidates in the pool (>=50%). This is likely to increase the likelihood of a minority to be hired, including the percentage % of minorities candidates is higher than % of majorities candidates, and the probability of a minority candidate being hired is greater than a majority candidate under soft AA minority(3). 2) (positive) Overcoming effects: Through comparing Baseline(1) and Baseline Type (2) in hiring decisions, we can know whether majority employers hold a natural bias against minority employees during hiring decisions. If the natural bias exists, the introduction of AA policy for minorities can help employers have greater exposure to minorities, and understand there is no ability difference between majorities and minorities candidates. This is likely to decrease the likelihood of a minority to be hired, including the percentage % of minorities candidates is lower than % of majorities candidates, and the probability of a minority candidate being hired is smaller than a majority candidate under soft AA minority(3). 3) (negative) Unfairness effects: The introduction of AA policies may be accompanied by a perceived procedural unfairness to the affirmed group and give employers a greater preference for the unaffirmed group. This is likely to decrease the likelihood of a minority to be hired, including the percentage % of minorities candidates is lower than % of majorities candidates, and the probability of a minority candidate being hired is smaller than a majority candidate under soft AA minority(3). 2) Estimation decisions: 1) (positive) Exposure effects: The exposure effects are likely to eliminate the differences in conditional predicted outcomes between majority candidates and minorities candidates. We expect to see there are no differences in conditional predicted outcomes in the Soft AA minority (3), but there are positive differences in the Baseline type (2). 2) (negative) Signal effects: The introduction of a soft AA policy would weaken the positive productivity signals of the affirmed group because some candidates from the affirmed group would not pass the pre-screen process without the soft AA policy. This will cause employers to predict lower scores for the affirmed candidates than the unaffirmed candidates. We expect to see 1) mean predicted scores of minorities < mean predicted scores of majorities under the Soft AA minority(3); 2) A greater proportion of minority candidates received multipliers <1 than majority candidates. 2) Among those who received multipliers <1, the marginal effect of being a minority should be negative, indicating a greater difference between the estimated and actual scores of minority candidates.
Experimental Design (Public) In this experiment, we have two phases: 1) preliminary phase, in which we aim to recruit 100 participants to complete a series of tasks. 2) The secondary phase, in which we aim to recruit 100 participants for every four treatments to complete a hiring game with a hiring decision and 4 estimating decisions. The preliminary phase is designed to generate actual profiles of candidates for use in the second phase of the hiring game. The benefit of using actual profiles is to introduce actual costs for discriminatory behaviour and therefore capture the actual level of employer discrimination (Hedegaard & Tyran, 2018). During this phase, we are going to ask participants to finish an individual experiment, including five individual tasks with 2 minutes each. The individual task is a 4-letter word anagram that participants need to correctly rearrange as many as possible sets of 4 letters to a meaningful word in 2 minutes. At the end of this phase, we will ask participants to finish an exit survey to capture their individual demographic differences. With five 4-letter anagram tasks, we were able to measure each individual's productivity and generate the inputs for the second phase of the hiring game. The second phase is a hiring game, in which we will introduce four different treatments, a soft AA policy for an ethnic minority group, a soft AA policy for a randomly selected group, and baselines both with and without information about ethnicity. In the second part of a hiring game, we will only recruit the majority as our participants. The majority are those who self-reported as White, currently live in the U.S., are born in the U.S., use English as their first native language. And all the participants for this experiment need to make two decisions: 1) hiring decision 2) estimation decision. Prior to making a hiring decision, all profiles will go through a “pre-screen process" in which the computer will randomly select one of the five tasks completed by the individuals of profiles during the preliminary phase and rank all 12 profiles. Only 4 profiles will be selected as candidates during the hiring decision. During the hiring decision, participants will receive the profiles of four candidates, including scores of another drawn task (different from task used in “pre-screen process"), and age. Whether the ethnicity type of each candidate is included in the profiles, and the way for selecting 4 candidates' profiles are different treatments by treatments. We have 4 different treatments. The preliminary phase is designed to generate actual profiles of candidates for use in the second phase of the hiring game. The benefit of using actual profiles is to introduce actual costs for discriminatory behaviour and therefore capture the actual level of employer discrimination (Hedegaard & Tyran, 2018). The second phase is a hiring game, in which we will introduce four different treatments, a soft AA policy for an ethnic minority group, a soft AA policy for a randomly selected group, and baselines both with and without information about ethnicity. Prior to making a hiring decision, all profiles will go through a “pre-screen process" in which the computer will randomly select one of the five tasks completed by the individuals of profiles during the preliminary phase and rank all 12 profiles. Only 4 profiles will be selected as candidates during the hiring decision. The pre-screen process and the given information in the profiles vary treatments by treatments (see interventions) In this experiment, we have two phases: 1) preliminary phase, in which we aim to recruit 100 participants to complete a series of tasks. 2) The secondary phase, in which we aim to recruit 100 participants for every four treatments to complete a hiring game with a hiring decision and 4 estimating decisions. The preliminary phase is designed to generate actual profiles of candidates for use in the second phase of the hiring game. The benefit of using actual profiles is to introduce actual costs for discriminatory behaviour and therefore capture the actual level of employer discrimination (Hedegaard & Tyran, 2018). During this phase, we are going to ask participants to finish an individual experiment, including five individual tasks with 2 minutes each. The individual task is a 4-letter word anagram that participants need to correctly rearrange as many as possible sets of 4 letters to a meaningful word in 2 minutes. At the end of this phase, we will ask participants to finish an exit survey to capture their individual demographic differences. With five 4-letter anagram tasks, we were able to measure each individual's productivity and generate the inputs for the second phase of the hiring game. The second phase is a hiring game, in which we will introduce four different treatments, a soft AA policy for an ethnic minority group, a soft AA policy for a randomly selected group, and baselines both with and without information about ethnicity. In the second part of a hiring game, we will only recruit the majority as our participants. The majority are those who self-reported as White, currently live in the U.S., are born in the U.S., use English as their first native language. And all the participants for this experiment need to make two decisions: 1) hiring decision 2) estimation decision. Prior to making a hiring decision, all profiles will go through a “pre-screen process" in which the computer will randomly select one of the five tasks completed by the individuals of profiles during the preliminary phase and rank all 12 profiles. Only 4 profiles will be selected as candidates during the hiring decision. During the hiring decision, participants will receive the profiles of four candidates, including scores of another drawn task (different from task used in “pre-screen process"), and age. Whether the ethnicity type of each candidate is included in the profiles, and the way for selecting 4 candidates' profiles are different treatments by treatments. We have 4 different treatments. The preliminary phase is designed to generate actual profiles of candidates for use in the second phase of the hiring game. The benefit of using actual profiles is to introduce actual costs for discriminatory behaviour and therefore capture the actual level of employer discrimination (Hedegaard & Tyran, 2018). The second phase is a hiring game, in which we will introduce four different treatments, a soft AA policy for an ethnic minority group, a soft AA policy for a randomly selected group, and baselines both with and without information about ethnicity. Prior to making a hiring decision, all profiles will go through a “pre-screen process" in which the computer will randomly select one of the five tasks completed by the individuals of profiles during the preliminary phase and rank all 12 profiles. Only 4 profiles will be selected as candidates during the hiring decision. The pre-screen process and the given information in the profiles vary treatments by treatment (see interventions).
Randomization Method Randomisation was done by a computer through O-tree Randomisation was done by a computer through O-Tree
Intervention (Hidden) - Baseline (1): The profiles of the top 4 best performers will enter the candidate pool for all participants to choose from. During the selection, the ethnic type will not be explicitly informed. - Baseline – Type (2): The profiles of the top 4 best performers will enter the candidate pool for all participants to choose from. During the selection, the ethnic type will be explicitly informed. - Soft AA – Type (3): The profiles of the top 2 best-performing minorities and the top 2 best-performing non-selected remainders will enter the candidate pool. During the selection, the ethnic type will be explicitly informed. - Soft AA – Lucky (4): Half of the profiles will be assigned as “lucky", and half will be assigned as “unlucky". The profile of the top 2 best performing individuals from the “lucky" group and the top 2 best-performing non-selected remainders will enter the candidate pool. During the selection, the ethnic type will not be explicitly informed. - Baseline (1): The profiles of the top 4 best performers will enter the candidate pool for all participants to choose from. During the selection, the ethnic type will not be explicitly informed. - Baseline Type (2): The profiles of the top 4 best performers will enter the candidate pool for all participants to choose from. During the selection, the ethnic type will be explicitly informed. - Soft AA minority (3): The profiles of the top 2 best-performing minorities and the top 2 best-performing non-selected remainders will enter the candidate pool. During the selection, the ethnic type will be explicitly informed. - Soft AA Lucky (4): Half of the profiles will be assigned as “lucky", and half will be assigned as “unlucky". The profile of the top 2 best performing individuals from the “lucky" group and the top 2 best-performing non-selected remainders will enter the candidate pool. During the selection, the ethnic type will not be explicitly informed.
Secondary Outcomes (End Points) 1) Hypothesis 1: Behaviour story (Large unfairness impact – hired less but estimated same). - In the hiring decision: The negative spillover effect is much larger in the soft AA policy minority(3) than in the soft AA policy lucky(4). - In the estimation decision: Expect no difference in soft AA policy minority(3) and in the soft AA policy lucky(4). 2) Hypothesis 2: Rational story (Small unfairness impact – hired more or indifferent but estimated less) within Soft AA minority(3). - In the hiring decision: Exposure and frequency effects (positive spillover) dominate the signal effects (negative spillover), if unfairness is stronger with the out-group than with a random group. - In the estimation decision: Signal effects (negative spillover) dominate the exposure effects (positive spillover).
Back to top