Gender differences in willingness to lead, the role of confidence

Last registered on November 17, 2023

Pre-Trial

Trial Information

General Information

Title
Gender differences in willingness to lead, the role of confidence
RCT ID
AEARCTR-0012440
Initial registration date
November 07, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
November 17, 2023, 7:45 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Université Paris 1 Panthéon-Sorbonne (CES), Paris School of Economics

Other Primary Investigator(s)

PI Affiliation
Université Paris 1 Panthéon-Sorbonne, Paris School of Economics
PI Affiliation
Monash University

Additional Trial Information

Status
In development
Start date
2023-11-07
End date
2023-12-15
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This project explores gender differences in willingness to lead (WTL) in a controlled laboratory environment, and seeks to identify underlying mechanisms. The primary goal of the study is to explore the effect of confidence on willingness to lead. In particular, we ask whether women are more hesitant to become leaders because they are less confident in their ability, and in which leadership setting confidence is more likely to drive the decision to become leader. To isolate the effect of confidence on WTL, factors such as performance, risk aversion, and gender stereotypes are measured, and backlash against female leaders is ruled out as total anonymity is maintained. The study examines two different contexts of leadership. In the first context, which we call ‘responsibility’, leaders are responsible for making decisions on behalf of the group following input from group members. In the second, which we call ‘influence’, followers make their own decisions, but leaders have the opportunity to persuade the group to adopt their viewpoint. These settings are designed such that the effort required from leaders (writing a message to explain their rationale) is identical between the two, and the difference lies in how the leader’s input determines payoffs. Participants are randomly assigned to one of these two settings and perform the same task twice, once individually and once as part of a group. The task is identical in both settings and consists in ranking objects according to their importance for survival in different scenarios. In line with previous research, we expect to find that women are reluctant to volunteer for leadership roles. We hypothesize that gender differences in confidence explain a significant part of the gender gap in WTL.
External Link(s)

Registration Citation

Citation
Bouleau, Clémentine, Lata Gangadharan and Nina Rapoport. 2023. "Gender differences in willingness to lead, the role of confidence." AEA RCT Registry. November 17. https://doi.org/10.1257/rct.12440-1.0
Experimental Details

Interventions

Intervention(s)
Intervention Start Date
2023-11-07
Intervention End Date
2023-12-15

Primary Outcomes

Primary Outcomes (end points)
Willingness to lead
Individual performance
Confidence in performance (overestimation, overplacement, overprecision)
Primary Outcomes (explanation)
Willingness to lead - Participants indicate how much they want to become the leader of their group, on a scale between 1 and 10

Overestimation: Incentivized guess of absolute performance in the 1st task- Actual absolute performance in the 1st task

Overplacement: Incentivized guess of relative performance in the 1st task compared to a sample of participants from a pilot of the experiment - Actual relative performance in 1st task

Overprecision: Average confidence reported by participant for each item in Task 1 - average accuracy of participant in Task 1

Secondary Outcomes

Secondary Outcomes (end points)
Explicit and implicit gender attitudes
Risk attitudes
Leaders’ evaluation
Text of leader's messages
Gender identity questions
Demographic information - age, gender, occupation, field of study for students
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Part I
a. Individual work - participants work individually on a task outlining a survival situation. They answer a series of question consisting in selecting which items they find most important for survival. We use an expert solution to evaluate these answers and determine payoffs in the different parts of the experiment.
b. Confidence elicitation - we measure participants' confidence in their answers on several confidence dimensions (precision, estimation, placement).

Part 2
a. Appointment of a group leader - participants are informed that they will perform a similar task involving a different survival situation. They are also told that they are grouped with 3 other participants in the session, with whom they will work for this task. Before starting Part 2.b, a group leader will be appointed, whose role depends on the leadership setting participants have been randomly attributed to. They are only informed about their specific leadership setting: In the first setting, leaders are responsible for making decisions on behalf of the group following input from group members. In the second, followers make their own decisions, but leaders have the opportunity to persuade the group to adopt their viewpoint. Once participants are informed of these procedures, they indicate how much they want to become the leader, on a scale between 1 and 10 (“Willingness to Lead”). The group members who indicate the highest motivation are selected to become group leaders.
b. Group work - following the procedures described above, participants complete the second task.
c. Confidence elicitation: - We elicit beliefs about (individual) performance in the second part, and, depending on treatment and role, a belief on group dynamics
d. Evaluation of Leader - group members are asked to evaluate the leader's performance on a scale from 1 to 10, and leaders are asked to evaluate their own performance as a leader on the same scale. Non-leaders also rate their satisfaction with the leader's integration of the group's input (setting 1) or the extent to which they found the leader's justification message (setting 2).

Part 3 - IAT Test, Questionnaire, and Payment
a. IAT - participants take an implicit association test (IAT), eliciting the strength of their implicit associations between leadership and being male.
b. Questionnaire - participants answer questions about their gender identity, willingness to take risks, beliefs about gender differences in task performance, attitudes on gender and leadership, previous leadership experience and motivation for their answer to the WTL question. We collect demographic information on age, gender and occupation/field of study.
c. Feedback and Payment - participants receive feedback on their performance in Part 1 and 2. They also have the opportunity to view the experts' solutions to better understand their scores. One the two parts of the experiment is randomly selected to determine payment.
Experimental Design Details
Part 1. “Lost at Sea” Task
Individual work
Participants first work individually on a task called“Lost at Sea”. The scenario outlines a survival situation in which a group of individuals becomes isolated after an accident. These survivors have ten items salvaged from the accident and are tasked with ranking these items based on their importance for the group’s survival. This task has been used in previous work on leadership (e.g. Thomas-Hunt and Phillips (2004); Born, Ranehill and Sandberg (2022)). To enhance the precision of confidence measures, we have adapted this task from ranking 10 items to a pairwise comparison of 5 pairs of items. Participants are presented with 5 pairs of items and must select, for each pair, which item they believe is more critical for survival. After each of the 5 questions, participants are asked to report their confidence in their answer (“precision”), using a scale ranging from 0 (random choice) to 100 (absolute certainty). Additionally, for the first question, participants are required to write a few lines justifying their answer to ensure their engagement and familiarity with the task. Participants' answers are then compared to those provided by a panel of survival experts. Participants receive €2 for each answer that matches the expert's answer and €0 otherwise. They do not learn about their score until the very end of the study. Before starting the task, participants must answer a set of comprehension questions correctly.
b. Confidence elicitation
Participants are asked to estimate their performance in Part 1.a. They provide two estimations: the number of correct responses (“estimation”, on a scale from 0 to 5) and their perceived relative performance compared to 40 other participants who have previously completed the same task (“placement”, on a scale ranging from the bottom quartile to the top quartile). Each guess is incentivized with a €0.50 bonus added to their payment for Part 1.
Part 2. “Desert survival” Task
a. Appointment of a group leader
Participants are informed that they will perform a task that is similar to the “Lost at sea” scenario, but involves a different survival situation. They are also told that they are grouped with 3 other participants in the session, with whom they will work for this task. Before starting Part 2.b, a group leader will be appointed, whose role depends on the leadership setting participants have been randomly attributed to. They are only informed about their specific leadership setting:
In the Responsibility treatment: all group members except the leader answer each question individually. Leaders receive the answers given by other group members and are responsible for submitting the final answer on behalf of their group. They must provide an ex-post explanation which is shared with the group at the end of the task. The group's payment depends on the number of correct responses provided by the leader
In the Influence treatment: leaders answer each question first, providing a message along with their answer. They thus have the opportunity to persuade the group to adopt their viewpoint. Group members receive the leader’s answer and message, and provide their own answers following (or not) the leader’s input. The group's payment depends on the average number of correct responses provided by group members (including the leader)
In both settings, answers are evaluated in the same manner as in Part 1.a, and group members (including the leader) receive the same payoff for the task.
Once participants are informed of these procedures, they indicate how much they want to become the leader, on a scale between 1 and 10 (“Willingness to Lead”). The group members who indicate the highest motivation are selected to become group leaders. In case of a tie, the computer randomly selects the group leader.
After stating their willingness to lead, all group members are informed about whether they have been selected to be the group leader or not.
b. Group work
Following the procedures described above, participants complete the “Desert Survival” task, similar to Part 1.a but involving a new survival scenario. They are presented with 5 pairs of items and must select the more important item in each pair. After each of the 5 questions, they are asked to report their confidence in their answers, using a scale from 0 (random choice) to 100 (absolute certainty).
Participants must answer a set of comprehension questions correctly before stating their WTL and beginning the task.
c. Confidence elicitation:
Although payoff for the task is determined at the group level, each participant answers all questions individually, which allows to elicit again individual beliefs about performance. Participants are asked to estimate their performance in Part 2.b., providing two estimations: the number of correct responses (“estimation”) and their perceived relative performance compared to 40 other participants who have completed the same task (“placement”).
Depending on their treatment assignment and their leadership status, they are also asked an additional question regarding their beliefs about: the number of other group members who have submitted the same answers as theirs (for leaders in the Influence treatment), the percentage of participants in the session who have submitted the same answers as theirs (for leaders in the Responsibility treatment and followers in the Influence treatment), or the number of questions for which the leader has submitted the same answers as theirs (for followers in the Responsibility treatment). Each guess is incentivized with a €0.50 bonus added to the participant's payment for Part 2.
d. Evaluation of Leader
Every group members' answers are displayed on the screen. Leaders' answers are highlighted in red, and participants' own answers are in bold. Group members are asked to evaluate the leader's performance on a scale from 1 to 10, and leaders are asked to evaluate their own performance as a leader on the same scale.
In the Responsibility treatment, group members also rate their satisfaction with the leader, considering the leader's incorporation of the group members' input to provide a final answer, on a scale from 1 (not at all satisfied) to 10 (very satisfied). In the Influence treatment, group members rate the extent to which they found the leader's justification message convincing on a scale from 1 (not at all convincing) to 10 (very convincing).
Part 3 - IAT Test, Questionnaire, and Payment
a. IAT
Participants take an implicit association test (IAT), eliciting the strength of their implicit associations between leadership and being male.
b. Questionnaire
Participants answer questions about their nationality, gender identity, willingness to take risks, beliefs about gender differences in task performance, attitudes on gender and leadership, and previous leadership experience. They are also asked to provide a brief motivation for why they wanted to become the leader or not.
c. Feedback and Payment
Participants receive feedback on their performance in Part 1 and 2. They also have the opportunity to view the experts' solutions to better understand their scores. Finally, one the two first parts of the experiment is randomly selected to determine the participant's final payment, according to the rules described earlier.
Randomization Method
Experimenters determine treatment assignment for each session. Participants are assigned to treatments based on the session they sign up for.
Randomization Unit
Treatments are assigned at the session level. Participants are assigned to treatments based on the session they sign up for.
Within a given session, participants (~20 per session) are randomly assigned to groups of four by the experimental program (OTree).
They do not get any information about group members for the whole duration of the experiment, and the limited feedback they receive about the behavior of group members is presented after we gather the main outcomes of performance, WTL and beliefs on own performance. We thus consider randomization to be at the individual level for our main analyses, and refer to this unit for the fields below.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
280 participants
Sample size: planned number of observations
280 participants
Sample size (or number of clusters) by treatment arms
140 participants per treatment
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Based on data from our pilot (details below) and budget constraint, a sample of 280 participants (140 per treatment), with equal number of men and women (70 men and 70 women per treatment) should allow us to detect a gender difference in willingness to lead within each condition, on which we then intend to perform exploratory analysis focusing on gender differences in confidence. To calculate the minimal sample size, power calculations were performed using data from a pilot with 44 participants from the same subject pool as the planned experiment, under the following assumptions: -Calculations are based on two-sided hypotheses on the existence of a gender gap in WTL in both conditions. -Effect size is calculated using Cohen’s D -Desired power is set to 0.8, desired sig. level is set to 0.05 -Setting 1: Effect size= -0.489 (~ -0.5 sd) → n= 67, i.e. 134 gender balanced sample -Setting 2: Effect size= 0.8989 (~ 1 sd) → n=21, i.e. 42 gender balanced sample
IRB

Institutional Review Boards (IRBs)

IRB Name
Institutional Review Board - Paris School of Economics
IRB Approval Date
2023-11-02
IRB Approval Number
2023-035

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials