Back to History Current Version

Undergraduate Women in Economics Challenge

Last registered on October 28, 2015

Pre-Trial

Trial Information

General Information

Title
Undergraduate Women in Economics Challenge
RCT ID
AEARCTR-0000686
Initial registration date
June 02, 2015

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
June 02, 2015, 12:50 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
October 28, 2015, 2:33 PM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
National Bureau of Economic Research

Other Primary Investigator(s)

PI Affiliation
Harvard University

Additional Trial Information

Status
On going
Start date
2015-01-20
End date
2020-06-30
Secondary IDs
Abstract
Nationally, there are about three undergraduate men for every one woman who major in economics. The gender disparity is due to many factors but is exacerbated by incomplete information about the application of economics beyond business and finance, and a lack of role models and mentors. The Challenge is an RCT that will test the effects of deliberate intervention strategies by economics departments at 20 randomly selected schools to recruit and retain female majors. The experiment will determine whether there are any detectable benefits of this intentional effort by comparing the outcomes at the treatment schools with those at control schools and by comparing outcomes at treatment schools for entering cohorts before and after treatment.
External Link(s)

Registration Citation

Citation
Avilova, Tatyana and Claudia Goldin. 2015. "Undergraduate Women in Economics Challenge." AEA RCT Registry. October 28. https://doi.org/10.1257/rct.686-6.0
Former Citation
Avilova, Tatyana and Claudia Goldin. 2015. "Undergraduate Women in Economics Challenge." AEA RCT Registry. October 28. https://www.socialscienceregistry.org/trials/686/history/5792
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The study will provide grant money ($12,500 total) and guidance to schools/departments to implement various intervention programs aimed at recruiting more undergraduate women into the economics major. Each school/department will design their own intervention program, although some elements may be similar between schools/departments. Interventions can be classified into one or more of the following three categories depending on the area that they target:

- Better Information: Without accurate information about the broader application of economics (e.g., beyond finance and consulting), women are more likely to major in less rigorous fields, often within the social sciences or humanities, that seem to provide more application to the theory behind economics.
- Mentoring and Role Models: Women are more sensitive to their grades in introductory courses when choosing their major than are men. The creation of networks among students within the department and showing support for their decision to major in the field has been effective in recruiting underrepresented minorities.
- Content and Presentation Style: On average, female undergraduates are less confident about their quantitative skills than are men even if they are equally able and prepared. Their lack of confidence may diminish their belief that economics fits their personal strengths and abilities.

These three areas were identified based on discussion with a board of experts, consisting of economics educators and experts in economics pedagogy, at the November 2014 Planning Group Meeting, as well as focus groups conducted with students at some of the treatment institutions. Actual interventions can include, but are not limited to:

- inviting alumni/guest speakers who work in diverse fields other than finance and consulting for a lecture series or a panel discussion about the application of economics in their work;
- increasing the number of female TAs/graduate students/older undergraduate mentors;
- helping students find summer jobs that value economics, are dynamic, and include human contact;
- having informal lunches with professors and TAs;
- supporting independent/group projects in various sub-fields such as health, poverty, crime, inequality, sports, and others, or supplementing introductory and intermediate theory economics courses with modules in these sub-fields;
- making sections more conductive to learning for students with different skill levels, styles of learning, and interests,
and many more.
Intervention Start Date
2015-09-01
Intervention End Date
2016-05-31

Primary Outcomes

Primary Outcomes (end points)
The key outcome variable is the number of students graduating with a major in economics, by gender. If such data is available, the study will account for the number of economics majors who transferred to the institution after their sophomore year: these students would have taken their introductory and intermediate econ courses at a separate institution, and departmental interventions are less likely to have a full effect on their choice of major.

The study will also collect the following information from the schools.
- the number of students graduating with a minor in economics, by gender;
- the number of students enrolled in the principles of economics sequence, by gender by class year;
- the number of students enrolled in the intermediate theory sequence, by gender by class year.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
A letter of invitation to participate in the Challenge was sent to 344 co-educational colleges and universities in the United States that had graduated at least 15 BA students from their economics program per year (averaged across the 2011 to 2013 period). Of the group contacted, 167 schools (or almost 50%) expressed an interest in the initiative. The letter of invitation did not give much detail but did state that all treatment schools would receive a maximum of $12,500 that could be used for any part of the intervention (e.g., guest speakers; lunches with faculty members; events with teaching fellows).

Out of the 167 schools that volunteered to participate in the study, 88 were selected to be part of the "treatable sample" based on several institutional characteristics. Of the institutions in the treatable sample, 20 were randomly selected to be part of the treatment group, and the remaining 68 institutions were asked if they wished to be part of the control group. Of these, 35 schools volunteered to be in the control pool.

Each treatment school will design their own intervention program aimed at recruiting more undergraduate women into economics, with some guidance from the trial organizers and our designated Board of Experts, with whom we met to design the experiment in November 2014. Treatment schools will begin implementing the interventions in the Fall 2015. The main intervention will last one year (Fall 2015 to Spring 2016), with some spillover into the following academic year (Fall 2016 to Spring 2017). Schools will receive funding from the study for the first full year. Schools may continue their intervention programs beyond that if they wish.

Treatment schools will submit reports detailing their plan of intervention. Both treatment and control schools will be asked to provide aggregate numbers for several years prior to the start of the trial for students graduating with an economics BA. For the duration of the trial, they will also be asked to provide aggregate numbers for students enrolled in introductory and intermediate economics courses, and the major selection for students in the treatment cohort (Fall 2015 to Spring 2016) at the point of major declaration and upon their graduation. In addition, the trial organizers will use data provided in the IPEDS (US Department of Education) to collect aggregate numbers on the majors of graduating students at schools that did not respond to the letter of invitation to be in our sample of institutions interested in the Challenge.

The trial organizers will conduct statistical analysis to determine what, if any, impact the intervention programs have on recruiting more women to major in economics by comparing the data from the treatment schools, the interested control schools, and the schools that never demonstrated an interest. Given the enormous interest that was expressed in the program and statements from control schools that they have been motivated by our Challenge, even though they were not randomly chosen as a treatment, we will look at time trends for all groups, particularly for the group that meets our criteria of size of program and selectivity.
Experimental Design Details
Due to the large number of responses, a decision was made to limit the institutions even further by the number of BA majors and the selectivity of the institution to increase the power by reducing the variance. Of the schools that expressed an interest, the sample was further reduced by the schools that had graduated fewer than 30 economics BAs per year (averaged across the 2011 to 2013 period), schools that were not in the (USN&WR) “top 100 universities” or the “top 100 colleges” and produced fewer than three economics PhD graduates across the 2008 to 2012 period, and all unranked schools.

The remaining 88 schools were ranked in order based on the USN&WR “top universities” and “top colleges” rankings (merged by “within group” ranking number). Colleges and universities with the same ranking were ordered highest to lowest based on the average Verbal and Math SAT scores. Schools were then divided into four equal groups of 22 schools each, with a number 1 through 22 assigned to them based on their relative USN&WR rank.

We randomized in the following fashion. Ten random numbers were drawn for each of the four groups using an online random number generator. The schools with numbers corresponding to the first five numbers were assigned to the treatment group, and the other five schools were assigned to the waitlist, in the case that a treatment or a control school declined to participate in the Challenge. The remaining 12 schools were assigned to the control group. All 20 schools originally assigned to treatment agreed to participate. All waitlisted schools were automatically invited to join the control group.
Randomization Method
Randomization in the office using an online random number generator.
Randomization Unit
Treatment is randomized at school level within four selectivity groups of institutions.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
N/A
Sample size: planned number of observations
Economics departments at least 55 schools (universities and liberal arts colleges in the United States).
Sample size (or number of clusters) by treatment arms
20 treatment schools and at least 35 control schools (selected out of the schools that expressed an interest in the Challenge). Other schools can be added into the control group by using publicly available IPEDS data on majors, provided they passed the initial selection criteria for graduating a sufficient number of economics majors every year.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Harvard University, Committee on the Use of Human Subjects
IRB Approval Date
2015-06-01
IRB Approval Number
15-2030

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials