Creating Moves to Opportunity in Seattle and King County

Last registered on December 07, 2020

Pre-Trial

Trial Information

General Information

Title
Creating Moves to Opportunity in Seattle and King County
RCT ID
AEARCTR-0002807
Initial registration date
March 28, 2018

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 29, 2018, 6:35 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
December 07, 2020, 4:42 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Primary Investigator

Affiliation
Harvard University

Other Primary Investigator(s)

PI Affiliation
Harvard University
PI Affiliation
Harvard University
PI Affiliation
MIT Sloan
PI Affiliation
Johns Hopkins University
PI Affiliation
Columbia Teacher's College

Additional Trial Information

Status
On going
Start date
2018-03-01
End date
2022-12-31
Secondary IDs
Abstract
The Seattle-King County Creating Moves to Opportunity (CMTO) Demonstration aims to help families with children who receive Housing Choice Vouchers (also known as Section 8 Vouchers) have the opportunity to move to and persist in higher opportunity neighborhoods. Families with children under 15 who receive a Housing Choice Voucher from the Seattle Housing Authority (SHA) and King County Housing Authority (KCHA) who elect to participate in the study will be randomly assigned to either the treatment group (expected to be 642 families), who receives access to CMTO services, or the control group (expected to be 642 families), who have access to the normal support services provided by the housing authorities to new voucher-holders. CMTO services include housing locator services (housing search assistance, neighborhood education, and support in preparing rental applications) and access to flexible financial assistance to help cover costs associated with opportunity moves (e.g. security deposits, moving expenses). Additional outreach will be conducted to landlords in opportunity neighborhoods, and landlords will receive financial incentives for leasing to CMTO families in order to help increase the supply of units available to families. Future phases of research may involve randomizing the types of services families receive. The primary outcomes of interest are to determine (1) if CMTO services increase the number of families moving to high opportunity neighborhoods, and (2) how long they persist in those neighborhoods.

The second phase builds on the lessons from the initial phase by testing three treatment groups that aim to increase the both explore the precise mechanisms that explain families’ decisions to move to opportunity areas and explore opportunities for more scalable housing mobility programs. Families with children under 15 who receive a Housing Choice Voucher from the Seattle Housing Authority and King County Housing Authority who elect to participate in the study will be randomly assigned to one of three treatment groups who each receive a particular set of CMTO services (expected to be about 160 families each), or the control group (expected to be about 160 families), which has access to the normal support services provided by the housing authorities to new voucher holders. Families in the Coaching Services and Resources group receive housing locator services, access to flexible financial assistance to help cover costs associated with opportunity moves (e.g. security deposits, moving expenses), and connections to landlords identified in opportunity areas through proactive outreach and incentivized to participate through financial backstops and streamlined processes. Those in the Cost-Optimized Services group receive pared down versions of the three program supports outlined above, and those in the Financial Assistance group only receive the full flexible financial assistance.

Registration Citation

Citation
Bergman, Peter et al. 2020. "Creating Moves to Opportunity in Seattle and King County." AEA RCT Registry. December 07. https://doi.org/10.1257/rct.2807-6.199999999999999
Former Citation
Bergman, Peter et al. 2020. "Creating Moves to Opportunity in Seattle and King County." AEA RCT Registry. December 07. https://www.socialscienceregistry.org/trials/2807/history/81159
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
Families will receive access to housing locator services to assist in their housing search. The services provided will include marketability counseling to help the families prepare for their housing search, opportunity area education to introduce families to the opportunity neighborhoods, and assistance in finding available apartments. These services will be provided by a third-party provider. Participating families will have access to financial assistance to help cover costs that may be higher in opportunity neighborhoods, such as security deposits, moving expenses, and application fees, in the event families do not have the funds to cover those expenses themselves. Landlords in opportunity areas will also have incentives to lease to voucher-holders, including access to a risk mitigation fund to cover damages above and beyond a security deposit. There will be more intensive recruitment efforts to increase the number of landlords willing to lease to voucher-holders in opportunity areas during the program as well.

In Phase II of the study, enrolled families assigned to the treatment group families received one of three possible sets of CMTO services: Coaching Services and Resources, Cost-Optimized Services, and Financial Assistance. These three interventions are based either in whole or in part on the services provided in Phase I, and the breakdown is provided below.Due to the COVID-19 pandemic, the PHAs decided to suspend enrollment in the phase two of CMTO in mid-March of 2020. The PHAs and Navigators continued to provide services for families who had already enrolled in the program, though nearly all interactions were shifted to a remote capacity given the need to follow local social distancing guidelines. This decision was made due to the public health situation, though PHA staff did consult with staff at Opportunity Insights in making the decision.

Coaching Services and Resources: Families could receive Rental Application Coaching, Opportunity Area Education, Housing Search Assistance, Flexible Financial Assistance, and Access to Landlords from Landlord Outreach as described above. This intervention is nearly identical to the intervention from Phase I, with slight deviations outlined above.

Cost-Optimized Services: Families in this group received pared down versions of the interventions described above. For example, families had only one in-person meeting with the Family Navigator, and fewer conversations via text or phone compared to those in the Coaching Services and Resources group. Families in this group did not receive direct customized unit referrals (unless their vouchers were for 3+ bedroom units), but the navigators would help with the housing search process if the family requested such assistance. Additionally, security deposit assistance is capped based on the bedroom size of the family’s voucher using the following limits: 0-1BD: $500, 2BD: $750, 3BD: $1000, 4BD: $1250, 5BD: $1500. Families could access additional financial assistance to cover costs related to application fees, but only for three units at the most.

Financial Assistance: Families in this group only received the full Flexible Financial Assistance available to families in the Coaching Services and Resources group. However, they received none of the other supports aside from some simple opportunity area education so they knew where they were eligible to use the financial assistance.
Intervention Start Date
2018-04-02
Intervention End Date
2021-05-07

Primary Outcomes

Primary Outcomes (end points)
Our core short-run outcomes are housing mobility and neighborhood environment characteristics. These include

• Initial lease up rate in an opportunity area (Defined at the family-level as 1 = lease up in opportunity neighborhood; 0 = does not lease up in opportunity neighborhood)

• Exposure to higher opportunity neighborhood quality. Our primary measure of this will be exposure-weighted mean neighborhood quality for the two years after random assignment using the Chetty and Hendren (2018 QJE) mean upward mobility rate of each neighborhood (Census tract). We will consider alternative ways to measure the exposure to neighborhood quality, including

i. Share of post-random assignment period spent residing in a high opportunity neighborhood (using a discrete measure of high opportunity)

ii. Point-in-time measures include measuring opportunity neighborhood residency status (binary or continuous measure using tract-level upward mobility rate) at a given amount of time after random assignment. For example, initial outcomes may be measured as the likelihood each family is living in an opportunity neighborhood one year after being randomly assigned to treatment or control groups.

• Census tract level mean household income rank for families at the 25th percentile of the parent income distribution in the neighborhood families chose using data from the Opportunity Atlas as laid out in Chetty, Friedman, Hendren, Jones and Porter (2018 NBER).

References:

Chetty, Raj and Nathaniel Hendren. 2018. “The Impacts of Neighborhoods on Intergenerational Mobility II: County-Level Estimates.” Quarterly Journal of Economics 133(3), 1163-1228.

Chetty, Raj and Nathaniel Hendren. 2018. “The Impacts of Neighborhoods on Intergenerational Mobility II: County-Level Estimates.” Quarterly Journal of Economics 133(3), 1163-1228.

Chetty, Raj, John N Friedman, Nathaniel Hendren, Maggie R Jones, and Sonya R Porter. 2018. The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility. Working Paper, Working Paper Series 25147. National Bureau of Economic Research, October.
Primary Outcomes (explanation)
The RCT’s goal is to test which interventions alleviate constraints that decrease the likelihood of low-income families moving to higher-opportunity neighborhoods for their children. Thus, the primary short-run outcome of interest indicating intervention effectiveness will be the likelihood of moving to an opportunity neighborhood, coupled with a measure of treatment persistence and intensity given by exposure-weighted neighborhood quality metrics. A key short-run mediating outcome is the overall housing voucher lease-up rate. CMTO interventions could increase overall housing voucher lease-up rates by providing assistance in housing search, but the CMTO could reduce overall lease-up rates by focusing housing search on higher-opportunity neighborhoods where it is more difficult to lease-up.

Secondary Outcomes

Secondary Outcomes (end points)
Secondary short-run outcomes include
• Teen birth rates and incarceration rates (both for families at the 25th percentile of the parent income distribution) in the neighborhood families chose based on data from the Opportunity Atlas as laid out in Chetty, Friedman, Hendren, Jones and Porter (2018 NBER).
• Apartment and neighborhood characteristics including the number of miles moved, size of the new unit in square feet, and total rent amount paid to the owner.
• A family's self-reported satisfaction with their new neighborhood, and their certainty about wanting to stay in their new neighborhood based on post-move survey data.
• Housing voucher lease up rate (1 = lease up with the housing voucher; 0 = does not lease up).

Interim secondary outcomes on families include

• Children’s standardized test scores (state percentile rank)
• Household adults’ employment and earnings

Longer-run child outcomes include

• Post-random assignment childhood exposure-weighted neighborhood quality from random assignment to age 18 (or early 20s) based on the Chetty and Hendren (2018 QJE) measure of neighborhood (Census tract) upward mobility. This is the primary measure of neighborhood environment that the intervention is designed to support.
• Core outcomes from IRS administrative tax data as defined in Chetty, Hendren, and Katz (2016 AER, Table 11) include
i. Individual earnings
ii. Household income
iii. College attendance from age 18-20 (%)
iv. College quality from age 18-20
v. Marital status
vi. Poverty share in zip code of residence (%) (or in Census tract of residence if possible with future versions of administrative tax data)

References:

Chetty, Raj and Nathaniel Hendren. 2018. “The Impacts of Neighborhoods on Intergenerational Mobility I: Childhood Exposure Effects.” Quarterly Journal of Economics 133(3), forthcoming.

Chetty, Raj and Nathaniel Hendren. 2018. “The Impacts of Neighborhoods on Intergenerational Mobility II: County-Level Estimates.” Quarterly Journal of Economics 133(3), forthcoming.

Chetty, Raj, Nathaniel Hendren, and Lawrence F. Katz. 2016. "The Effects of Exposure to Better Neighborhoods on Children: New Evidence from the Moving to Opportunity Experiment." American Economic Review, 106(4): 855-902.

Chetty, Raj, John N Friedman, Nathaniel Hendren, Maggie R Jones, and Sonya R Porter. 2018. The Opportunity Atlas: Mapping the Childhood Roots of Social Mobility. Working Paper, Working Paper Series 25147. National Bureau of Economic Research, October.
Secondary Outcomes (explanation)
We will also attempt to measure other short-run outcomes that we do not expect to change substantially in response to the CMTO interventions based on prior research including children’s educational outcomes and household income. In the longer-run, based on prior research on opportunity neighborhood exposure during childhood, we hypothesize that there will be an effect on longer-run child outcomes such as college attendance, individual and household income, marital status and out-of-wedlock childbearing, and adult neighborhood quality.

Experimental Design

Experimental Design
All families with at least one child under age 15, applying for federal housing choice vouchers (HCVs) through SHA or KCHA and eligible for that program (e.g. meeting income requirements) will be offered enrollment in CMTO. If they consent to participate in the study, they will be randomly assigned to a treatment group or a control group. In the first phase of the evaluation, families in the treatment group will have access to all the CMTO services in addition to the regular services provided by the housing authorities for new HCV participants. The control group will only have access to the normal housing authority services. A second phase of research is planned to further test the more promising components of CMTO services and understand their relative cost effectiveness. The services to be tested in this phase will be selected based upon qualitative research during the first phase around which services families are finding most helpful in making opportunity moves.
Experimental Design Details
Randomization Method
randomization done in office by computer
Randomization Unit
household
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
n/a
Sample size: planned number of observations
1284 households
Sample size (or number of clusters) by treatment arms
642 treatment, 642 control across Phases 1 and 2 of the RCT
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Assuming conventional 80% power and 95% confidence intervals, preliminary power calculations suggest that the minimum detectable effect size in the first year of the intervention is a 5 percentage-point change (46%) in the likelihood of moving to an opportunity neighborhood when comparing treatment and control groups. Using statistics provided by the Seattle and King County Housing Authorities, we based our calculations on assumptions on the projected number of new families with at least one child under age 15 issued a voucher each year (N = 1284), equally sized treatment and control group sizes, and the usual fraction of families issued vouchers who move to an opportunity neighborhood absent any intervention (11%, standard deviation = 0.31). Although we are interested in outcomes conditional on voucher take up, randomization will occur at the level of issued voucher, and we assume that historical 68% lease-up rates (weighted average across SHA and KCHA) will prevail for both treatment and control. We further assume that gamma = 5% of families assigned to the treatment group will opt-out of services. To calculate the minimum detectable effect size with an expected sample size of 1284 households, we followed equation (4.3) in Orr (1999) Minimum Detectable Effect = 2k*sigma/sqrt((1-gamma)*N) = 0.0502 where k = 2.8 is a constant determined by desired statistical size (5%) and power (80%); sigma = 0.31 is the standard deviation of the unconditional outcome of interest (the fraction of households issued a voucher that lease up in an opportunity neighborhood); gamma = 0.05 is the fraction of sample that decline program participation; and N = 1284 is the total number of vouchers to eligible families expected to be issued during the study across the two housing authorities. Although this is a large effect in relative terms, it is small in absolute terms (less than an extra 100 families a year moving to opportunity neighborhoods), and it is smaller than effects seen in the original Moving to Opportunity experiment evaluation and those estimated non-experimentally for the Baltimore Housing Mobility Program. Looking specifically at the power calculations for Phase I alone, and following the same assumptions as above, the Minimum Detectable Effect for the Phase I sample (642 issuances across treatment and control) rises to .0710 meaning that we anticipate having sufficient power to detect a 7.1 percentage point treatment effect between the treatment and control group. Phase Two consists of three distinct treatment arms with smaller sample sizes per arm and thus larger minimum detectable effects. Again the total sample target was 642 issuances, with 25% of families randomly assigned to one of the three treatment groups and the control group. Focusing specifically on the minimum detectable effects in the pairwise comparison context, our minimum detectable effect increases to 0.1003 meaning that we anticipate having sufficient power to detect a 10.0 percentage point treatment effect across any two treatment arms.
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
MDRC Institutional Review Board
IRB Approval Date
2018-02-15
IRB Approval Number
1030056-4
Analysis Plan

Analysis Plan Documents

Phase 2 Amendment to CMTO Seattle/King County Pre-Analysis Plan

MD5: 0c4cf87d28f492b8bf30ae55e28c5bd4

SHA1: e5a7ff59d12cbb76413e3ae9638923652703f4c5

Uploaded At: December 07, 2020

CMTO Seattle/King County Pre-Analysis Plan

MD5: c8cabc1c4d963348f6cfbe7ada0250fb

SHA1: 54f4dfec1ead61e66b3469d2d3807b44b713bc1d

Uploaded At: May 21, 2018

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials