| Field | Before | After |
|---|---|---|
| Field Last Published | Before September 17, 2024 01:53 PM | After September 18, 2024 04:20 PM |
| Field Intervention (Public) | Before After consenting to participate, this survey begins with a series of screener questions and some baseline demographic questions. At the beginning of the survey experiment, all respondents are provided with a short description of the 2023 takeover of HISD by Texas Education Agency. Half the respondents receive only this information (control group), and half the respondents are randomly assigned to receive additional information (treatment group) about student performance on standardized tests in different sets of schools. After viewing this information, both groups answer a series of questions related to their perception of the state takeover (overall and its individual components), HISD district leadership, and the process that led to the takeover. The survey experiment concludes with both groups answering a set of demographic questions. | After After consenting to participate, this survey begins with a series of screener questions and some baseline demographic questions. At the beginning of the survey experiment, all respondents are provided with a short description of the 2023 takeover of HISD by Texas Education Agency. Half the respondents receive only this information (control group), and half the respondents are randomly assigned to receive additional information (treatment group) about student performance on standardized tests in different sets of schools. After viewing this information, both groups answer a series of questions related to their perception of the state takeover (overall and its individual components), HISD district leadership, the process that led to the takeover, and a 2024 bond measure that would provide $4.4 billion to finance improvements within HISD schools. The survey experiment concludes with both groups answering a set of demographic questions. |
| Field Intervention (Hidden) | Before After consenting to participate, this survey begins with a series of screener questions to assess whether respondents are eligible to participate in a given wave of the survey (all participants must be at least 18 years old, and some waves are geographically restricted). After the screener questions, participants are asked whether they live in the boundaries of Houston Independent School District (HISD), whether they are a parent of a school-aged child, and whether that child attends an HISD school. At the beginning of the survey experiment, all respondents are provided with a short description of the 2023 takeover of HISD by Texas Education Agency. Half the respondents receive only this information (control group), and half the respondents are randomly assigned to receive additional information (treatment group) about student performance on standardized tests in HISD schools most affected by the state takeover, in HISD schools least affected by the state takeover, and in Texas as a whole. After reading this description, both groups answer an attention check question. Next, the control group answers a series of questions related to their perception of the state takeover (overall and its individual components), HISD district leadership, and the process that led to the takeover. The treatment group views two figures synthesizing the additional information about student performance on standardized tests and answers an additional attention check question before answering the same series of questions related to their perception of the state takeover (overall and its individual components), HISD district leadership, and the process that led to the takeover. The survey experiment concludes with both groups answering a set of demographic questions. For survey details, see uploaded materials in "Supporting Documents and Materials". | After After consenting to participate, this survey begins with a series of screener questions to assess whether respondents are eligible to participate in a given wave of the survey (all participants must be at least 18 years old, and some waves are geographically restricted). After the screener questions, participants are asked whether they live in the boundaries of Houston Independent School District (HISD), whether they are a parent of a school-aged child, and whether that child attends an HISD school. At the beginning of the survey experiment, all respondents are provided with a short description of the 2023 takeover of HISD by Texas Education Agency. Half the respondents receive only this information (control group), and half the respondents are randomly assigned to receive additional information (treatment group) about student performance on standardized tests in HISD schools most affected by the state takeover, in HISD schools least affected by the state takeover, and in Texas as a whole. After reading this description, both groups answer an attention check question. Next, the control group answers a series of questions related to their perception of the state takeover (overall and its individual components), HISD district leadership, and the process that led to the takeover. The treatment group views two figures synthesizing the additional information about student performance on standardized tests and answers an additional attention check question before answering the same series of questions related to their perception of the state takeover (overall and its individual components), HISD district leadership, the process that led to the takeover, and a 2024 bond measure that would provide $4.4 billion to finance improvements within HISD schools. The survey experiment concludes with both groups answering a set of demographic questions. For survey details, see uploaded materials in "Supporting Documents and Materials". |
| Field Secondary Outcomes (End Points) | Before The secondary outcomes of this study will include a series of indices that assess different dimensions of respondents' perceptions of the state takeover of HISD, including 1) An index summarizing respondents' overall rating of the state takeover of HISD; 2) respondents' overall rating of NES reforms related to teacher and principal compensation and evaluation; 3) respondents' overall rating of NES reforms related to classroom instruction; 4) respondents' overall rating of NES reforms related to school culture and staffing; 5) respondents' overall rating of NES reforms related to school operations. Additionally, we will convert respondents' stated preferences about when TEA should restore governing responsibilities to the elected HISD school board into a binary variable based on the median response of the control group, and report whether the informational intervention influenced respondents to prefer a longer or shorter takeover. Similarly, we will convert respondents' stated preferences about the conditions under which TEA should restore governing responsibilities to the elected HISD school board into a binary variable based on the median response of the control group, and report whether the informational intervention influenced respondents to prefer more or less restrictive conditions for ending the takeover. Finally, we will conduct a moderation and mediation analyses. We will conduct a moderation analysis comparing the influence of information on respondent preferences based on distance from HISD. First, among Harris county residents, we will compare the impact of information on the preferences of HISD parents with school age children versus non-parents and parents of older children. Next, we will compare the impact of information on the preferences of Harris County residents versus respondents who take the survey elsewhere in Texas or outside of Texas. We will examine participants ratings of the process that led to the takeover as a mediator of their ratings of the takeover. Exploratory analyses will examine the impact of information in responses to particular questions or subquestions. | After The secondary outcomes of this study will include a series of indices that assess different dimensions of respondents' perceptions of the state takeover of HISD, including 1) An index summarizing respondents' overall rating of the state takeover of HISD; 2) respondents' overall rating of NES reforms related to teacher and principal compensation and evaluation; 3) respondents' overall rating of NES reforms related to classroom instruction; 4) respondents' overall rating of NES reforms related to school culture and staffing; 5) respondents' overall rating of NES reforms related to school operations. Additionally, we will convert respondents' stated preferences about when TEA should restore governing responsibilities to the elected HISD school board into a binary variable based on the median response of the control group, and report whether the informational intervention influenced respondents to prefer a longer or shorter takeover. Similarly, we will convert respondents' stated preferences about the conditions under which TEA should restore governing responsibilities to the elected HISD school board into a binary variable based on the median response of the control group, and report whether the informational intervention influenced respondents to prefer more or less restrictive conditions for ending the takeover. Additionally, we will convert respondents' stated preferences about the $4.4 billion 2024 HISD bond measure into a binary variable based on the median response of the control group, and report whether the informational intervention influenced respondents to express more or less support for the bond measure. Finally, we will conduct a moderation and mediation analyses. For our primary moderation analysis, we will compare the influence of information on respondent preferences based on distance from Houston. First, we will compare the impact of information on the preferences of survey respondents who take the survey in Texas versus those who live outside of Texas. If we have at least 150 survey participants who live in Harris County, Texas, we will compare the impact on Harris County residents versus respondents who take the survey in Texas versus those who live outside of Texas. This is a slight change from our original pre-registered moderation analysis plan (see trial history), when we anticipated being able to target the survey to Harris County residents only (we were able to restrict the sample by state, but not county). We will examine participants ratings of the process that led to the takeover as a mediator of their ratings of the takeover. Exploratory analyses will examine the impact of information in responses to particular questions or subquestions. |
| Field Secondary Outcomes (Explanation) | Before To construct each index, subquestions related to each domain will be converted from a 7-point Likert scale of "Strongly Disagree" to "Strongly Agree" to numeric values of 1-7, summed, and standardized to have a mean of 0 and a standard deviation of one. Below the subquestions that contribute to each index are listed by their question numbers (see survey materials in "Supporting Documents and Materials"): Index 1: 4 subquestions of Q6.1 Index 2: 4 subquestions of Q6.2 Index 3: 3 subquestions of Q6.3 Index 4: 5 subquestions of Q6.4 Index 5: 3 subquestions of Q6.5 Length of takeover secondary outcome: Binary variable based on median response to Q7.1 in control group. Restrictiveness of conditions to end takeover secondary outcome: Binary variable based on median response to Q7.2 in control group. | After To construct each index, subquestions related to each domain will be converted from a 7-point Likert scale of "Strongly Disagree" to "Strongly Agree" to numeric values of 1-7, summed, and standardized to have a mean of 0 and a standard deviation of one. Below the subquestions that contribute to each index are listed by their question numbers (see survey materials in "Supporting Documents and Materials"): Index 1: 4 subquestions of Q6.1 Index 2: 4 subquestions of Q6.2 Index 3: 3 subquestions of Q6.3 Index 4: 5 subquestions of Q6.4 Index 5: 3 subquestions of Q6.5 In Length of takeover secondary outcome: Binary variable based on median response to Q7.1 in control group. Restrictiveness of conditions to end takeover secondary outcome: Binary variable based on median response to Q7.2 in control group. Bond support secondary outcome: Binary variable based on median response to Q47 in control group. |
| Field | Before | After |
|---|---|---|
| Field Document Name | Before | After Survey Instrument (Texas Sample) |
| Field File | Before |
After
HISD_Takeover_Survey_Experiment_TX_Final.pdf
MD5:
2574ecf6371be83f6fb98c5647415251
SHA1:
36be01ae7081da23b9df27c41e5e3f3ff83f4543
|
| Field Description | Before | After This is the survey instrument for the Texas sample (pilot data collection of 50 subjects began on 9/16/24). No data was accessed until after this revision of the pre-registration. |
| Field Public | Before | After Yes |