|
Field
Last Published
|
Before
October 31, 2022 03:53 PM
|
After
July 14, 2024 06:14 PM
|
|
Field
Planned Number of Clusters
|
Before
2020-2021
District 1: 2,324 students, 46 blocks (school-by-grade-by texting language fixed-effects)
District 2: 2,106 students, 12 blocks (school-by-grade fixed-effects)
District 3: 2,888 students, 33 blocks (school-by-grade fixed-effects)
2021-2022
District 1: 1,133 students, 47 blocks (school-by-grade-by texting language fixed-effects)
District 2: 943 students, 12 blocks (school-by-grade fixed-effects)
District 3: 1,246 students, 33 blocks (school-by-grade fixed-effects)
District 4: 2,819 students, 34 blocks (school-by-grade-by texting language fixed-effects)
District 5: 4,976 students, 66 blocks (school-by-grade-by texting language fixed-effects)
District 6: 3,510 students, 36 blocks (school-by-grade-by texting language fixed-effects)
District 7: 609 students, 18 blocks (school-by-grade fixed-effects)
|
After
2020-2021 (same-year effects sample sizes)
District 1: 2,324 students, 46 blocks (school-by-grade-by texting language fixed-effects)
District 2: 2,106 students, 12 blocks (school-by-grade fixed-effects)
District 3: 2,888 students, 33 blocks (school-by-grade fixed-effects)
2021-2022 (same-year effects sample sizes)
District 1: 1,133 students, 47 blocks (school-by-grade-by texting language fixed-effects)
District 2: 943 students, 12 blocks (school-by-grade fixed-effects)
District 3: 1,246 students, 33 blocks (school-by-grade fixed-effects)
District 4: 2,819 students, 34 blocks (school-by-grade-by texting language fixed-effects)
District 5: 4,976 students, 66 blocks (school-by-grade-by texting language fixed-effects)
District 6: 3,510 students, 36 blocks (school-by-grade-by texting language fixed-effects)
District 7: 609 students, 18 blocks (school-by-grade fixed-effects)
2022-2023 (same-year effects sample sizes) xxxxxxxxxxxxxx
District 1: 1,133 students, 47 blocks (school-by-grade-by texting language fixed-effects)
District 2: 943 students, 12 blocks (school-by-grade fixed-effects)
District 3: 1,246 students, 33 blocks (school-by-grade fixed-effects)
District 4: 2,819 students, 34 blocks (school-by-grade-by texting language fixed-effects)
District 5: 4,976 students, 66 blocks (school-by-grade-by texting language fixed-effects)
District 6: 3,510 students, 36 blocks (school-by-grade-by texting language fixed-effects)
District 7: 609 students, 18 blocks (school-by-grade fixed-effects)
District 8: 609 students, 18 blocks (school-by-grade fixed-effects)
2023-2024 (same-year effects sample sizes)
District 4: 1,426 students, 33 blocks (school-by-grade-by texting language fixed-effects)
District 5: xxx4,976 students, 66 blocks (school-by-grade-by texting language fixed-effects)
District 6: xxx3,510 students, 36 blocks (school-by-grade-by texting language fixed-effects)
|
|
Field
Planned Number of Observations
|
Before
2020-2021
District 1: 2,324 students, 46 blocks (school-by-grade-by texting language fixed-effects)
District 2: 2,106 students, 12 blocks (school-by-grade fixed-effects)
District 3: 2,888 students, 33 blocks (school-by-grade fixed-effects)
2021-2022
District 1: 1,133 students, 47 blocks (school-by-grade-by texting language fixed-effects)
District 2: 943 students, 12 blocks (school-by-grade fixed-effects)
District 3: 1,246 students, 33 blocks (school-by-grade fixed-effects)
District 4: 2,819 students, 34 blocks (school-by-grade-by texting language fixed-effects)
District 5: 4,976 students, 66 blocks (school-by-grade-by texting language fixed-effects)
District 6: 3,510 students, 36 blocks (school-by-grade-by texting language fixed-effects)
District 7: 609 students, 18 blocks (school-by-grade fixed-effects)
|
After
2020-2021 (same-year effects sample sizes)
District 1: 2,324 students, 46 blocks (school-by-grade-by texting language fixed-effects)
District 2: 2,106 students, 12 blocks (school-by-grade fixed-effects)
District 3: 2,888 students, 33 blocks (school-by-grade fixed-effects)
2021-2022
District 1: 1,133 students, 47 blocks (school-by-grade-by texting language fixed-effects)
District 2: 943 students, 12 blocks (school-by-grade fixed-effects)
District 3: 1,246 students, 33 blocks (school-by-grade fixed-effects)
District 4: 2,819 students, 34 blocks (school-by-grade-by texting language fixed-effects)
District 5: 4,976 students, 66 blocks (school-by-grade-by texting language fixed-effects)
District 6: 3,510 students, 36 blocks (school-by-grade-by texting language fixed-effects)
District 7: 609 students, 18 blocks (school-by-grade fixed-effects)
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
2020-2021
District 1
- Treatment: 1,169
- Control: 1,155
- Total: 2,324
- Blocks: 46
District 2
- Treatment: 1,051
- Control: 1,055
- Total: 2,106
- Blocks: 12
District 3
- Treatment: 1,445
- Control: 1,443
- Total: 2,888
- Blocks: 33
2021-2022
District 1
- Treatment: 569
- Control: 564
- Total: 1,133
- Blocks: 47
District 2
- Treatment: 472
- Treatment: 471
- Total: 943
- Blocks: 12
District 3
- Treatment: 622
- Control: 624
- Total: 1,246
- Blocks: 33
District 4
- Treatment: 1,410
- Control: 1,409
- Total: 2,819
- Blocks: 34
District 5
- Treatment: 2,488
- Control: 2,488
- Total: 4,976
- Blocks: 66
District 6
- Treatment: 1,753
- Control: 1,757
- Total: 3,510
- Blocks: 36
District 7
- Treatment: 302
- Control: 307
- Total: 609
- Blocks: 18
|
After
2020-2021 (same-year effects sample sizes)
District 1
- Treatment: 1,169
- Control: 1,155
- Total: 2,324
- Blocks: 46
District 2
- Treatment: 1,051
- Control: 1,055
- Total: 2,106
- Blocks: 12
District 3
- Treatment: 1,445
- Control: 1,443
- Total: 2,888
- Blocks: 33
2020-2021 Academic Year
District Treatment Control Total # Blocks
District 1 1,431 1,409 2,840 46
District 2 1,193 1,203 2,396 12
District 3 1,598 1,605 3,203 33
Total 4,222 4,217 8,439 91
2021-2022
District 1
- Treatment: 569
- Control: 564
- Total: 1,133
- Blocks: 47
District 2
- Treatment: 472
- Treatment: 471
- Total: 943
- Blocks: 12
District 3
- Treatment: 622
- Control: 624
- Total: 1,246
- Blocks: 33
District 4
- Treatment: 1,410
- Control: 1,409
- Total: 2,819
- Blocks: 34
District 5
- Treatment: 2,488
- Control: 2,488
- Total: 4,976
- Blocks: 66
District 6
- Treatment: 1,753
- Control: 1,757
- Total: 3,510
- Blocks: 36
District 7
- Treatment: 302
- Control: 307
- Total: 609
- Blocks: 18
2021-2022
District 1
- Treatment: 569
- Control: 564
- Total: 1,133
- Blocks: 47
District 2
- Treatment: 472
- Treatment: 471
- Total: 943
- Blocks: 12
District 3
- Treatment: 622
- Control: 624
- Total: 1,246
- Blocks: 33
District 4
- Treatment: 1,410
- Control: 1,409
- Total: 2,819
- Blocks: 34
District 5
- Treatment: 2,488
- Control: 2,488
- Total: 4,976
- Blocks: 66
District 6
- Treatment: 1,753
- Control: 1,757
- Total: 3,510
- Blocks: 36
District 7
- Treatment: 302
- Control: 307
- Total: 609
- Blocks: 18
2023-2024
District 4
- Treatment: 713
- Control: 713
- Total: 1,426
- Blocks: 33
District 5
- Treatment: 724
- Control: 724
- Total: 1,448
- Blocks: 35
District 6
- Treatment: 1,068
- Control: 1,051
- Total: 2,119
- Blocks: 72
|
|
Field
Power calculation: Minimum Detectable Effect Size for Main Outcomes
|
Before
We used the PowerUp! tool for power analyses (Shiny App here: https://powerupr.shinyapps.io/index/), allocating 50% of students to the treatment and 50% to the control. Below are the minimum detectable effect sizes (SD units).
2020-2021
District 1: 46 blocks, harmonic mean across blocks = 15.83980 --> MDES = 0.170 SD
District 2: 12 blocks, harmonic mean across blocks = 172.3907 --> MDES = 0.101 SD
District 3: 33 blocks, harmonic mean across blocks = 72.02920 --> MDES = 0.094 SD
2021-2023
District 1: 47 blocks, harmonic mean across blocks = 11.03975 --> MDES = 0.201 SD
District 2: 12 blocks, harmonic mean across blocks = 69.04140 --> MDES = 0.159 SD
District 3: 33 blocks, harmonic mean across blocks = 29.79569 --> MDES = 0.146 SD
District 4: 34 blocks, harmonic mean across blocks = 17.98736 --> MDES = 0.185 SD
District 5: 66 blocks, harmonic mean across blocks = 56.84348 --> MDES = 0.075 SD
District 6: 36 blocks, harmonic mean across blocks = 32.24948 --> MDES = 0.134 SD
District 7: 18 blocks, harmonic mean across blocks = 31.09235 --> MDES = 0.194 SD
|
After
We used the PowerUp! tool for power analyses (Shiny App here: https://powerupr.shinyapps.io/index/), allocating 50% of students to the treatment and 50% to the control. Below are the minimum detectable effect sizes (SD units).
2020-2021 (same-year effects sample sizes)
District 1: 46 blocks, harmonic mean across blocks = 15.83980 --> MDES = 0.170 SD
District 2: 12 blocks, harmonic mean across blocks = 172.3907 --> MDES = 0.101 SD
District 3: 33 blocks, harmonic mean across blocks = 72.02920 --> MDES = 0.094 SD
2021-2022 (same-year effects sample sizes)
District 1: 47 blocks, harmonic mean across blocks = 11.03975 --> MDES = 0.201 SD
District 2: 12 blocks, harmonic mean across blocks = 69.04140 --> MDES = 0.159 SD
District 3: 33 blocks, harmonic mean across blocks = 29.79569 --> MDES = 0.146 SD
District 4: 34 blocks, harmonic mean across blocks = 17.98736 --> MDES = 0.185 SD
District 5: 66 blocks, harmonic mean across blocks = 56.84348 --> MDES = 0.075 SD
District 6: 36 blocks, harmonic mean across blocks = 32.24948 --> MDES = 0.134 SD
District 7: 18 blocks, harmonic mean across blocks = 31.09235 --> MDES = 0.194 SD
|