|
Field
Last Published
|
Before
July 14, 2024 03:20 PM
|
After
July 15, 2024 04:17 PM
|
|
Field
Planned Number of Clusters
|
Before
501 students in 2018-2019
1,156 students in 2019-2010
48 blocks in 2018-2019 (school-by-grade-by texting language fixed-effects)
41 blocks in 2019-2020 (school-by-grade-by texting language fixed-effects)
|
After
501 students in 2018-2019
1,156 students in 2019-2010
48 blocks in 2018-2019 (school-by-grade-by texting language fixed-effects)
42 blocks in 2019-2020 (school-by-grade-by texting language fixed-effects)
|
|
Field
Planned Number of Observations
|
Before
501 students in 2018-2019
1,156 students in 2019-2010
48 blocks in 2018-2019 (school-by-grade-by texting language fixed-effects)
41 blocks in 2019-2020 (school-by-grade-by texting language fixed-effects)
|
After
501 students in 2018-2019
1,156 students in 2019-2010
48 blocks in 2018-2019 (school-by-grade-by texting language fixed-effects)
42 blocks in 2019-2020 (school-by-grade-by texting language fixed-effects)
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
2018-2019
- Treatment: 253
- Control: 248
- Total: 501
- Blocks: 48
2019-2020
- Treatment: 581
- Control: 575
- Total: 1,156
- Blocks: 41
|
After
2018-2019
- Treatment: 253
- Control: 248
- Total: 501
- Blocks: 48
2019-2020
- Treatment: 581
- Control: 575
- Total: 1,156
- Blocks: 42
|
|
Field
Power calculation: Minimum Detectable Effect Size for Main Outcomes
|
Before
We used the PowerUp! tool for power analyses (Shiny App here: https://powerupr.shinyapps.io/index/), allocating 50% of students to the treatment and 50% to the control. Below are the minimum detectable effect sizes (SD units).
2018-2019
PSJA: 48 blocks, harmonic mean across blocks = 5.937367 --> MDES = 0.272 SD
2019-2020
PSJA: 41 blocks, harmonic mean across blocks = 7.274103 --> MDES = 0.266 SD
|
After
We used the PowerUp! tool for power analyses (Shiny App here: https://powerupr.shinyapps.io/index/), allocating approximately 50% of students to the treatment and 50% to the control. We assumed that our model would include 20 covariates and would explain about 33.33% of the variance. Below are the minimum detectable effect sizes (SD units).
2018-2019
PSJA: 48 blocks, harmonic mean across blocks = 5.937367 --> MDES = 0.272 SD
2019-2020
PSJA: 42 blocks, harmonic mean across blocks = 7.274103 --> MDES = 0.263 SD
|