Minimum detectable effect size for main outcomes (accounting for sample
design and clustering)
Proportional outcomes, considering a sample of 1200, divided across 4 groups of 300, provide valid power for this type of policy experiment. Specifically considering an initial reading level reported at 15% we are powered at 80% to detect a 9% increase or decrease in reading level, and 11% if the baseline value is revealed to be as high as 30%.
Proportional outcomes considering a sample of 1200, divided across 4 groups of 300, provide valid power for this type of policy experiment. Specifically considering an initial reading level reported at 15% we are powered at 80% to detect a 9% increase or decrease in reading level, and 11% if the baseline value is revealed to be as high as 30%.
When it comes to the difference between treatment arms, we are considering a higher level of reading for the standard treatment group of 50%. This is the worst-case scenario, given the binary outcome power property, and with a power of 80% we are still able to detect a 12% difference with an additional treatment group. For the father intervention, we do not necessarily expect the actual reading to exceed that much the standard intervention, but we do expect other indicators on social norm and attitude towards reading to increase significantly, and this would be enough, to see an effect on father’s outcome.