Minimum detectable effect size for main outcomes (accounting for sample
design and clustering)
We determined that 10 groups, as described above, were necessary to achieve the objectives of this experiment. We then considered the number of households we could realistically recruit in the field and decided to assign 250 households to each group.
Our power calculation indicated that, with 250 households per group, detecting a statistically significant treatment effect at the 5% level would require at least a 7.5% reduction in electricity consumption.
In our previous study (Ida et al., 2023), we offered a rebate of 100 Japanese Yen per kWh and observed an average reduction in electricity usage of 5%. Since a 100 Yen rebate was unlikely to produce a reduction of 7.5% or more, we decided to increase the rebate to 200 Yen per kWh in order to reach the target effect size.
Ida, T., Ishihara, T., Ito, K., Kido, D., Kitagawa, T., Sakaguchi, S., & Sasaki, S. (2024). Choosing Who Chooses: Selection-Driven Targeting in Energy Rebate Programs. (No. w30469). National Bureau of Economic Research.