|
Field
Last Published
|
Before
November 10, 2015 02:10 PM
|
After
November 10, 2015 02:15 PM
|
|
Field
Primary Outcomes (End Points)
|
Before
Court administrate data collected through a template called the Daily Court Return Template. This template will be used to primarily measure timeliness and efficiency of cases. Namely,
• Time to disposition (the average and median time between filing of a case (or entry of plea) to conclusion).
• Percentage of cases concluded within the time limit (360 days)
• Case clearance rate (the number of resolved cases as a percentage of initiated cases for a specific period).
Court user satisfaction and employee engagement surveys will provide a means to decipher whether efforts to improve timeliness and efficiency has negative side-effects on quality. . The survey will be conducted on annual basis and will ask court users and employees about their perceptions on service quality, facilities, perceptions of judicial officers and complaints handling.
|
After
Court administrate data collected through a template called the Daily Court Return Template. This template will be used to primarily measure timeliness and efficiency of cases. Namely,time to disposition (the average and median time between filing of a case (or entry of plea) to conclusion);percentage of cases concluded within the time limit (360 days); case clearance rate (the number of resolved cases as a percentage of initiated cases for a specific period).
Court user satisfaction and employee engagement surveys will provide a means to decipher whether efforts to improve timeliness and efficiency has negative side-effects on quality. The survey will be conducted on annual basis and will ask court users and employees about their perceptions on service quality, facilities, perceptions of judicial officers and complaints handling.
|
|
Field
Experimental Design (Public)
|
Before
The intervention implementation will use a fractional factorial design testing three binary treatments. There will be four treatment arms or clusters. To avoid that one of the treatments gets 2 or more of the courts located in the largest urban areas, we will stratify by city size. In particular, courts located within the largest urban areas will not be included in the same treatment group.
|
After
The intervention implementation will use a fractional factorial design testing three binary treatments. There will be four treatment arms or clusters. To avoid that one of the treatments gets 2 or more of the courts located in the largest urban areas, we will stratify by city size. In particular, courts located within the largest urban areas will not be included in the same treatment group.
|
|
Field
Randomization Unit
|
Before
4 clusters with 54 courts randomly assigned to each cluster
|
After
4 clusters with 58 courts randomly assigned to each cluster
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
54 courts control, 54 simple feedback form, 54 simple feedback from + top-down accountability, 54 simple feedback form + demand-side accountability
|
After
58 courts control, 58 simple feedback form, 58 simple feedback from + top-down accountability, 58 simple feedback form + demand-side accountability
|
|
Field
Power calculation: Minimum Detectable Effect Size for Main Outcomes
|
Before
Indicators based on the Daily Court Returns Template:
We provide below the number of courts required per treatment arm that are required to achieve power to 80%. Intra-cluster correlation is not applicable here as we have 1 observation per court. We report 2 scenarios for the correlation between waves (which we expect to be quite high given the monthly nature of the data). We use as benchmark indicator the case clearance rate. Other inputs for the sample power calculation are: 5% significance level, power 80%, baseline probability: 60% (based on data from Sep 2015 DCRT), 6 baseline waves, and 12 follow up waves. The table below confirms that 58 courts per treatment arm should ensure acceptable level of statistical power.
Indicators based on court user satisfaction and employee engagement survey:
We provide below the number of courts required per treatment arm that are required to achieve power to 80% under different levels of the intra-cluster correlation (rho). We use as benchmark indicator the probability of court users that report are satisfied with the court service. Other inputs for the sample power calculation are: 5% significance level, power 80%, baseline probability: 66% (based on data from the baseline), 1 baseline wave, and 2 follow up waves, correlation between waves: 0.6, and that 24 respondents will be interviewed in each court (as it was indeed the case for the baseline survey already conducted and will be for the follow ups). The table below confirms that 58 courts per treatment arm should ensure acceptable level of statistical power.
|
After
Indicators based on the Daily Court Returns Template:
Power calculations have revealed that 58 courts per treatment arm are sufficient to achieve power to 80%. Intra-cluster correlation is not applicable here as we have 1 observation per court. We report 2 scenarios for the correlation between waves (which we expect to be quite high given the monthly nature of the data). We use as benchmark indicator the case clearance rate. Other inputs for the sample power calculation are: 5% significance level, power 80%, baseline probability: 60% (based on data from Sep 2015 DCRT), 6 baseline waves, and 12 follow up waves. Power calculations have confirmed that 58 courts per treatment arm should ensure acceptable level of statistical power.
Indicators based on court user satisfaction and employee engagement survey:
Power calculations have revealed that 58 courts per treatment arm are sufficient to achieve power to 80% under different levels of the intra-cluster correlation (rho). We use as benchmark indicator the probability of court users that report are satisfied with the court service. Other inputs for the sample power calculation are: 5% significance level, power 80%, baseline probability: 66% (based on data from the baseline), 1 baseline wave, and 2 follow up waves, correlation between waves: 0.6, and that 24 respondents will be interviewed in each court (as it was indeed the case for the baseline survey already conducted and will be for the follow ups).
|