Enhancing Enforcement through Religious Institutions: Experimental Evidence from Pakistan’s Power Sector

Last registered on August 10, 2023

Pre-Trial

Trial Information

General Information

Title
Enhancing Enforcement through Religious Institutions: Experimental Evidence from Pakistan’s Power Sector
RCT ID
AEARCTR-0011847
Initial registration date
August 06, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
August 10, 2023, 1:30 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Tufts University

Other Primary Investigator(s)

PI Affiliation
London School of Economics and Political Science
PI Affiliation
The University of Chicago
PI Affiliation
The University of Chicago
PI Affiliation
London School of Economics and Political Science

Additional Trial Information

Status
In development
Start date
2023-10-01
End date
2024-10-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
The ability of governments to expand access to reliable energy runs aground when state capacity is limited. Weak enforcement creates a leaky bucket in power sectors across the developing world as theft and unpaid bills go unchecked. Utilities, desperate to stanch further losses, are forced to restrict electricity supply and raise prices on those who do pay. Faced with bad supply and ever higher prices, customers choose to exit the grid or give up paying altogether, creating a negative fiscal spiral. Until this cycle is broken, governments remain stuck propping up ailing power sectors using scarce capital or are forced to cut back their investments into expanding access. Either outcome harms those in poverty as their access to energy gets cut and the price of electricity rises. Pakistan embodies this sorry tale: its power sector debt exceeds 5.2% of GDP, total losses surpass 25%, remote areas face hours of load shedding a day, and annual power subsidies exceed the country’s joint budget on social protection and education. In short, theft due to a lack of enforcement acts as a supply-side cost on the system, lowering the total electricity that can be produced and supplied to the poor. Perhaps counter-intuitively, enhancing enforcement in this setting can therefore raise the wellbeing of the poor over time.
If individuals judge the probability of punishment from the state to be low then other factors drive the decision to pay. Our hypothesis, based on ongoing fieldwork in Pakistan and from our long-standing research in Bihar, India, is that changing social norms might be a cost-effective way to enhance enforcement in these areas. Our aim is to evaluate a novel intervention backed by the government of Pakistan that seeks to shift social norms on the payment of electricity in areas beyond the reach of the state. If successful, this innovation could offer a cost-effective way to expand access to energy in poor, rural areas of the developing world that grapple with enforcement problems.
We plan to use influential agents in local communities to shift norms on paying for electricity by disseminating messages against theft to residents. In our context these messages will primarily be delivered through religious institutions (mosques). On a smaller scale we will test delivering secular messages through social gatherings led by community elders. We partner with Akhuwat, a prominent Islamic Microfinance institution, to design and implement the treatments.
External Link(s)

Registration Citation

Citation
Burgess, Robin et al. 2023. "Enhancing Enforcement through Religious Institutions: Experimental Evidence from Pakistan’s Power Sector." AEA RCT Registry. August 10. https://doi.org/10.1257/rct.11847-1.0
Experimental Details

Interventions

Intervention(s)
(A) Religious Messaging recruits religious leaders/mosques to deliver messages on electricity theft during Friday sermons, a weekly congregation attended by most of the male population in the country. We encourage using references from the Quran and Sunnah of the Prophet (Peace Be Upon Him).

(B) Secular Messaging recruits village leaders to gather community members and deliver messages on electricity theft, analogous to a
Panchayat. We explicitly ask them not to make any religious references in their messages and instead to rely purely on logical reasons (e.g. less theft means more supply). This pilot arm is important to test if secular messages can be a viable alternative in less religious contexts.

For both (A) and (B), messages would be delivered once every two weeks for three months. Leaders have discretion over the precise message content but we do ask them to specifically mention: “stealing electricity is theft and not paying bills is equivalent to not honoring debt”. We will audit a random set of treatment sites each week and will record all messages delivered. From our initial field work we did not encounter any significant issues on recruiting mosques into the treatment or on compliance.
Intervention Start Date
2024-01-01
Intervention End Date
2024-10-01

Primary Outcomes

Primary Outcomes (end points)
Changes in outright electricity theft, as measured by the difference between incoming feeder supply and billed power
Changes in bill recovery, as measured by changes in the proportion of monthly household electricity bills that get paid
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Our experiment will take place across 140 distribution feeders in rural areas of Punjab, Pakistan over a 12-month period. The experiment consists of the following treatments:

A. Religious Messaging [Mosques] (65 Feeders)
B. Secular Messaging [Social gathering] (10 Feeders)
D. Control (65 Feeders)

Our level of randomization is large. A typical distribution feeder covers 5-6 villages with an average of over 3,500 customers per feeder. The largest mosques in each village will be recruited for the treatment. Akhuwat will help recruit communities into the various treatments, bringing down costs and setting us up for a future scale up. We randomize at the feeder level because this is the lowest level we can observe direct measurements of outright electricity theft via illegal hooks onto power lines, a common form of theft in our sample area.

Our focus is on rural areas. We stratify our sample based on the pre-treatment feeder category assigned by the government. The government classifies a feeder into different categories (I to VII) based on its historical aggregate technical and commercial losses. This category, in turn, determines the amount of scheduled power outages a particular feeder will face. Stratifying based on these bins will therefore ensure a cleaner comparison between treatment and control, especially since outages may influence payment or theft decisions. We control for further covariates, notably number of customers in a feeder and baseline incomes, that may influence our outcomes.

Monthly electricity billing and supply data at both the individual and feeder level will be provided by the government. This will let us measure our two core outcomes of interest: changes in outright electricity theft, as measured by the difference between incoming feeder supply and billed power, and changes in bill recovery, as measured by changes in the proportion of monthly household electricity bills that get paid. These outcomes provide a revealed preference measure for whether social norms change.

Household surveys (30-40 per feeder) will supplement this data to elicit beliefs on paying for electricity as well as measure religiosity. The household survey captures three major aspects:

- Basic Household Information: demographics, asset ownership, income and expenditure, numeracy and literacy tests, risk preferences and loss aversion, shocks
- Electricity: electricity sources, consumption, payments, reasons for partial/non-payment and theft, power outages, beliefs on enforcement and whether people believe that electricity is a right
- Religiosity: we elicit levels of religiosity (intrinsic, extrinsic, general) in a similar vein to Bryan, Choi & Karlan (2021). We included detailed questions on mosque and Friday sermon attendance.
- Networks: we are currently testing a survey instrument in a sample of villages to generate aggregate relational data that can identify likely network ties in local communities (Breza, Chandrasekhar, McCormick & Pan, 2020). This would enable us to trace out whether changes in outcomes following the receival of the treatment (e.g. listened to mosque sermon) extend via social networks to ‘untreated’ households (e.g. those who did not attend) within a community.
Experimental Design Details
Randomization Method
Randomization done in office by a computer.
Randomization Unit
Feeder.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
140 distribution feeders in rural areas of Punjab, Pakistan.
Sample size: planned number of observations
140*3,500=490,000 customers/households, on average
Sample size (or number of clusters) by treatment arms
Religious Messaging [Mosques]: 65 Feeders
Secular Messaging [Social gathering]: 10 Feeders
Control: 65 Feeders
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Our primary outcomes of interest are outright theft (measured at the feeder level) and bill payments (measured either on individual bills or feeder level collection). We use administrative data for all feeders in our sample area over the past 6 months coupled with individual billing data to estimate the necessary sample sizes to obtain power. We stratify based on feeder category and control for the number of connections. With the standard assumption on significance level (0.05), we require a total sample size of 126-130 feeders to detect a meaningful effect (i.e. 10% change). To improve our measure of losses due to unpaid bills we can utilise our individual-level billing data by adapting a clustered design with distribution feeders as the cluster. We compute the intra-cluster correlation using consumer data from earlier fieldwork. Our power calculations for collection loss (individual level) tells us that in order to detect a 2.5 percentage point difference (6% change) with a cluster size of 50, we need 36 feeders in treatment and 36 in control. In total, 72 feeders and 3,600 individuals. Because we lack full pilot results on treatment effect sizes we opt for a conservative core total sample size of 130 feeders. The treatment effect sizes necessary (i.e. 6-10% changes) are reasonable and match those with other papers using religious interventions in other settings, such as paying back credit card debt (Bursztyn et al, 2019). To avoid possible concerns on spillovers we will not place treatment and control feeders next to each other.
IRB

Institutional Review Boards (IRBs)

IRB Name
LSE Research Ethics Committee
IRB Approval Date
2021-03-08
IRB Approval Number
21425

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials