Experimental Design
This study is a randomized control trial implemented in collaboration with the Punjab Safe Cities Authority (PSCA), an autonomous government body within the Punjab Police that aims to improve public safety and security in the Punjab. To test if the behaviors of the state affect citizens’ perceptions and/or willingness to engage with the state, we randomly provide the opportunity for citizens to engage more with the state by providing information about- and access to- state services.
Our basic treatment design for the study randomizes individuals into one of six types of treatments (and a control group). The treatments deploy two distinct services: the 1787 Police Complaint Hotline and the Singh Legal Aid Call Centre (SLACC). For each service, we have two intensities of treatments: a regular and an assistive treatment. Both treatments give the respondents an opportunity to connect with the service. The assistive treatment, on the other hand, includes an additional follow-up survey after 2 to 3 days to get an update on their dispute. The assistive treatment also offers the respondent another opportunity to connect with the service. In addition to that, we also have an information treatment, that simply informs the respondent about the efficiency, case resolution rates and turnaround times of the 1787 police complaint hotline.
Specific details below:
1. Control group:
For this group, only the surveys (baseline, midline, and endline) are administered. No other feedback or advice is provided to respondents.
2. Information treatment:
The exact wording is as follows:
”Sir/Madam, I understand the trouble you’re going through. However, I would like to inform you of the tremendous progress the Punjab Police has made over the previous year to make their services citizen friendly and reassure you that your case is in the best hands possible.
The Punjab Police has launched the 1787 IG Punjab helpline, which is a free service where you can notify police authorities in the IG office through a call, text, or email that an FIR or police-related complaint is not being registered or an investigating police officer is not doing their job properly. Previously complaints at the IG Office had to be lodged either by post or by citizens visiting the IG office physically, which was costly and time consuming.
As a result of the introduction of the 1787 helpline, there has been a remarkable improvement in the timely resolution of complaints. In 2021, 1787 processed over 100,000 complaints and 85% were resolved by the IG office in a timely manner. The average time taken for resolution was only 5 days. The introduction of IGP’s 1787 helpline has more than doubled the monthly resolution rate of complaints in just 4 years”
3. Treatment 1 – 1787 Police Complaint Hotline [Regular variation]:
Citizens can call this hotline for the following complaints: 1) Police do not register a First Information Report (FIR); 2) The investigating officer (IO) is not doing his job properly; 3) Unlawful arrests/false FIRs; and 4) Bribery/corruption in the Punjab police. Complaints can be lodged by post, call, SMS, or email. The system is highly interactive, and the complainant is kept informed of the status of their complaint until its resolution. The complainant can view the progress of his/her complaint online and send feedback at any moment, online or through SMS. The 1787 service is run by the state police, and simply expands the role of the state service.
This treatment arm is delivered in regular intensity, meaning that no modifications are done regarding how the service would normally be delivered by the 1787 hotline.
4. Treatment 2 - 1787 Police Complaint Hotline [Assistive variation]:
This treatment arm also involves referring the respondent to the 1787 hotline service to file a complaint. However, for people assigned to this treatment arm, the surveyor actively assists the respondent during the complaint filing process. This assistive variation is delivered by modifying the surveyor-respondent-1787 officer interaction in four ways:
a. The surveyor briefly introduces the respondent to the 1787 officer, instead of the respondent doing so himself/herself
b. The surveyor is allowed to interject during the call to provide any clarification or answer any question if needed. This is particularly important for respondents whose language use level does not allow them to communicate clearly. For example, those who are illiterate don’t speak a common language with the operator fluently or can get confused about police jargon. This is where the surveyor can assist in clarifying.
c. The surveyor stays on the line even after the respondent-1787 officer interaction has finished, to have a short debrief with the respondent and make sure they know what steps need to be taken or to clarify outstanding questions
d. Approximately 2 to 3 days later, the respondent receives a very brief 5-minute call to follow-up on the status of their case. No outcome questions are asked at this point, since this is meant to be a quick check-in call.
The assistive variation is meant to represent a more citizen-centric version of the 1787 hotline to test if such an approach would yield significantly better results relative to the regular variation of the service, the information treatment, and the control group.
5. Treatment 3 – Legal Aid Services [Regular variation]:
The respondents are provided legal aid services through the SLACC local lawyers on their complaints. The Legal Advisory Call Center is an initiative run by the Legal Aid Society, which provides pro bono/low bono legal services, and has been operational for the past 4 years. The purpose of this call center is to spread awareness of legal rights and remedies, as well as guidelines for different procedural matters, and its agents are practicing lawyers with real-time experience in courts of law. Callers’ information is kept highly confidential, and they receive a free solution within 24 hours and can leave recordings after hours. To date, the call center has responded to over 12,000 queries from 180 cities and towns across Pakistan. Run by a non-profit but with the intent of making it easier for the citizen to navigate the state apparatus, SLACC is an interesting service to examine since a citizen may build a positive view of the state simply by having a better experience as they work through the state processes, even if the state has not directly changed anything. Specifically, the legal advice provided can help with the process of navigating the existing state structure and bureaucracy, increasing perceptions about accessibility, for example.
This treatment arm is delivered in regular intensity, meaning that no modifications are done regarding how the service would normally be delivered by the SLACC call center.
6. Treatment 4 – Legal Aid Services [Assistive variation]:
This treatment arm also involves referring the respondent to the SLACC call center to receive legal aid. However, for people assigned to this treatment arm, the surveyor actively assists the respondent during the call. This assistive variation is delivered by modifying the surveyor-respondent-SLACC lawyer interaction in four ways:
a. The surveyor briefly introduces the respondent to the SLACC lawyer, instead of the respondent doing so himself/herself
b. The surveyor is allowed to interject during the call to provide any clarification or answer any question if needed. This is particularly important for respondents whose language use level does not allow them to communicate clearly. For example, those who are illiterate don’t speak a common language with the operator fluently or can get confused about police jargon. This is where the surveyor can assist in clarifying.
c. The surveyor stays on the line even after the respondent-lawyer interaction has finished, to have a short debrief with the respondent and make sure they know what steps need to be taken or to clarify outstanding questions
d. Approximately 2 to 3 days later, the respondent receives a very brief 5-minute call to follow-up on the status of their case. No outcome questions are asked at this point since this is meant to be a quick check-in call.
The assistive variation is meant to represent a more citizen-centric version of the SLACC service to test if such an approach would yield significantly better results relative to the regular variation of the service, the information treatment, and the control group. Together, these two services and two variations allow us to examine whether improvements need to be carried out by the state, like redesigning services to be more citizen-centered, easier to navigate, or offer complementary services, if we find that these treatment arms help induce an even more favorable engagement with- and view of the state.