Primary Outcomes (explanation)
Measuring Take-up Quantity (used in Outcome 1)
I measure the quantity of take-up using scheme applications. I prioritize measuring applications over availed schemes because it better models an individual's decision. The 15 priority schemes I selected have historically not had many supply-side challenges, but their processing timelines differ widely (some schemes might issue immediately, while others might take months to process). Therefore, I measure take-up using applications as it captures the demand-side decision individuals make, and can be consistently measured across schemes at a fixed period of time.
Measuring Take-up Quality (used in Outcomes 2 and 3)
I measure take-up quality by constructing an index that proxies the net value of a scheme. I construct this index prior to the start of the intervention, then use a machine learning model to predict scheme quality for each individual who applies to schemes during the intervention period.
- Pre-intervention index construction: I collect survey data from individuals that interacted with Haqdarshak in Haryana in 2025. The phone survey asked beneficiaries about the 15 priority schemes they were eligible for. For each scheme an individual self-reported having availed, individuals were asked about the scheme's benefits (helpfulness, benefits relative to expectations, counterfactual reliance), application costs (documentation burden, office visits, monetary costs), demand (usage, probability of use), and monetary evaluation (willingness to accept giving up a scheme). Citizens who had not availed certain schemes they were eligible for were asked parallel questions about reasons for non-application and their perceptions of each scheme's benefits, application costs, and demand. I combine this survey data with administrative application data and scheme-level attributes to construct a menu of potential quality indices.
I select the final index through a treatment-blind procedure prior to the start of the evaluation. I review each candidate index and run two main checks. First, I check each index's variation. The final index should show meaningful variation across schemes and individuals. If an index does not vary much across either dimension, it will not be able to be ranked. Second, I check each index's consistency with other benchmarks. In the phone survey, I ask individuals about their most helpful scheme and overall welfare. Indexes should be consistent with a held-out revealed preference benchmark. Overall, using pre-intervention survey variation, I choose an index that measures scheme-quality for each individual that has high variance and is consistent. Since I select this index prior to the intervention, it is not influenced by the RCT's results. I standardize the final quality index prior to the RCT.
- Pre-intervention predictive modeling: I train a supervised machine learning model to predict the quality index for each individual-scheme based on that individual's baseline demographic characteristics. I freeze this model prior to the RCT.
- Intervention: For each individual a frontline worker interacts with during the RCT, I predict scheme quality for each scheme an individual is eligible for using the machine learning model that was trained on pre-intervention data. Overall, my metric for scheme quality was designed using a data-driven approach pre-intervention.