Experimental Design
Experimental design
The intervention is carried out in 181 villages (enumeration areas) across several regions in Ethiopia, including Tigray, Afar, Amhara, Oromia, Sidama, South Ethiopia, Southwest Ethiopia, Central Ethiopia, Somali regions, as well as the Dire Dawa city administration. As described above, the experiment is implemented by six community leaders per village, each leader holding different customary or administrative roles in the community. This composition mimics targeting practices in Ethiopia, including those practices used in the PSNP. The intervention occurs at two levels: (i) community leaders and (ii) community members (households). In this study, we focus on the impact of alternative community-based targeting interventions on household-level outcomes. The same community leaders also participated in a similar targeting experiment conducted two years ago (Abay et al., 2024).
The intervention follows a community-level cluster randomization, where 181 villages (enumeration areas) are randomly assigned into a control group and two treatment arms. We stratified the random assignment of villages by region and previous participation in cash transfer programs. As shown in Figure 1 below, we randomly assigned about 34% of the villages (61 EAs) to the control group, while the remaining 36% (66 EAs) and 30% (54 EAs) were randomly assigned to an incentivized (non-participatory) and an incentivized and participatory targeting, respectively.
(1) Control: Hypothetical targeting and ranking for distributing a 20,000 Birr transfer (C):
Community leaders in this group are asked to rank 20 randomly selected households in each village based on their need for social assistance and allocate a hypothetical transfer of ETB 20,000 to those deemed “eligible”. We provided them five criteria to prioritize and rank households by asking them to prioritize households who (i) had difficulty satisfying their food needs; (ii) own no or little asset (e.g., livestock, land); (iii) have limited income-generating activities or capacity; (iv) have lost productive assets due to shocks (e.g., conflict, drought); and (v) have lost family members recently. Before ranking and community leaders first discuss these set of five pre-defined targeting criteria and report whether the criteria are exhaustive. If they wish, community leaders were given the option to retain up to a maximum of 10 percent of the budget for covering “administrative” costs. This is beyond the token of appreciation of 350 Ethiopian Birr (about 2.5 USD) for their participation. Before distributing the hypothetical transfer, each community leader was individually state how much of the budget (up to 10%) they would hypothetically allocate to cover their “administrative costs”. Community leaders then jointly agree on the amount of money to be retained. Then community leaders jointly rank all households from most to least needy and make a hypothetical allocation that does not exceed ETB 20,000.
(2) Incentivized targeting involving actual cash transfer (T1):
Community leaders in this group follow the same procedures as in the control group, except the leaders receive an actual budget of ETB 20,000. Community leaders collectively decide the share to be allocated to cover administrative costs, and then rank households using the same pre-defined criteria, and distribute real cash transfers to those community members deemed “eligible” accordingly. Community leaders record the amount allocated to each household and list the most important criterion used for the three top-ranked beneficiaries. Comparing Groups 1 and 2 allows us to examine the impact of real cash transfers on community leaders’ targeting decisions as well as ultimate impacts on trust and social cohesion among households.
(3) Incentivized and participatory targeting involving community members (T2):
Community leaders in this group also receive an actual budget of ETB 20,000 and rank and allocate the cash transfer to potential beneficiaries using the same selection criteria as in Group 2, including the decisions on the amount of administrative costs they keep for themselves. However, community leaders were asked to explicitly involve potential beneficiary households in the targeting processes. After community leaders propose the ranking and allocation of the cash transfer, a public deliberation session is held with at least two-thirds of the sample households. During this session, community leaders must publicly disclose the total budget allocated to the village (ETB 20,000), the amount of budget kept for themselves to cover their administrative cost, their proposed beneficiary ranking and allocations, and their justification for the selection of beneficiary households. Community members are then informed that they can anonymously vote to accept or override leaders’ inclusion and exclusion decisions. Beneficiary households must receive at least 50% support from participating households to be considered as eligible to receive the transfer. If not, these households may be replaced by community members-nominated households that secure at least 50% of the votes. If more nominees pass the threshold than positions available, those with the highest vote shares are selected. Community members cannot add new beneficiaries without replacing others, and including the administrative costs, total allocations remain within ETB 20,000. Importantly, households selected by community leaders who do not participate in the public deliberation or voting session are still eligible to receive the transfer; non-attendance does not exclude them from receiving the cash transfer. The final beneficiary list and allocations are also recorded after voting.
Overall, this experimental design allows us to identify (i) the impact of cash transfers by comparing hypothetical vs real cash transfers, and (ii) the impact of public disclosure and participatory targeting by comparing leaders-only targeting versus targeting where community members can overturn decisions.