Experimental Design
This section describes the experimental design of the CBT. The target group for this experiment is community leaders drawn from 181 communities. Thus, the key actors and targets of our interventions are the six community leaders recruited from each village. As described earlier, the CBT experiment brings together six community leaders who assume various roles and responsibilities within each village. To mimic actual targeting practices in Ethiopia, we define the six committee members to include: (i) a Kebele leader or member of the kebele leadership, (ii) an elder man/woman, (iii) a religious leader, (iv) a women’s representative, (v) a teacher or development agent or extension worker, and (vi) a youth representative. These members reflects the typical composition of local targeting committees in social protection programs in Ethiopia, including the PSNP. The same community leaders also participated in a similar targeting experiment conducted two years ago (Abay et al., 2024).
The CBT intervention follows community-level clustered randomization, in which the 181 communities are randomly assigned into one of the three treatment arms. The random assignment is stratified by region and by previous treatment status, as many of the community leaders had participated in a prior CBT experiment (Abay et al., 2024). The treatment assignment varies along two dimensions: (i) whether the community receives an actual transfer or a hypothetical transfer (control group), and (ii) whether the community members (potential beneficiary households) participate or not in the targeting process. The treatment arms generated by these combinations are outlined below.
(1) Control: Hypothetical targeting and ranking for distributing a 20,000 Birr transfer (C): Community leaders in this group are instructed to assume a hypothetical budget of 20,000 Birr, which needs to be distributed to those deemed “needy”. Before allocating transfers, community leaders are first asked to rank 20 sample households from the most to the least needy, based on their perceived need for social assistance. They are then asked to allocate this notional budget among the 20 households included in our sample according to their ranking. During this exercise, leaders are required to strictly adhere to pre-defined criteria provided by the research team. These criteria are carefully selected to mirror the targeting criteria used in actual social assistance programs in Ethiopia, such as the PSNP (Gilligan et al., 2009; Berhane et al., 2024). Community leaders are instructed to prioritize households that: (i) had difficulty satisfying their food needs; (ii) own no or little asset (e.g., livestock, land); (iii) have limited income-generating activities or capacity; (iv) have lost productive assets due to shocks (e.g., conflict, drought); and (v) have lost family members recently. These targeting criteria closely follow those used by the national safety net program in Ethiopia, the PSNP (e.g., Gilligan et al., 2009; Hoddinott et al., 2012; Abay et al., 2022).
(2) Incentivized targeting involving actual cash transfer (T1): Another group of communities is randomly assigned to a treatment arm that receives real transfer funds with a total budget of 20,000 Birr (about 140 USD). In this treatment arm, community leaders are required to rank households based on the same five pre-determined targeting criteria in the control group and allocate real cash transfers to those deemed “needy".
(3) Incentivized and participatory targeting involving community members (T2): This group of communities follows similar rules as those in T1, but the targeting process incorporates public engagement by involving potential beneficiary households. Community members (potential beneficiary households) will actively participate in in reviewing and approving the proposed beneficiary list. All decision made by the committee will be publicly disclosed and reviewed by at least two-third of the potential beneficiary households (community members) for final approval and implementation. This includes disclosing the following information to the community members (potential beneficiary households): (i) Total budget allocated, 20,000 Ethiopian Birr, (ii) Amount (and share) of transfer/budget they withhold for administrative costs by community leaders; (iii) A list of potential beneficiaries identified by community leaders, as well as the amount allocated to each beneficiary, and (iv) justification of community leaders’ decision to community members.
Community leaders are asked to rank households from the most needy (1st) to the least needy (last) and propose how funds should be allocated to those households they deem needy, but final allocation requires support by at least half of the community members (households). Most importantly, community members will vote on whether to include or exclude each proposed beneficiary. If a simple majority supports or rejects a decision, the community members' vote overrides the committee’s proposal. This treatment arm allows us to examine whether public disclosure and participation of potential beneficiaries improve targeting accuracy and reduce elite capture.