Experimental Design
To evaluate the economic opportunities component of SNSOP, we will collaborate with the implementing partner to randomly assign offers to participate in the economic opportunities component, which we will refer to as Treatment. All eligible households will already be participating in the direct support or public works component of SNSOP. The economic opportunities program specifically targets youth aged 18 to 35, who are literate and live in households with three or more dependents, including minors, elderly individuals, disabled persons, or those with chronic illnesses. This impact evaluation will concentrate on the first phase of the economic opportunities program, set to take place in three Payams within South Sudan’s capital, Juba County: Kator, Juba Town, and Munuki. The program aims to treat a total of 3,000 households in these Payams. As per the program’s design, there is an additional requirement of achieving a 1:1 female-to-male ratio, resulting in the selection of 1,500 women and 1,500 men for treatment in Juba.
During registration process for the direct support and public works component, program officers will collect households’ willingness to participate in the program and their priority preferences over the members of the household that are eligible, and they would like to nominate for participation. They will be reminded that nomination does not imply selection and that given program 1:1 ratio there are instances where program will only be offered to men or women. Households will then be individually randomized, with rates of study participation and treatment assignment dependent on household preferences. The sample will be divided into four groups based on the identity of the household members nominated for participation: households with only female or only male were nominated (F or M), and households with multiple nominated members of mixed genders in which households’ preferred participant is a woman (PF) or a man (PM). Household assignment to Treatment vs. Control will be stratified by these four subgroups. To maintain the 1:1 female-to-male overall ratio, treatment ratios will have to vary by subgroups, and household top preferences may not always be followed. Among PM households, treatment households will be randomized to either ‘household preference’ (=male participant) or ‘women targeting’ (=female participant), with a higher proportion of households assigned to treatment in group PM.
While the study participation rates in the four groups will be proportional to the population rates that we will learn once the registration process has been completed, group PM will be oversampled to increase statistical power for the subgroup analysis. However, this oversampling is subject to implementation constraints, and rates may vary across subgroups based on household’s stated preferences and on government partner guidance. While a portion of the PM group may not have their top-ranked household member selected, all program participants will be chosen from the list of members actually nominated by each household. Participants will also be informed during the registration process that their top preference might not be selected, as nomination does not imply selection. This approach should help to alleviate most concerns about potential backlash arising from the program's design.
The evaluation is designed to test the overall effect of household assignment to the treatment condition relative to control as implemented. In addition, the design allows a test of program effects under two different targeting regimes. The first is a traditional women-only targeting under which households can nominate a woman to participate and households without eligible women (group M in our case) are excluded. The second is a household-preference regime under which households can nominate a man to participate and households with only eligible men are included. For the former, we compare treatment and control households among groups F, PF and PM with women targeting; for the latter, we compare treatment and control households among groups F, M, PF and PM with household preference targeting.