Back to History Current Version

Climate and Resilience Impact Evaluation Window: Experimental Evidence from Several Countries

Last registered on January 07, 2021

Pre-Trial

Trial Information

General Information

Title
Climate and Resilience Impact Evaluation Window: Experimental Evidence from Several Countries
RCT ID
AEARCTR-0006851
Initial registration date
December 09, 2020

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 10, 2020, 12:25 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
January 07, 2021, 3:27 PM EST

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region
Region
Region

Primary Investigator

Affiliation
World Bank

Other Primary Investigator(s)

PI Affiliation
World Bank, DIME
PI Affiliation
World Food Programme, OEV
PI Affiliation
World Food Programme, OEV
PI Affiliation
World Food Programme, OEV
PI Affiliation
American University
PI Affiliation
World Bank, DIME
PI Affiliation
World Bank, DIME
PI Affiliation
World Bank, DIME
PI Affiliation
World Bank, DIME
PI Affiliation
World Bank, DIME

Additional Trial Information

Status
On going
Start date
2020-11-30
End date
2025-12-01
Secondary IDs
Abstract
The concept of resilience has gained attention because it recognises the importance of addressing shorter-term humanitarian needs while simultaneously supporting communities to face future crises induced by climate change, conflict, and other factors. Many institutions, including the World Food Programme (WFP), have increasingly used the concept as a basis for their programming. WFP's integrated packages of interventions aim to improve food security and nutrition by smoothing food consumption in the short-term, while supporting livelihoods and addressing barriers to development (e.g., better climate information, access to markets, education, WASH, etc.) in the long-term. While all programme activities are potentially important for building resilience, livelihood activities are clearly connected to both immediate and future wellbeing. These activities include cash or in-kind transfers to the household and support for creating assets that could benefit the household or the community in the future. Therefore, livelihood activities have the potential to support households in improving and maintaining their wellbeing when facing future shocks and stressors.

This pre-analysis plan describes policy experiments to estimate the impacts of experimentally varying WFP's activities on resilience as measured by community and household wellbeing. This approach follows others in conceptualizing resilience through changes in wellbeing (Knippenberg et al, 2019, Phadera et al. 2019, Jones and Tanner, 2017; Barrett et al, 2020). We design and run these experiments in the context of livelihoods programs implemented by the World Food Programme (WFP) across 6 countries. Beyond testing the overall impact of livelihood activities on wellbeing, a key ambition of this paper is to investigate whether activities themselves can be timed to accommodate households’ vulnerability to seasonal fluctuations and shocks that are often connected to weather patterns and agricultural cycle. We identify two such mechanisms: adjusting the timing of cash transfers and labor requirements; and/or allowing for re-targeting participants over time to account for changes in vulnerability status.
External Link(s)

Registration Citation

Citation
Adjognon, Guigonan Serge et al. 2021. "Climate and Resilience Impact Evaluation Window: Experimental Evidence from Several Countries." AEA RCT Registry. January 07. https://doi.org/10.1257/rct.6851-1.1
Sponsors & Partners

Sponsors

Partner

Experimental Details

Interventions

Intervention(s)
We implement a multi-country study of WFP's resilience program. These programs typically englobe a wide set of multi-sector activities, such as livelihood support, and nutrition, health as well as education components.
Intervention (Hidden)
Intervention Start Date
2021-01-01
Intervention End Date
2025-12-01

Primary Outcomes

Primary Outcomes (end points)
Consumption and Food Security; Time-use; Assets; Income Generating Activities; Shocks and Coping Mechanisms; Financial Outcomes; Migration; Psycho-social Well Being; Women's Empowerment; Social Capital, Safety-nets; Reservation Wages.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We design an RCT that measures the impact of the WFP resilience program on welfare dynamics. To this end, villages are randomly allocated to two treatment arms and a control group. In the first treatment arm (UCT), WFP provides unconditional cash transfers to households. In the second treatment arm (CCT), WFP provides their cash-for asset program to selected beneficiaries. We compare CCT to control to isolate the benefits of a livelihood program on welfare dynamics. We compare the UCT to the CCT to understand whether the positive returns from the asset outweigh the costs that come from having to invest additional labor. In doing so we are able to isolate the benefit of assets on their own.

Beyond testing the overall impact of resilience and livelihood activities on wellbeing, a key ambition of this paper is to investigate whether activities themselves can be timed to accommodate households’ vulnerability to seasonal fluctuations and shocks that are often connected to weather patterns and agricultural cycle. We identify two such mechanisms: adjusting the timing of cash transfers and labor requirements; and/or allowing for re-targeting participants over time to account for changes in vulnerability status.
Experimental Design Details
The resilience and livelihood activities in this study align with similar programs that provide cash payments tied to the condition of undertaking some form of (CALP, 2020). While the nature of the work differs substantially across programs, it typically involves an activity that is designed to generate positive returns for the household, or the community they live in. WFP introduced a livelihood program called Food Assistance for Assets (FFA) in the 1990s to meet the short-term food needs of vulnerable populations (through cash transfers), while promoting long-term resilience through the production of assets (WFP, 2019).

We design an RCT that measures the impact of the WFP livelihood program on welfare dynamics. To this end, villages are randomly allocated to two treatment arms and a control group. In the first treatment arm (UCT), WFP provides unconditional cash transfers to households. In the second treatment arm (CCT), WFP provides their cash-for asset program to selected beneficiaries. We compare CCT to control to isolate the benefits of a livelihood program on welfare dynamics. We compare the UCT to the CCT to understand whether the positive returns from the asset outweigh the costs that come from having to invest additional labor. In doing so we are able to isolate the benefit of assets on their own. This complements existing research on graduation programs, which were designed to understand the effect of assets when combined with other forms of assistance (namely cash and training) (Banerjee et al., 2015).

We hypothesize that the welfare gains associated with these programs could increase if the timing of their own activities were adjusted to accommodate seasonality and shocks. These fluctuations are especially relevant in agricultural economies where households' marginal utility of consumption and opportunity cost of labor are positively correlated. During the pre-harvest season, households have less disposable income and less time to devote to nonfarm activities. In the post-harvest season, households have additional income from selling their crops and fewer demands on their time. It follows that cash transfers should be provided in the pre-harvest season when the marginal utility of consumption is high, and work requirements should be reserved for the post-harvest season when the returns to alternative labor allocations are low. To test this hypothesis, we further subdivide CCT villages into two groups. In the first group, villages receive the Coupled WFP cash for asset program- households are invited to work on the asset while they receive cash payments. In the second group, villages receive a De-coupled WFP cash for asset program, whereby the cash transfers are provided when the marginal utility of consumption is highest (the pre-harvest season), but work requirements are limited to when the marginal cost of labor is low (the post-harvest season). Comparing the de-coupled CCT to the coupled CCT isolates the welfare gains associated with providing cash and labor at times when the MPC is high and the MPL are low, respectively. Importantly, this tests the value of changing the timing of programs to account for seasonal variation in labor calendars and consumption patterns.

While the timing of program implementation is one dimension on which programs account for dynamic adjustments, a second dimension can involve updating targeting and beneficiary selection to reflect changes over time in the welfare rankings of households. To study the implications of these decisions, we further cross-randomize CCT villages into two groups. In both groups, we ask villages to draw up a list of beneficiaries, where the 5 last households will be kept in `reserve'. After the harvest season (when shocks may have shifted new households into poverty), we ask communities to identify 5 additional `postharvest' beneficiaries to include in the program. In non-retargeted villages, the 5 `reserve' households will be enrolled right away in the pre-harvest season. In re-targeted villages, the `post-harvest' beneficiaries will receive the program instead. We apply a difference-in-difference specification to determine the relative treatment effect of the CCT for postharvest beneficiaries relative to the `reserve' households in re-targeted vs. non-retargeted villages. We also we investigate the extent to which communities select beneficiaries based on unobservable characteristics across treatment arms. Finally, we can apply the ML techniques developed by Chernozhukov et al. (2018) to predict who benefits from each program based on observable characteristics, and determine the quality of targeting under each treatment arm, comparing whether the beneficiaries selected under each program match those we predict would derive the highest returns.
Randomization Method
Both private randomizations done in office by a computer and public lotteries
Randomization Unit
Village level randomization, with possible clustered approach in some areas (groups of villages)
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
Approximately 200 villages per country (1,200 villages total)
Sample size: planned number of observations
Approximately 20 to 30 households per village (18,000 to 24,000 households)
Sample size (or number of clusters) by treatment arms
We plan to implement all treatment arms where ever possible, with the following estimate sample size per treatment arm:

-UCT: 50 villages per country (300 villages total)
-CCT coupled: 25 villages per country (150 villages total)
-CCT decoupled: 25 villages per country (150 villages total)
-Control: 100 villages per country (600 villages total)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Solutions IRB
IRB Approval Date
2020-11-12
IRB Approval Number
Protocol #2020/09/12
Analysis Plan

Analysis Plan Documents

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials