Experimental Design
The following experimental design and sampling procedure relate to a training experiment on uptake of organic farming. In the course of the endline survey for this experiment, we will include the first survey experiment.
The second survey experiment is included in the endline survey of a different study which assesses the benefits of soil tests. Other than the survey experiment, the data and results of this soil test project will not be used for this registered study, but will be used for a different study. Please refer to the pre-analysis plan registered under https://doi.org/10.1257/rct.11448-1.0 for details on this project.
Sampling design
We applied a three-stage random sampling design to select 1,200 respondents. In the first stage, we randomly selected 60 villages, 30 villages in Yogyakarta and 30 villages in Tasikmalaya. In the second stage, we randomly drew farmer group(s) in selected villages. Farmer groups in Indonesia function both as social group but also as task groups for government programmes and the allocation of subsidies.
Training experiment
The treatment was randomised at the village level and consisted of training on organic farming methods and principles. Farmers from groups in control villages did not receive any training. As baseline data was not available at the time of the randomisation, we used publicly available regional data for the stratification. Specifically, we stratified the sample according to urban and rural status and the reported size of agricultural land area per village. In Tasikmalaya, we used ‘travel distance to the district capital’ as an additional stratification criterion as this region is characterised by less developed infrastructure.
In 2018 and 2022, we invited the 20 interviewed farmers in each treatment village to participate in a three-day (2018) / two-day (2022) training on organic farming, with farmers receiving seven hours of training per day. Based on the insights from the theoretical framework, our training intervention addressed experience, beliefs and risks. It offered extensive information about the costs and benefits of organic farming practices and hands-on training to maximize the learning effect and minimize the risk of usage. Raising awareness, changing perceptions and implementation at the community level are intended to address social risks. The training provided farmers with an introduction to organic farming and included information on potential marketing channels. Particular emphasis was placed on practical activities such as making organic fertilisers and pesticides.
During the training in 2022, trainers provided partly a refresher training of the first training. They further augmented the training by a discussion of soil management in organic farming and by training on soil tests. Based on the soil tests that each farmer could conduct for his or her own soil, trainers provided fertilizer recommendations according to organic principles.
Survey experiment
The survey experiment will be included in two surveys. The first survey is the endline survey for the above-mentioned training experiment. The second survey is the endline survey of a different experimental agricultural study conducted with small-scale rice farmers in Yogyakarta focusing on soil tests. As outlined above, we make use of the endline survey of this study to include a second survey experiment.
In the first survey, we randomize the order of the questions about the topic of greenness of rice fields. Respondents in group (1) (survey 1) will first be asked about the degree to which greenness levels of rice fields influences their decision to try a new practice that is good for soil health but could reduce plants’ greenness. Afterwards they will be asked about perceived gossip about greenness levels in their village.
Respondents in group (2) (survey 1) will first be asked about perceived gossip in their village and only afterwards about the degree to which greenness influences their decision to try a new practice that is good for soil health but could reduce plants’ greenness.
In the second survey, we similarly randomize the order of questions about the topic of greenness of rice fields but add a second question to the randomization order (this question is also included in the first survey but asked in the same order to all respondents).
Respondents in group (1) (survey 2), will first be asked about the degree to which greenness influences their decision to try a new practice that is good for soil health but could reduce plants’ greenness. Afterwards they will be asked about perceived gossip in their village and are asked to compare the greenness level of their own rice fields with the greenness level of rice fields of other farmers in their village.
Respondents in group (2) (survey 2), will first be asked about perceived gossip in their village and are asked to compare the greenness level of their own rice fields with the greenness level of rice fields of other farmers in their village. Afterwards they will be asked about the degree to which greenness influences their decision to try a new practice that is good for soil health but could reduce plants’ greenness.
These two survey experiments will allow us to investigate (1) whether making to topic of possible gossip about greenness levels more salient influences own stated willingness to experiment with a new practice that could impact greenness levels and (2) whether the degree to which this is made salient makes a significant difference (i.e., one or two questions in the randomized order).
Both survey experiments are randomized at the individual level and are stratified by village and 2021 organic fertilizer use (survey 1) and 2022 organic fertilizer use (survey 2).