Back to History Current Version

Evaluating the Impact of a Digital Agriculture Advisory Program in India

Last registered on November 21, 2021

Pre-Trial

Trial Information

General Information

Title
Impact of a Digital Agriculture Advisory Program in Odisha
RCT ID
AEARCTR-0008560
Initial registration date
November 18, 2021

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
November 21, 2021, 5:07 PM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
Precision Development

Other Primary Investigator(s)

PI Affiliation
Harvard Business School
PI Affiliation
University of Maryland
PI Affiliation
Precision Development

Additional Trial Information

Status
On going
Start date
2021-02-01
End date
2023-09-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
With the rapid increase in access to mobile phones, there is an increasing effort among governments and policymakers to provide timely and customized agricultural information via mobile phones. However, rigorous evidence on how and for whom such interventions work is still limited. This study aims to understand whether and how agricultural extension delivered via mobile phones increases the agricultural productivity and profitability of smallholder farmers. The research is motivated by the large and persistent yield gap that exists among poor farmers in developing countries. We plan to examine this question using a large-scale randomized controlled trial over a two-year period in Odisha, India. Moreover, this study will test low-cost approaches to measuring yields. Specifically, it will assess the feasibility of using satellite images to estimate farmers’ rice yields in Odisha. This work will help address a common empirical challenge of evaluating digital extension and other agricultural interventions.
External Link(s)

Registration Citation

Citation
Cole, Shawn et al. 2021. "Impact of a Digital Agriculture Advisory Program in Odisha ." AEA RCT Registry. November 21. https://doi.org/10.1257/rct.8560-1.0
Experimental Details

Interventions

Intervention(s)
Treatment farmers receive access to a toll-free agricultural helpline through which farmers receive interactive voice response (IVR) calls that provide relevant agricultural information based on the agricultural cycle, crop, and weather content, at an approximately weekly schedule. During the Kharif season, treatment farmers receive IVR calls that share agricultural advisories on paddy; during the Rabi season, treatment farmers receive IVR calls with advisories on two crops that farmers have selected.

Moreover, farmers can also use this service to listen to and respond to agricultural questions posed by other farmers, and record their own questions to local agronomists. The use of this service is completely voluntary, and it does not involve any monetary contribution by the farmers.
Intervention Start Date
2021-06-09
Intervention End Date
2022-12-31

Primary Outcomes

Primary Outcomes (end points)
Vegetation index, self-reported yield, revenue, and profit, knowledge and adoption indices
Primary Outcomes (explanation)
We will use remote sensing satellite data to create multiple vegetation indices, which will then be used to examine the impact of treatment on “greenness”. In addition, we will collect self-reported yield, revenue, and profit, and agricultural knowledge and adoption behavior through in-person and phone surveys. Summary indices for agricultural knowledge and adoption will be constructed using individual questions and weighting matrix.

Secondary Outcomes

Secondary Outcomes (end points)
Agricultural investment, agricultural diversification, non-agricultural self-employment income generating activities in the household.
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
We use a randomized controlled trial (RCT) to investigate the impact of a digital agricultural advisory service on smallholder farmers’ yield. We plan to recruit eligible households cultivating rice across 1,300 villages in 19 blocks using a random-walk method and randomly select half of the households to receive a free digital advisory service.

We selected 19 blocks in five districts in the state for inclusion in the study. All the included blocks had low (<18.5 percent) “penetration” of the information service, as measured by the estimated share of farmers that were enrolled prior to the study, and were covered by the same satellite path. Within these 19 blocks, we selected all villages that met the following criteria during the 2011 Census of India: (i) classified as “rural”; (ii) had more than 50 households; (iii) located in a panchayat with service “penetration” below 10 percent. A total of 1,313 or 39 percent of the villages met these conditions and constituted our study sites. In each village, we plan to select 5 - 10 percent of households using a random-walk sampling method. Households will be eligible for inclusion in the study if they meet a set of criteria and are willing to allow the research team to collect the GPS coordinates of their primary rice plot.

The eligible households (one person per household) will be invited to participate in a baseline survey, including questions on demographics, farm characteristics, agricultural knowledge and practice, yield, and GPS coordinates of the primary rice plot.

We then randomize those farmers who have completed the baseline survey into control and treatment groups. Randomization is conducted at the individual farmer level, and stratified by panchayat and an indicator for participants’ self-reported productivity at baseline being above median.

Farmers in the treatment group start to receive free digital advisory service in the coming agriculture season. Moreover, those farmers are administered a phone-based compensation and service enrollment survey, which collects necessary information to send farmer compensation for their baseline survey participation and explains the digital advisory service to farmers.

The study began implementation of the random walk sampling method in March 2021, but suspended all field operations on 23rd April following a steep rise in COVID-19 cases in the state. 5,204 households were enrolled in the study before the fieldwork suspension (“initial” sample, or cohort 1), of which half were randomized to the treatment group and invited to enroll in the information service via phone. 2,571 (99.5%) members of the treatment group (2,602 farmers) opted-in to the service and began receiving advisory messages from 9th June. As the COVID-19 situation alleviated in the study location, we resumed our field activities in October, 2021. We use the same random-walk method in the same locations as previously and plan to sample a further 8,000 - 10,000 households.

At the end of 2021-22 and 2022-23 Kharif seasons, we will conduct a midline survey and an endline survey with the initial sample of farmers, allowing us to measure their knowledge, practice, yield and profit.
Experimental Design Details
Randomization Method
We conduct randomization using the Stata program on a computer in an office.
Randomization Unit
Individual farmer level.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
N/A
Sample size: planned number of observations
Approximate 15,000 rice farmers.
Sample size (or number of clusters) by treatment arms
Control group: 7,500 farmers.
Treatment group: 7,500 farmers.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
If this study achieves its planned number of observations (15,000), it will be able to detect a 3.2% or 0.04 standard deviation increase in self-reported rice yields and a 0.74% increase in vegetation index, with 80% power at 5% significance.
IRB

Institutional Review Boards (IRBs)

IRB Name
The Committee on the Use of Human Subjects (CUHS) - Harvard University Area Institutional Review Board
IRB Approval Date
2021-02-01
IRB Approval Number
IRB20-1776
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials