Measuring Norms and Enumerator Effects: Survey Method Matters

Last registered on October 03, 2024
View Trial History

Pre-Trial

Trial Information

General Information

Title
Measuring Norms and Enumerator Effects: Survey Method Matters
RCT ID
AEARCTR-0011696
Initial registration date
June 29, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 10, 2023, 8:50 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
October 03, 2024, 9:50 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Country
Benin
Region
South

Primary Investigator

Name
Pablo Álvarez-Aragón
Affiliation
Université de Namur
Contact Primary Investigator

Other Primary Investigator(s)

PI Name
Hugues Champeux
PI Affiliation
University of Cagliari
Contact Investigator

Additional Trial Information

Status
Completed
Start date
2020-05-01
End date
2022-08-31
Keywords
Agriculture, Gender, Other
Additional Keywords
Methodology
JEL code(s)
C81, C83, C93, J16, O10, O12
Secondary IDs
Prior work
This trial is based on or builds upon one or more prior RCTs.
Abstract
While the process of data collection can lead to bias, little empirical evidence investigates the role of the survey method. In this paper, we compare two survey methods: the standard face-to-face interview and an alternative method we call Human-Assisted Self-Administered survey (HASA). In the latter, respondents are guided by an enumerator reading questions, but they answer privately on an electronic device. Taking advantage of an RCT in Benin, we randomize the survey method across respondents. We show that the survey method leads to different results depending on enumerator influence. Identifying this influence, we document that variables that are likely to be influenced by enumerators differ systematically across survey methods. Interestingly, these variables are mainly related to gender norms and women agency. We find that respondents who answer directly on a tablet report less gender-equal values. Investigating the mechanisms, we show that social desirability bias affects responses in face-to-face interviews.
External Link(s)

Registration Citation

Citation
Champeux, Hugues and Pablo Álvarez-Aragón. 2024. "Measuring Norms and Enumerator Effects: Survey Method Matters." AEA RCT Registry. October 03. https://doi.org/10.1257/rct.11696-1.2
Sponsors & Partners
Experimental Details

Interventions

Intervention(s)
We take advantage of an RCT in Benin in which respondents are randomly assigned to receive a business training. Participants are grouped together to receive the training. In this context, we administer a survey at the beginning of the session and compare the results with those obtained in face-to-face interviews.
Intervention (Hidden)
We take advantage of an RCT in Benin in which respondents are randomly assigned (individual-level randomization) to receive a business training. Participants are grouped together to receive the training. In this context, we administer a survey at the beginning of the session and compare the results with those obtained in face-to-face interview. Respondents in groups answer questions posed by a common enumerator directly on a tablet provided to them (privately).
Intervention Start Date
2021-12-13
Intervention End Date
2022-08-31

Primary Outcomes

Primary Outcomes (end points)
Comparison of attrition rates, socioeconomic characteristics (i.e., number of children, father/mother alive), women empowerment (including decision making and goal setting), intra-household allocation of chores and expenses, gender norms
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Women invited to the training program are randomly selected from a sample of pineapple producing households who applied for a subsidy to start or expand a pineapple production (these households typically include a man producing pineapple and in half of the cases a woman producing as well). A control group is selected among the initial pool of applicants.
Data collection occured in two waves: baseline in 2020 and endline in 2022.
Experimental Design Details
the 673 women invited to the training program are randomly selected from a sample of pineapple producing households who applied for a subsidy to start or expand a pineapple production (these households typically include a man producing pineapple and in half of the cases a woman producing as well). A control group of 336 women is selected among the initial pool of applicants.
Data collection occured in two waves: baseline in 2020 and endline in 2022.
Randomization Method
Randomization done in office by a computer
Randomization Unit
Individual
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1009 women
Sample size: planned number of observations
1009 women
Sample size (or number of clusters) by treatment arms
673 women in treatment group and 336 in control
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Supporting Documents and Materials
IRB

Institutional Review Boards (IRBs)

IRB Name
University of Namur – social sciences ethical committee
IRB Approval Date
2020-03-06
IRB Approval Number
2020/02
Analysis Plan

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials