Behavioral Interventions to decrease dangerous driving in Armenia

Last registered on September 04, 2023

Pre-Trial

Trial Information

General Information

Title
Behavioral Interventions to decrease dangerous driving in Armenia
RCT ID
AEARCTR-0011972
Initial registration date
September 03, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
September 04, 2023, 7:00 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

Region

Primary Investigator

Affiliation
American University of Armenia

Other Primary Investigator(s)

Additional Trial Information

Status
On going
Start date
2023-08-23
End date
2023-10-15
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
With a population of around 3 million, Armenia has a high road fatality rate of 9.4 deaths per 100,000 people. In 2019, road crash fatalities were more than double the European Union (EU) average, and the socioeconomic costs of road crashes are estimated at 5.7 percent of Armenia’s GDP.
Within a wider context of road safety improvement projects in Armenia, the purpose of the current trial is to test whether messages using different behavioral framings cause any significant change in the driving behavior of the subjects concerned.

The specific research questions are:
- Is the communication with the drivers using the existing channels effective to deter risky driving behavior (in particular, speeding)?
- Do the drivers respond differently to messages which are designed to target different biases and themes?
- Does the information on relative position of the driver in terms of driving license points lost create incentives to change risky driving behavior?

The trail is aiming to run a behavioral randomized controlled trial that would address the research questions stated just above. It will utilize the existing infrastructure used by road police to communicate with the drivers about their performance.
The overall aim of the trial is to reduce the number of traffic rules violations with a specific emphasize on speed regime violations.

In this trial we will be implementing 2 different RCTs which utilize different communication means and intend to reach out to the drivers with the purpose of changing their risky driving behavior.

The first experiment will utilize the existing modes of communication used by road police to communicate with the drivers about their performance (mainly official letters). The second experiment will use additional SMS to be sent to the drivers.
External Link(s)

Registration Citation

Citation
Baghdasaryan, Vardan. 2023. "Behavioral Interventions to decrease dangerous driving in Armenia." AEA RCT Registry. September 04. https://doi.org/10.1257/rct.11972-1.0
Sponsors & Partners

Sponsors

Partner

Type
government
Experimental Details

Interventions

Intervention(s)
There are two types of interventions envisaged.
First one utilizes the system of notifying the drivers about traffic speeding rules violations by providing additional information to them (both paper based and electronic). There are 5 active treatment arms which differ by the messages and behavorial biases they are targeted at. In addition, the subjects are separated into 3 different blocks depending on previous history of speeding violations.
Second intervention is a stand alone SMS based communication with the registered drivers which provides an update about the traffic violation points preserved/lost at this point of time in the year. The messages are meant to trigger social comparisons and within subject comparisons of performance over time. There are 4 active treatment arms envisaged.
The Final goal is to induce change in driving behavior which will be statistically measurable. .
Intervention Start Date
2023-08-23
Intervention End Date
2023-10-15

Primary Outcomes

Primary Outcomes (end points)
For first intervention: Number of speed violations registered by speed cameras
For second intervention: Number of violation points preserved/lost
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
For first intervention: The days between two adjacent violations during the observation period
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
There are two types of interventions envisaged.
First one utilizes the system of notifying the drivers about traffic speeding rules violations by providing additional information to them (both paper based and electronic). There are 5 active treatment arms which differ by the messages and behavorial biases they are targeted at. In addition, the subjects are separated into 3 different blocks depending on previous history of speeding violations. In particular all drivers who have violations in 2021-2022, as well as first half of the 2023 are divided into three groups - with low number of violations (3-4 per year), medium (5-7 per year) and high (more than 7). The experiment is randomized for 5 active treatment arms for each of these blocks separately.


The second intervention is a stand alone SMS based communication with the registered drivers which provides an update about the traffic violation points preserved/lost at this point of time in the year. With this option we intend to use the point system introduced by the Road Police back in 2020, which provides the information about the driver’s performance via an electronic platform. Under this approach there is no need to wait for specific event to happen to be able to communicate with the experimental subjects. The communication can be chosen to happen at any time, using the contact details (mobile phone numbers) which are available in the system. The population of the drivers registered in the system as of the moment of the experiment (e.g. July 2023) will be block randomized into three active treatment arms and one control arm (which will receive no communication at all). The sample of the experiment participants and the allocation to treatment arms will be conducted in advance. The intervention will be delivered by the Road Policy using SMS and phone numbers identified in the database. Technical duration of intervention is very short (hours), but it would be preferable to monitor the delivery of the messages and conduct it over 2-3 days.
Experimental Design Details
There are two types of interventions envisaged.
First one utilizes the system of notifying the drivers about traffic speeding rules violations by providing additional information to them (both paper based and electronic). There are 5 active treatment arms which differ by the messages and behavorial biases they are targeted at. In addition, the subjects are separated into 3 different blocks depending on previous history of speeding violations. In particular all drivers who have violations in 2021-2022, as well as first half of the 2023 are divided into three groups - with low number of violations (3-4 per year), medium (5-7 per year) and high (more than 7). The experiment is randomized for 5 active treatment arms for each of these blocks separately.
There are 5 types of messages envisaged for this intervention: 1. Informing about high number of casualties (appealing to social preferences), 2. Highlighting the aggragate of fines paid over the last few years (appealing to loss aversion), 3. Highlighting the savings on insurance due to better driving (appealing to possible gains), 4. Appeal to emotions by direct message from accident family member (appeal to empathy with the help of hand written mail from a daughter of deceases traffic accident participant). 5. Kitchen sink type intervention which joins messages from 1 to 4 into one letter.

The second intervention is a stand alone SMS based communication with the registered drivers which provides an update about the traffic violation points preserved/lost at this point of time in the year. With this option we intend to use the point system introduced by the Road Police back in 2020, which provides the information about the driver’s performance via an electronic platform. Under this approach there is no need to wait for specific event to happen to be able to communicate with the experimental subjects. The communication can be chosen to happen at any time, using the contact details (mobile phone numbers) which are available in the system. The population of the drivers registered in the system as of the moment of the experiment (e.g. July 2023) will be block randomized into three active treatment arms and one control arm (which will receive no communication at all). The sample of the experiment participants and the allocation to treatment arms will be conducted in advance. The intervention will be delivered by the Road Policy using SMS and phone numbers identified in the database. Technical duration of intervention is very short (hours), but it would be preferable to monitor the delivery of the messages and conduct it over 2-3 days.
There are three type of short messages envisaged for this intervention. 1. Information about the relative standing of the driver compared to other drivers (appeal to social preferences), 2. Information about the dynamics of behavior with respect to her/his own performance during the preceding period (appeal to self control). These two options have negative or positive frames depending on the drivers actual position. 3. A neutral sms to all drivers which highlights possible savings on insurance if driving performance is improved (similar to intervention 1 treatment 3).
Randomization Method
Randomization is implemented using randtreat routine in Stata.
Randomization Unit
Individual driver
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
There are 3 blocks for each of the two interventions.
Sample size: planned number of observations
For each of the two experiments it is planned to send out around 10,000 notifications. Each of the experiments combined with control group will be composed of around 12,000 observations. This number might be not final due to specifics of the fieldwork.
Sample size (or number of clusters) by treatment arms
Sample size is different depending on the blocks given that the power requirements can be different due to variations in means and standard deviations.
Intervention 1.
Block 1 - 450 per treatment - 2250 active + 450 control
Block 2 - 550 per treatment - 2750 active + 550 control
Block 3 - 700 per treatment - 3500 active + 750 control
Note: Sample sizes are large due to the assumption of low delivery rate of the letters (1 out of 3 sent) and the differences in number of observations per treatment are due to larger standard deviation in Block 2 and Block 3.

Intervention 2.
Block 1 - 900 per treatment - 2700 active + 900 control
Block 2 - 750 per treatment - 2250 active + 750 control
Block 3 - 750 per treatment - 2250 active + 750 control
Note: WE do not have reliable information to what extent the mobile numbers in the system are accurate. The sample size is relatively large due to assumption that 1 out of 2 numbers is correct and the message will be delivered.

Relatively low cost of intervention (sending additional page with the intervention 1 adds almost zero marginal cost and the price of one SMS in Armenia is low as well) provides the opportunity to have conservative estimations of sample sizes.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
The power of the test is set at 80, and significance level is 5%. The MDES for all treatments is set at 5% level. These are the statistics for each of the interventions and blocks. Intervention 1. Speeding experiment (Letters and elecronic notifications) Block 1. average number of violations (normalized per month) - 0.27, st. dev - 0.03 Block 2. average number of violations (normalized per month) - 0.43, st. dev - 0.07 Block 3. average number of violations (normalized per month) - 0.89, st. dev - 0.32 Intervention 2. Violations points experiment (SMS) Block 1. average number of points preserved at the time of experiment (out of total 9) - 2.9, st. dev - 1 Block 2. average number of points preserved at the time of experiment (out of total 9) - 5.7, st. dev - 0.7 Block 3. average number of points preserved at the time of experiment (out of total 9) - 7.9, st. dev - 0.6
IRB

Institutional Review Boards (IRBs)

IRB Name
IRB Approval Date
IRB Approval Number

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
No
Data Collection Complete
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials