Measuring Non Cognitive Skills using portable EEG devices

Last registered on September 04, 2018

Pre-Trial

Trial Information

General Information

Title
Measuring Non Cognitive Skills using portable EEG devices
RCT ID
AEARCTR-0000916
Initial registration date
October 20, 2015

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
October 20, 2015, 5:01 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
September 04, 2018, 12:07 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Region

Primary Investigator

Affiliation
Massachusetts Institute of Technology

Other Primary Investigator(s)

Additional Trial Information

Status
Completed
Start date
2015-03-16
End date
2015-11-13
Secondary IDs
Abstract
This project aims to implement a methodology that uses recordings from brain activity to improve the accuracy
with which commonly used in personality and creativity questionnaires to measure traits and abilities. Participants in the
study will be asked to perform a few different tasks that require the use of cognitive, social and emotional skills. Before and while
they are performing the tasks, researchers will record (electrophysiological) activity in their brain using a standard methodology called Electroencephalography, or EEG.

We are performing an RCT in eight vocational schools in Chile, where four among them received a program designed to foster life skills at the beginning of the academic year in March 2015.
External Link(s)

Registration Citation

Citation
Egana del Sol, Pablo. 2018. "Measuring Non Cognitive Skills using portable EEG devices." AEA RCT Registry. September 04. https://doi.org/10.1257/rct.916-2.0
Former Citation
Egana del Sol, Pablo. 2018. "Measuring Non Cognitive Skills using portable EEG devices." AEA RCT Registry. September 04. https://www.socialscienceregistry.org/trials/916/history/33856
Experimental Details

Interventions

Intervention(s)
This project study the Chilean program ``Mining’s Rockstars’’ - ``Rockstars para la Mineria’’, that aims to foster life skills, in particular self confidence and creativity, following principles that could be summarized as: ``learning by failing, gaming, doing and rethinking’’\footnote{For details see the Appendix.}. The intervention evaluated here was a randomized control trial that targeted young students that were in technical –vocational- high school for one academic semester (around four months). The randomization was done by the NGO together with the researcher of this study. We randomized at school level, since administrative restrictions.

Intervention Start Date
2015-03-16
Intervention End Date
2015-11-13

Primary Outcomes

Primary Outcomes (end points)

I explore the effects of student’s participation on cognitive, life skills and creativity by using commonly-use psychometric tests. In particular, it was measured the Big Five Inventory Test, Locus Control Test, Grit Test, and Torrance’s Creative.
I also took a raven test as a placebo test, since shouldn't be affected by the treatment.

I measured a proxy for emotional state, in the valence dimension, and emotional responsiveness to positive and negative stimulus.


Primary Outcomes (explanation)
The constructed outcomes will be the emotional state and emotional responsiveness.
In addition, I am planning to construct emotionally-corrected scores of the aforementioned psychometric test (Grit, Locus Control, etc.). The idea is to correct the scores by the emotional state at baseline.

In particular, I use low-cost portable electroencephalogram (EEG) headsets to estimate subject’s emotional state following methodologies from emotion detection theory (See for example Takahashi, 2004; Ramirez and Vamvakousis, 2012; Verma and Tiwary, 2014). In fact, emotions will be modeled using the arousal-valence model developed by Lang (1995), in which arousal is related to activation and deactivation and valence is related to gratification and displeasure. I'll have particular focus on valence dimension, since it is theoretically unambiguously related with perception, having a positive relation with many psychometric test scores.


Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
This study consists of eight randomly selected schools. The randomization considered only "technical" schools, i.e. vocational schools, as well as schools that belong to the 4th Region of Coquimbo in Chile, since they were eligible to receive the program.
The study will measure the program's impacts through experiment and surveys of students in a random sample of four schools from the eight randomly selected schools participating in the study. The randomization was done by both the NGO that run the program an the main researcher of this project.
Experimental Design Details
The data analysis will follow the methodology developed by Ramirez and Vamvakousis (2012) to measure emotions from EEG signals. Evidence has shown that the prefrontal cortex coordinates consciousness and regulates emotions (Bear et al. 2007). In fact, to measure emotions it would be consider the EEG signal using electrodes AF3, AF4, F3, and F4 in the 10-20 standard classification, which are located on the prefrontal lobe (For the exact location of each electrode in the brain, see Figure 10 20 SYSTEM in the appendix.). By applying a Fourier transformation, it is possible to separate the EEG signal into different frequencies, from 1 to 80Hz. The frequencies of interest in measuring emotions are both alpha (8-12Hz) and beta (12-30Hz) waves (Bos, 2011). Alpha waves are predominant in relaxed states and brain inactivation, while beta frequencies are associated with alertness and excited state of mind. Consequently, the beta-alpha ratio is an effective indicator of the level of arousal. On the other hand, previous neurophysiological evidence had shown that emotional valence has different representation in right and left brain's cortical hemisphere (see Ramirez and Vamvakousis, 2012). Right frontal inactivation is correlated with positive emotion, while left frontal inactivation is related with negative emotion. Since inactivation could be measured as the inverse of arousal level, it is possible to estimate valence level by subtracting the inverse of arousal on the left hemisphere with the the same index in the right hemisphere.
Randomization Method
Randomization done in office by a computer.
Randomization Unit
The unit of randomization was the school.
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
8 schools.

Sample size: planned number of observations
200 students for each round.
Sample size (or number of clusters) by treatment arms
4 schools control, 4 schools treatment.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Grit Test, Big Five Personality Inventory, Study parameters: Study parameters: alpha = 0.0500 power = 0.8000 N = 300 N per group = 150 m1 = 3.2000 sd = 0.6000 Estimated effect size and experimental-group mean: delta = 0.1947 m2 = 3.3947 i.e., the minimum detectable effect size is 1/3 standard deviations. Locus Control Test (which uses a different scale) will have: Study parameters: alpha = 0.0500 power = 0.8000 N = 300 N per group = 150 m1 = 65.0000 sd = 11.0000 Estimated effect size and experimental-group mean: delta = 3.5700 m2 = 68.5700 i.e., the minimum detectable effect size is 1/3 standard deviations.
IRB

Institutional Review Boards (IRBs)

IRB Name
Columbia University IRB
IRB Approval Date
2015-04-10
IRB Approval Number
AAAP2363(Y1M00)

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
September 01, 2015, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
September 01, 2015, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
8 Schools
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
296 subjects
Final Sample Size (or Number of Clusters) by Treatment Arms
4 schools control, 4 schools treatment.
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials