|
Field
Last Published
|
Before
July 16, 2024 02:31 PM
|
After
July 18, 2024 12:20 PM
|
|
Field
Experimental Design (Public)
|
Before
Recruiting 405 professional translators on online freelancer websites (eg. Freelancer.com, fiverr.com) across three languages (Spanish, Arabic, and Hindi). Each translator will first complete a baseline task of language ability. Then they will complete five short follow-up tasks. In each follow-up task half will receive no AI assistance (control), and the other half will be randomly assigned one of thirteen different generative AI models. They will also all complete some short questions (eg. on their experience as a professional translator, familiarity with AI tools, etc.)
|
After
Recruiting 336 professional translators on online freelancer websites (eg. Freelancer.com, fiverr.com) across three languages (Spanish, Arabic, and Hindi). Each translator will first complete a baseline task of language ability. Then they will complete five short follow-up tasks. In each follow-up task individuals will equally be split into one of fourteen groups. One with no AI assistance (control), and the others will be randomly assigned one of thirteen different generative AI models. They will also all complete some short questions (eg. on their experience as a professional translator, familiarity with AI tools, etc.)
|
|
Field
Planned Number of Clusters
|
Before
390 (130 individuals for each of the three languages)
|
After
336 (112 individuals for each of the three languages)
|
|
Field
Planned Number of Observations
|
Before
390 individuals
|
After
336 individuals
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
75 tasks completed * 13 arms = 975 tasks
975 control tasks
Total= 1950 tasks/ 5 tasks per individual= 390 individuals
|
After
120 tasks completed * 14 arms = 1680 tasks
Total= 1680 tasks/ 5 tasks per individual= 336 individuals
|
|
Field
Did you obtain IRB approval for this study?
|
Before
No
|
After
Yes
|