|
Field
Last Published
|
Before
August 02, 2026 06:35 AM
|
After
August 02, 2026 06:45 AM
|
|
Field
Planned Number of Clusters
|
Before
There are 11 within-subject treatment comparisons. For 7 of them, we will enlist 120 subjects each, for the remaining four we will enlist 60 subjects each.
|
After
In the Reverse Causality Problem, there are 5 groups of subjects for within-subject comparisons that enlist about 120 subjects each. In addition, there are 2 groups of about 120 subjects each for across-subjects comparisons.
In the Confounded Choice Problem, there are 3 groups of subjects for within-subject comparisons that enlist about 120 subjects each. In addition, there are 2 groups of about 120 subjects each for across-subjects comparisons.
|
|
Field
Planned Number of Observations
|
Before
1080 individuals
We include a subject in the data analysis only if all of the following conditions are met:
1. the subject's prolific authenticity checks has “high” for both fields, LLM and bots. Subjects with missing fields are excluded, too.
2. the subject does _not_ give a correct answer to the question "How many elements does the largest sporadic simple group have?”
3. the subject has a reCaptcha score of at least 0.7 (based on https://web.archive.org/web/20260316085956/https://researcher-help.prolific.com/en/articles/445222-understanding-the-limitations-of-recaptcha-bot-detection-in-research)
4. the subject does not miss the “Monday” attention check (which terminates the survey)
5. the subject passes the technical check in which a sequence of numbers is displayed in video format
The target sample size refers to subjects who satisfy all of the above conditions
|
After
1440 individuals
We include a subject in the data analysis only if all of the following conditions are met:
1. the subject's prolific authenticity checks has “high” for both fields, LLM and bots. Subjects with missing fields are excluded, too.
2. the subject does _not_ give a correct answer to the question "How many elements does the largest sporadic simple group have?”
3. the subject has a reCaptcha score of at least 0.7 (based on https://web.archive.org/web/20260316085956/https://researcher-help.prolific.com/en/articles/445222-understanding-the-limitations-of-recaptcha-bot-detection-in-research)
4. the subject does not miss the “Monday” attention check (which terminates the survey)
5. the subject passes the technical check in which a sequence of numbers is displayed in video format
The target sample size refers to subjects who satisfy all of the above conditions
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
1080 individuals
|
After
1440 individuals
|