|
Field
Primary Outcomes (Explanation)
|
Before
Performance in each task is a measure of the quality of ideas. The effort is measured by time, correctness, and the number of attempts to answer, depending on the task.
|
After
Performance on each task measures the quality of ideas. The effort is measured by time, correctness, and the number of attempts to answer, depending on the task. For the writing task, we will recruit independent human raters to evaluate participants’ written messages across different dimensions (details in the docs); the overall effectiveness rating will be used to determine the writing task score.
We will use LLMs to analyse the written messages and compare the results to those from human raters. We will also do exploratory analysis with LLMs on the written messages.
|