Experimental Design Details
Inclusion/exclusion for sampling for the study
This study will be done over M Turk.
We currently make the following inclusion criteria
Participant HIT approval rate of over 95%
Over 1000 HITs approved
As of right now, there are no other exclusion criteria.
Study Overview:
Participants will respond to an MTurk survey, which will have three stages:
Stage One:
Participants will be given two minutes to come up with as many alternative uses for an object as possible (called an alternative uses task or AUT). They will be asked to generate alternative uses under three different perspectives :
Perspective Treatment 1
Please list all the creative alternative uses you can think of for an item (the item will be presented on the next page).
List as many creative uses as possible within the time limit
Responses must be in a general format, describing how the item could be used. See the proper response format below.
Proper Response Format: A brick could be used____________.
Example: A brick could be used as a paperweight.
Perspective Treatment 2
Please list all the creative alternative uses you can think of for an item (the item will be presented on the next page)
List as many creative uses as possible within the time limit
Responses must be in third person, describing how others could use the item. See the proper response format below.
Proper Response Format: A _____ could use a brick _____.
Example: A desk worker could use a brick as a paperweight.
Perspective Treatment 3
Please list creative alternative uses for an item (the item will be presented on the next page)
List as many creative uses as possible within the time limit
Responses must be in first person, describing how you personally could use the item. See the proper response format below.
Proper Response Format: I could use a brick _____.
Example: I could use a brick as a paperweight
During this initial AUT, half of the participants will also receive a financial incentive:
Financial Incentive
Important: During this task, if you score within the top half of participants for creative performance, then you will receive an additional 5 dollars bonus pay. Creative performance is measured as the total number of ideas you generate that two raters rate above a six (on a scale from 1 to 10 ) for creativity. Therefore, generating a larger number of creative ideas will result in greater creative performance.
Stage Two:
Stage two is the incubation phase. The incubation phase will take 12 minutes and will consist of three tasks: simple math problems, reading excerpts from open-source books, and using a mouse to move a slider along number lines to appointed numbers.
Stage Three:
Stage three will be a second round of AUTs. First we will give the same AUT as in Stage One, followed by a new AUT. The AUT that is the same as in Stage One is the important AUT, the new AUT is there to test whether any changes between conditions are specific to the previous task, or generalizable to new AUTs as well. There will be no manipulations in these AUTs, participants can respond in any format they wish and there is not additional incentive.
Post-study data exclusion criteria
Participants will have had to have given at least one answer to all the AUTs to be included. Otherwise, their scores cannot be calculated. How does one calculate the average creativity of a score when the scoring does not exist? Numbers of who did not complete an answer for all AUTs will be reported.
Participants will have to have signed the consent form to be included.
Participant answers to the AUTs will need to be in the proper format requested (each perspective condition asks for responses to be in a specific sentence format). Those that are not in the proper format will be excluded.
One researcher (or potentially individuals recruited for casual work) will look at the answers to the AUTs and discern whether the participant thought of the item as was intended (for example, thinking of a golf club as the metal stick, rather than as a social club where people go to play golf). Those who answered according to the wrong concept of the item will be removed from analysis. This number will also be reported.
Participants got the majority of the answers wrong in the incubation task, or did not answer the majority of the question in the incubation task, will be removed on the grounds that they were not participating correctly. We will include focus checks and proper survey completion checks as well. These may be used to exclude at least portions of the participants responses. However, if their response to the AUTs are in the proper format we will keep their answers for at least the AUTs. Answering in the proper format indicated that they were actually paying attention.
We may also include understanding checks to make sure the financial incentive was noticed and the study was performed as intended. Violating this may be cause for the removal of data points.
All exclusions will be reported along with justification.