Experimental Design Details
In a decision task, a subject needs to choose between a bet on the color of an unknown box (Option A) and a bet with an objective winning probability (Option B) for each line of the choice list. Specifically, in each task, there is a collection of (red and blue) boxes, and one color is assigned to Option A. The computer randomly selects one box (unobserved by subjects) from this collection of boxes. A subject choosing Option A wins a bonus if the selected box has the color assigned to Option A. A subject choosing Option B wins a bonus with a given chance. In a choice list, the winning probability of Option B in each line increases from 0% to 100% in steps of one percent. A subject needs to specify at which line she would like to switch from Option A to Option B in each choice list by reporting her probability assessment of the color of the selected box. In a basic task, a subject does not observe any signal and we elicit his/her unconditional matching probability; in a main task, a subject observes a "hint" before making his/her decision, as explained below.
In each main task, a box contains a number of "hint balls", and a subject observes one ball randomly drawn from the selected box before making a decision. There are two possible compositions of balls in a box. In the first composition, which corresponds to true news, there are more red balls in a red box and more blue balls in a blue box. In the second composition, which corresponds to fake news, the number of red (and blue) balls is fixed and not related to the color of the box. Depending on the treatment, subjects may or may not know how likely is each composition. We adopt the strategic method to elicit a subject's conditional matching probability on both possible signals.
We employ a between-subject design with two treatments: Fully Ambiguous treatment and Partially Ambiguous treatment. In each treatment, a subject faces decision tasks under both the ambiguous scenario (i.e., the pervasiveness of fake news is unknown) and under the non-ambiguous scenario (i.e., the pervasiveness of fake news is known). Within each scenario, we vary the proportion of red balls to blue balls in each composition across decision tasks.
Under the ambiguous scenario in the Fully Ambiguous treatment, a subject has no information about how likely is each composition. Under the ambiguous scenario in the Partial Ambiguous treatment, a subject is informed that the first composition (i.e., true news) is more likely to be the composition of balls in a box. Under the non-ambiguous scenario in the Fully Ambiguous treatment, a subject is informed that both compositions have equal chance. Under the non-ambiguous scenario in the Partial Ambiguous treatment, a subject is informed that there is a 25 out of 100 chance that the second composition (i.e., fake news) is the composition of balls in a box.