Back to History

Fields Changed

Registration

Field Before After
Trial End Date September 30, 2021 December 31, 2025
Last Published May 26, 2021 10:28 AM May 22, 2025 02:14 AM
Intervention End Date September 30, 2021 May 31, 2025
Experimental Design (Public) In an online lab experiment, participants are asked to design two drafts of a recruitment poster for the lab. Before they complete the second draft, they receive a review of their first draft from one of the other participants. Participants are allocated to different "feedback groups": in one group, pairs of participants review each other (sequentially); in another group, participants are matched anonymously. Subjects' payments are based on the peer feedback for the first draft (within a tournament) and on researchers' grading for the second draft. We study how feedback groups affect performance in the second poster and contribution in a public good game subjects play at the end of the session, as well as feedback content. In an online lab experiment, participants are asked to design two drafts of a recruitment poster for the lab. Before they complete the second draft, they receive a review of their first draft from one of the other participants. Participants are allocated to different "feedback groups": in one group, pairs of participants review each other (sequentially); in another group, participants are matched anonymously. Subjects' payments are based on the peer feedback for the first draft (within a tournament) and on researchers' grading for the second draft. We study how feedback groups affect performance in the second poster and contribution in a public good game subjects play at the end of the session, as well as feedback content. We also conduct a Prediction Survey on Prolifics with approximately 200 HR professionals (May 2025). In this survey, we ask which of the two feedback groups (reciprocal vs. non-reciprocal) improved their final posters more, by which percentage, and why.
Planned Number of Clusters Approximately, 10 sessions with 32 participants each (16 A-players and 16 B-players). A-B pairs are randomly allocated to the two feedback treatment groups. 20 experimental sessions, for a total of 742 participants (split into A-players and B-players). A-B pairs are randomly allocated to the two feedback treatment groups.
Planned Number of Observations Our analysis focuses on B-players (i.e. those who receive feedback in step 2) for the second draft performance and number of comments received. We expect 16 observations per session, or a total of 160 observations. We also analyze contributions to the PGG for all participants (an expected total of 320 observations). Our analysis focuses on B-players (i.e., those who receive feedback in step 2) for the second draft performance and the number of comments received. Our sample includes a total of 367 B-players. We also analyze contributions to the PGG for all participants (an expected total of 320 observations).
Secondary Outcomes (End Points) - Number of comments received in the feedback to the first draft of the poster - Quality of comments (exploratory measures: survey items with subjective assessment of comments quality; correlation of number of comments received with objective score in first draft of the poster) - Number of comments received in the feedback to the first draft of the poster - Quality of comments (exploratory measures: survey items with subjective assessment of comments quality; correlation of number of comments received with objective score in first draft of the poster) - Answers to a prediction survey on Prolifics, where we ask HR professionals which of the two feedback groups (reciprocal vs. non-reciprocal) improved their final posters more, by which percentage, and why.
Building on Existing Work No
Back to top