The Demand for Expert Advice and Karmic Luck: An Experimental Investigation

Last registered on July 17, 2024

Pre-Trial

Trial Information

General Information

Title
The Demand for Expert Advice and Karmic Luck: An Experimental Investigation
RCT ID
AEARCTR-0013559
Initial registration date
July 17, 2024

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
July 17, 2024, 2:21 PM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
Nanyang Technological University

Other Primary Investigator(s)

PI Affiliation
Nanyang Technological University
PI Affiliation
Nanyang Technological University

Additional Trial Information

Status
In development
Start date
2024-08-05
End date
2026-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
We aim to test standard rational theories and illusion of control theory in a 2×2 experiment.
External Link(s)

Registration Citation

Citation
Powdthavee, Nattavudh, Yohanes Eko Riyanto and Xiaojie Zhang. 2024. "The Demand for Expert Advice and Karmic Luck: An Experimental Investigation." AEA RCT Registry. July 17. https://doi.org/10.1257/rct.13559-1.0
Experimental Details

Interventions

Intervention(s)
Details will be revealed upon the completion of the study.
Intervention Start Date
2024-08-05
Intervention End Date
2026-12-31

Primary Outcomes

Primary Outcomes (end points)
Our key outcome of interest will be the behavior of investors accessing envelopes or not across the 5 rounds in the 4 treatment conditions. This is measured as a dummy variable: P_ij, which equals to 1 if the subject i accesses the envelope before betting in round j, and 0 otherwise.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The 2×2 experimental design consists of four stages.
Stage 1: prediction of fair coin flips
Stage 2: Probability Test
Stage 3: Behavioral Determinants Test
Stage 4: Post-experiment Questionnaire
Experimental Design Details
Not available
Randomization Method
Randomization done by a computer.
Randomization Unit
individual randomization for treatments.
Was the treatment clustered?
No

Experiment Characteristics

Sample size: planned number of clusters
1 University.
Sample size: planned number of observations
816 participants.
Sample size (or number of clusters) by treatment arms
Each treatment will consist of 204 participants.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
We ascertain our sample size through a meticulous estimation with a hypothesized main effect and employ this derived sample size to determine the minimum effect size that can be detected for the hypothesized absence of an interaction effect. We ascertain our sample size through a meticulous estimation with a hypothesized main effect (H1) and employ this derived sample size to determine the minimum effect size that can be detected. We derive the primary effect size from the study conducted by Powdthavee and Riyanto (2015), which is of direct relevance to this study. Their research, which focused on a coin prediction game featuring options for participants to pay for predictions without any access to information about the prediction generation process. In their study, the effect size became significantly larger and larger after observing a longer streak of correct predictions. For instance, the effect size of a streak of two accurate predictions on the purchasing behavior is 0.153, corresponding to an Odds ratio of 8.85 at round 3. The effect size of having longer streaks is higher (i.e., the effect sizes associated with streaks of three and four accurate predictions on purchasing behavior are 0.211 and 0.273, respectively). For the purpose of our analysis, and since the treatment effect is already relatively strong with a streak of two accurate predictions, we will focus our experiments on it. R^2 other X=0.25X parm π=0.25, a one-tailed z-test, and the test procedure with variance correction proposed by Hsieh et al. (1998), we conducted sample size estimation using G*Power 3.1. The analysis yields a total sample size of n = 204, providing an actual power = 0.800218. In other words, a sample size of n = 204 will provide a statistical power of more than 80% for our fundamental hypothesis (H1). Since the proposed experiment will involve a two-dimensional treatment (With/Without Financial Intervention × Paying for Advice/Donate for Luck Setting), the total necessary sample size is 204×4=816. In summary, our approach to sample size determination combines meticulous estimation based on the hypothesized main effect with rigorous sensitivity analysis. This enables us to ascertain a sample size that fulfills the demands of our research objectives and study design.
Supporting Documents and Materials

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
IRB

Institutional Review Boards (IRBs)

IRB Name
Research Integrity and Ethics Office, Nanyang Technological University
IRB Approval Date
2024-04-01
IRB Approval Number
2023-1091