Economic Rationality under Cognitive Limitations: The Effect of Sequential Elimination

Participants are randomly assigned to one of three treatments, each distinguished by the choice procedure used in the first part of the experiment.

Participants are randomly assigned to one of three treatments: Sequential Elimination, the Direct Procedure, or the Minimum-Time Procedure. All treatment conditions employ closely comparable interfaces and instructions to isolate procedural differences. For each decision problem, participants select an option from a vertical list of options on the screen's left side. Each treatment begins with a practice trial. Example screenshots of the treatments are included in the Supplementary Materials.

In Sequential Elimination, participants make their choice by sequentially eliminating the options they do not prefer until only one option remains. To eliminate an option, they click on it, which moves it to a "Trash" box on the right side of the screen. Until submitting their choice, participants can reinstate any eliminated option by clicking on it in the Trash box.

In the Direct Procedure, participants make their choice after sequentially examining all options. To mark an option as examined, they click on it, which moves it to a "Choice List" on the right side of the screen. After all options are in the Choice List, participants select their preferred option by clicking on it in the Choice List. In the instructions, this condition is referred to as “Sequential Examination” to control for potential naming effects.

In the Minimum-Time Procedure, participants make their choice directly from the initial list of options. They must spend at least 35 seconds on each decision problem before submitting their choice. This minimum duration is calibrated from pilot data to match the average time spent under Sequential Elimination. A timer on the right side of the screen displays the time elapsed since each problem appeared.

2025-10-26

2026-08-31

Choice consistency

Our principal measure of economic rationality is choice consistency, defined as a binary variable equal to 1 if a participant’s choices satisfy the Generalized Axiom of Revealed Preference (GARP), a necessary and sufficient condition for consistency with preference maximization (Afriat, 1967; Varian, 1982). Guided by our theoretical framework, we pre-register the following hypothesis:

Hypothesis 1: Sequential elimination improves choice consistency relative to the direct procedure among individuals with cognitive limitations.

We test this hypothesis among low-IQ participants (those scoring at or below the sample median), who serve as a proxy for individuals with cognitive limitations.

As pre-registered robustness checks, we employ alternative measures of economic rationality: the number of GARP violations, the Houtman–Maks Index (HMI; Houtman and Maks, 1985), and stricter variants of these measures that additionally impose first-order stochastic dominance (FSD). The number of GARP violations quantifies departures from rationality. The HMI is defined as the minimum number of choices that must be removed to achieve consistency, with removed choices typically interpreted as mistakes. The FSD-based variants impose a stricter normative benchmark for decision-making under risk. These measures offer complementary assessments of sequential elimination, varying in stringency and granularity. The Supplementary Materials report the minimum detectable effects for all measures, providing a complete account of design sensitivity.


References:
Afriat, Sidney N. 1967. “The Construction of Utility Functions from Expenditure Data.” International Economic Review 8 (1): 67–77.
Houtman, Martijn, and Julian Maks. 1985. “Determining All Maximal Data Subsets Consistent with Revealed Preference.” Kwantitatieve Methoden 19 (1): 89–104.
Varian, Hal R. 1982. “The Nonparametric Approach to Demand Analysis.” Econometrica 50 (4): 945–973.

Effects by attentional deficits; response time and deliberation time; elimination behavior.

For additional analyses of robustness and mechanisms, we examine whether Sequential Elimination affects choice consistency among participants with higher attentional deficits (those scoring at or above the sample median) and in the overall sample, relative to the Direct Procedure. We also contrast Sequential Elimination with the Minimum-Time Procedure to investigate whether the effect of the former persists when response times are comparable. Additionally, we measure deliberation time as the interval until the final click on any option, to evaluate whether imposing a simple time requirement influences deliberation and, in turn, choice consistency. Finally, we analyze elimination behavior under Sequential Elimination to explore systematic patterns that may account for its effect.

The experiment consists of three parts. In the first, participants make economic decisions under their assigned treatment. In the second, they complete a series of cognitive tasks. In the third, they complete a set of questionnaires assessing attitudes toward inconsistency, attentional traits, and demographic characteristics.

The experiment is conducted online via the Qualtrics platform, with participants recruited from the Prolific pool. The final sample includes individuals aged 18 or older who provide informed consent, pass comprehension checks, and complete all tasks. Comprehension checks are embedded within the experimental instructions and decision problems. Participants who fail any instruction check twice, or who fail the decision problem check, are excluded from the sample.

In the first part, participants face twenty-five risky decision problems under their assigned procedure, including twenty-four for assessing economic rationality and one for a comprehension check. Adapted from Kim et al. (2018), each problem presents eleven distinct options in random order, with each option representing a lottery yielding one of two monetary prizes with equal probability. The comprehension check problem contains eleven options—(0, 0), (11, 11), (22, 22), (33, 33), (44, 44), (55, 55), (66, 66), (77, 77), (88, 88), (99, 99), and (111, 111)—and selecting any option other than (111, 111) indicates a lack of comprehension.

In the second part, cognitive ability is measured using IQ scores obtained through the ICAR test (Condon and Revelle, 2014), selective attention using the Stroop task (Stroop, 1935), and working memory using the Sternberg task (Sternberg, 1966).

In the third part, participants rate how at ease they are with a choice inconsistency scenario on a scale from 0 (least at ease) to 10 (most at ease), where higher scores indicate a less negative attitude. The scenario illustrates the attraction effect, a well-documented form of choice inconsistency (Huber, Payne, and Puto, 1982). This part also includes questionnaires assessing attentional deficits, using the Adult Self-Report Scale (ASRS v1.1; Kessler et al., 2005). Finally, participants report demographic characteristics, including age, gender, and education level.

References:
Condon, David, and William Revelle. 2014. “The International Cognitive Ability Resource: Development and Initial Validation of a Public-Domain Measure.” Intelligence 43: 52–64.
Huber, Joel, John W. Payne, and Christopher Puto. 1982. “Adding Asymmetrically Dominated Alternatives: Violations of Regularity and the Similarity Hypothesis.” Journal of Consumer Research 9 (1): 90–98.
Kessler, Ronald C, Lenard Adler, Minnie Ames, Olga Demler, Steve Faraone, EVA Hiripi, Mary J Howes, Robert Jin, Kristina Secnik, Thomas Spencer, et al. 2005. “The World Health Organization Adult ADHD Self-Report Scale (ASRS): a short screening scale for use in the general population.” Psychological Medicine 35 (2): 245–256.
Kim, Hyuncheol Bryant, Syngjoo Choi, Booyuel Kim, and Cristian Pop-Eleches. 2018. “The Role of Education Interventions in Improving Economic Rationality.” Science 362 (6410): 83–86.
Sternberg, Saul. 1966. “High-Speed Scanning in Human Memory.” Science 153 (3736): 652–654.
Stroop, J. Ridley. 1935. “Studies of Interference in Serial Verbal Reactions.” Journal of Experimental Psychology 18 (6): 643–662.

Randomization is implemented via Qualtrics.

Individual

No

N/A

We target an effective sample of 600 participants. To allow for an anticipated 5% exclusion rate due to failed comprehension checks, we plan to recruit up to 630 participants.

200 participants per treatment (including 100 low-IQ participants per treatment).

Power is evaluated via simulation using pilot data. We target 80% power at a two-sided 5% significance level for the primary test on choice consistency, comparing Sequential Elimination with the Direct Procedure among low-IQ participants. We simulate 10,000 independent datasets per candidate effect size, with 100 low-IQ participants per treatment arm, preserving the empirical distribution of choice consistency observed in the Direct Procedure. Under this design, the minimum detectable effect of Sequential Elimination on choice consistency is a log-odds ratio of 0.782 (corresponding to an odds ratio of 2.186), implying an increase of 19.3 percentage points (from 0.412 to 0.605).