Back to History

Fields Changed

Registration

Field Before After
Trial Status in_development on_going
Trial End Date April 30, 2025 June 07, 2025
Last Published April 22, 2025 09:25 AM May 14, 2025 11:06 AM
Intervention Start Date April 14, 2025 May 15, 2025
Intervention End Date April 30, 2025 May 31, 2025
Primary Outcomes (End Points) The main dependent variable we will look at is decision accuracy in Stae 2 (i.e. whether the decision to approve/deny the loan was ex-post correct). The main dependent variable we will look at is decision accuracy in State 2 (i.e. whether the decision to approve/deny the loan was ex-post correct).
Experimental Design (Public) We recruit 200 loan underwriters/officers/processors, and other participants to make loan application decisions in two stages. Our randomisation happens int the second stage, where we personalise interventions to each underwriter for half of the underwriters, and compare it to our control intervention. We recruit 200-300 loan underwriters/officers/processors to make loan application decisions in two stages. Our randomisation happens int the second stage, where we personalise interventions to each underwriter for half of the underwriters, and compare it to our control benchmarks.
Planned Number of Clusters 200 loan officers/processors/underwriters. 200-300 loan officers/processors/underwriters.
Planned Number of Observations We will aim to recruit 200 loan officers/processors/underwriters, unless otherwise limited by our recruitment (i.e., 2 weeks go by without any new loan officers/processors/underwriters). We will filter out subjects in our analysis based on attention and time checks as specified by our PAP. We will aim to recruit 200-300 loan officers/processors/underwriters, unless otherwise limited by our recruitment. We will filter out subjects in our analysis based on attention and time checks, as well as Stage I performance as specified by our PAP.
Sample size (or number of clusters) by treatment arms 100 in each arm -- adaptive and non-adaptive. 100-150 in treatment, 50-75 in each control.
Intervention (Hidden) Two-stage experiment with loan officers. In stage 1, randomisation is within-individual into 5 treatments. We use this data to inform personalised thresholds for the second stage. In the second stage, we randomise loan officers into two groups: (i) personalised AI thresholds (calculated from Stage I experimental data.) vs. (ii) general binary threshold implied by theoretical model. This is our core randomisation. The randomisation is across-individual, 50% in control (general binary threshold), 50% in treatment (personalised thresholds). See PAP for more details. Two-stage experiment with loan officers. In stage 1, randomisation is within-individual into 5 treatments. We use this data to inform personalised thresholds for the second stage. In the second stage, we randomise loan officers into three groups: (i) personalised AI thresholds (calculated from Stage I experimental data.) vs. (ii) generalised universal binary threshold implied by theoretical model from experiment 1, (iii) top-performing policy on average in the population from Stage I. This is our core randomisation. The randomisation is across-individual, 50% in control (general binary threshold), 50% in treatment (personalised thresholds). See PAP for more details.
Pi as first author No Yes
Back to top