NEW UPDATE: Completed trials may now upload and register supplementary documents (e.g. null results reports, populated pre-analysis plans, or post-trial results reports) in the Post Trial section under Reports, Papers, & Other Materials.
A Scientific Approach To Entrepreneurial Decision Making
Initial registration date
September 15, 2017
September 16, 2017 8:34 PM EDT
ICRIOS, Bocconi University
Other Primary Investigator(s)
ICRIOS, Bocconi University
Additional Trial Information
In explaining the high rates of startup failures, the entrepreneurship literature has emphasized several factors, such as the size and characteristics of the founding team or the technology. This study focuses instead on the role of entrepreneurial decision-making, whose importance in affecting new venture performance has become increasingly important in entrepreneurship and strategic management research and practice. Our randomized controlled trial tests if, to what extent and under which conditions the adoption of a scientific approach to entrepreneurial decision making improves performance. By scientific approach to entrepreneurial decision making we mean that entrepreneurs should behave like scientists, accurately framing and identifying the problem they wish to address, articulating theories, defining clear hypotheses, conducting rigorous tests to prove or disprove these hypotheses, measuring the results of the tests, and making decisions based on these tools.
Building on a pilot study (RCT) conducted at Bocconi University involving 116 Italian founders of new startups we are conducting another RCT on 265 startups to identify the mechanisms that explain why a scientific approach to entrepreneurial decision making affects firm performance. We argue that entrepreneurial decision-making can benefit from the use of a scientific approach because entrepreneurs can recognize when their projects exhibit low or high returns, or when it is profitable to pivot to alternative ideas. In other words, entrepreneurs with thoroughly thought-through, validated “theories” of their business and hypotheses of what customers want that are soundly tested through experiments, are better able to mitigate their biases when they analyze market signals, reducing the likelihood of incurring in false positives and false negatives.
Startups will receive 8 sessions of training plus coaching at Bocconi University, Milan. These sessions will include lecturettes and coaching by qualified mentors/instructors each working with a subset of the startup sample. Treated and control startups will receive the same amount of training on entrepreneurial decision making (on topics like business model canvas, customers' interviews, minimum viable products/services, concierge/prototype, etc.). The treated startups will be taught how to make entrepreneurial decisions according to a scientific approach.
Intervention Start Date
Intervention End Date
Primary Outcomes (end points)
1. Revenue: our main dependent variable is the amount of revenues (in euros).
2. Dropout: this is a binary variable that takes value 0 until the firm drops out (they abandon the program and cease the startup), 1 in the time period in which the firm drops out, and it is a missing value thereafter. In order to avoid attrition biases, we will check that the entrepreneurs that leave the program will actually cease any entrepreneurial activity. 3. Pivot: this is the cumulative number of times in which a startup makes a major change to its business model. We defined a change to be major by analyzing whether the entrepreneur moved from the original idea to another idea that changed the core value proposition of the product or service.
Primary Outcomes (explanation)
Secondary Outcomes (end points)
Secondary Outcomes (explanation)
The RCT focuses on nascent startups. We do not restrict to particular industries. We advertise the program through digital channels as a general course overseeing all the important aspect of new venture creation. The course is free of charge in order to ensure participation of firms with limited financial resources. Startups receive training at Bocconi University, Milan, Italy. The same amount of training is offered to both treatment and control groups in order to ensure that there was no other effect in the treatment than a scientific approach to entrepreneurial decision-making. 7 instructors/coaches have been trained to deliver the training using standard materials, purposely designed. Each instructor/coaches teaches two classes (one subgroup of treated startups and one subgroup of control startups). The Bocconi University research team designs, coordinates and oversees all the activities, ensuring that the learning modules and coaching activities are appropriately carried out by the instructors/coaches.
Experimental Design Details
Before starting the training program we ask to all the applicant startups to send us a pitch of their business idea and the vitae of the founders. On the basis of this information, we categorized them across stages of development, industries and regions of origin. Out of the 300+ applicants to the program, we select 265 startups early stage. These are admitted to the program conditional aupon they abide by the program rules and take a detailed survey (batteries of variables for randomization balance checks)
Participating startups are informed that Bocconi University is investigating the determinants of the success of startups, so we were providing management advice and training to the firms and collecting performance data. In other words, they knew that they were participating in an activity in which we were offering a service free of charge in exchange for monitoring their actions for educational and research purposes. Also we told them that there were two groups of startups with some differences in the content of the training program. However, they did not know whether they were part of the treatment or control group.
In order to avoid contamination, treated and control startups are taught/coached in different time slots of the same day (morning and afternoon). All communications to the two groups of startups are distinct. Individual level, team level and performance data are gathered periodically by a team of 15 research assistants following a purposely defined research protocol. Data gathering also includes startups’ learning and behavioral monitoring (level of adoption of a scientific approach to entrepreneurial decision making), conducted via phone interviews every other week.
Pure parallel randomization, done in office by a computer using STATA. After being randomly assigned into treatment and control group, 14 subgroups of startups (7 for the treatment and 7 for the control groups) were created and randomly matched with the instructors/coaches so that each instructor/coach teaches to two subgroups -of approximately 18 startups- one of treated and one of control startups. Subgroups were created subsetting the sample (treatment and control groups) into 14 groups (to be allocated randomly to the 7 instructors/coaches) and within categories as well (to have balanced subgroups). Randomization checks: reduced-form ordinary least squares (OLS) regressions of startup characteristics on a dummy for the allocation in the treatment or control group.
The unit of randomization is the individual startup.
Was the treatment clustered?
Sample size: planned number of clusters
Sample size: planned number of observations
265 startups X 18 (points in time) = 47700 observations
Sample size (or number of clusters) by treatment arms
265 Startups (132 in the treatment group; 133 in the control group)
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
We perform sample size calculations using STATA.
This RCT would like to test if a scientific approach to entrepreneurial decision making increases the average revenues of a treated start-up by 10 times compared with the control group (based on the average revenues of 29.4 euro that we observed last year). We do not anticipate the standard deviation of revenues to be larger than what we observed last year (16925). We estimate the sample size required to detect the anticipated difference by using a 5% level two-sided test with 80% power.
Based on our calculations, the sample size required for this study is 215. Given that there are 265 start-ups participating in our trial, the power of the study is estimated to be 0.87. We also calculate the minimum detectable standardized difference given the requested power and sample size is 0.17, which corresponds to average revenues of roughly 2950 euros.
INSTITUTIONAL REVIEW BOARDS (IRBs)
Ethics Committee of Università Commerciale Luigi Bocconi
IRB Approval Date
IRB Approval Number
Post Trial Information
Is the intervention completed?
Is data collection complete?