PsychologyOrbit
Sign in Join

#15 ·

Spot the flaw #15: Lessons from long-lasting founders

A past puzzle, with the answer. Try today's puzzle.

What is the flaw in this study?

Survivorship bias. Only founders whose firms survived were interviewed. Many founders who took exactly the same risks will have failed, possibly losing their homes, and they are invisible in this sample. If risk-taking is common among all founders, it will be common among…

A fictional study written for practice (Spot the flaw #15).

Fictional study Work & organisational · London, UK

The study

Two business psychologists in London interviewed 40 founders whose companies were still trading at least ten years after they were started. The interviews lasted about 90 minutes and were analysed by two coders who agreed closely. Thirty-six of the 40 founders described taking a major personal financial risk in the early years, such as remortgaging a home or leaving a secure job without savings. Many said this risk had forced them to succeed. The authors' book, aimed at new entrepreneurs, concludes that bold financial risk-taking is a key ingredient of business success and advises readers to commit fully rather than keep a safety net.

What is the flaw in this study?

  • A Ceiling effect
  • B Survivorship bias The flaw
  • C Order effects
  • D Regression to the mean
Survivorship bias. Only founders whose firms survived were interviewed. Many founders who took exactly the same risks will have failed, possibly losing their homes, and they are invisible in this sample. If risk-taking is common among all founders, it will be common among survivors too, whether or not it helps. To learn what predicts success, the study would need to follow a whole cohort of new businesses, including those that closed, and compare risk-taking between them. The coding was reliable; the problem is who was left out, not how the interviews were analysed.

The concept: Studying only the successes

This study is fictional, written for practice. No real study, institution or researcher is described.