Survivorship Bias: Why Success Stories Are the Worst Source of Strategy

Spotting that you're only seeing the winners is step one. The trap underneath it is that the riskiest moves look most reliable for the same reason, and this is how you put a number on the failures nobody recorded.

8 min read · for the tool Survivorship Filter

You’re about to copy a move that worked. A company you admire made a bold, unconventional bet, it paid off spectacularly, and the playbook is suddenly everywhere: trust your contrarian read and move fast. So you lean that way too. It feels like evidence, because it is evidence. What you can’t see is the other half of the picture, the companies that made the same bet, hit a wall, and folded before anyone wrote them up. They don’t get case studies, and nobody thought to ask them. The winners you heard about are real, and they’re also the only ones who lived to tell you about it.

You already know to ask the obvious question here: who tried this and didn’t make it. That’s the right reflex, and most of the time you can’t answer it, which tells you something on its own. But the question only gets you to the edge of the problem. The evidence you can see isn’t just incomplete, it’s bent in a specific direction, and the strategies you’d most want to copy are exactly the ones it bends hardest. Once you see the shape of the distortion, you can correct for it instead of just worrying about it.

The evidence

The cleanest demonstration came from wartime work on where to armour bomber aircraft. The planes that came back were covered in bullet holes across the fuselage and wings, and the obvious move was to reinforce where the holes clustered. The actual answer was the reverse. Those planes came home, so the holes marked the places a plane could be hit and still fly. The ones hit in the clean areas, the engines and the cockpit, were the ones that didn’t return. The data you could examine was made entirely of survivors, and the answer sat in the wreckage you couldn’t.

The same gap shows up wherever results are tallied only for the names still standing, and finance is where it’s been measured most precisely. When fund performance gets averaged, the databases tend to drop the funds that closed or merged, which are usually the ones that did badly. Put the failed funds back in and the industry’s apparent average return falls. One careful estimate put the inflation at roughly 0.9 percentage points a year. That sounds small until you compound it across a decade, where it’s enough to separate a strategy that looks like it beats the market from one that plainly doesn’t.

The same structure runs through how organisations learn from each other. The standard move is to study the winners and copy what they did, and the flaw is built into the method. The companies that ran the same playbook and went under aren’t available to study. They’ve folded, been absorbed, or faded out, so they never make the case study. This is the undersampling of failure, and it’s among the more reliably reproduced findings in decision research: success stories overcredit the visible traits of the survivors, because the identical traits of the failures were never written down.

How it works

Here’s the mechanism the obvious question misses. The absence of failures does the most damage to the boldest strategies, and those are the ones you’re most tempted to copy.

Think about what makes a strategy high-variance: a wide spread of outcomes, big wins on one end, big losses on the other. The aggressive market entry, the unconventional launch, the founder who bet everything on a single contrarian read. Run that move a hundred times and you get a handful of spectacular wins and a pile of wrecks. Now apply the filter. The wins get written up and turned into the strategy everyone studies. The wrecks vanish. So in the visible record that high-variance move shows up almost entirely as wins, and it looks not just good but reliable. The very thing that made it risky, the wide spread, is invisible, because you only ever see one tail of it.

A steady, low-variance approach gets no such flattery. Its outcomes are clustered and unremarkable, so its wins aren’t dramatic enough to profile and its losses aren’t dramatic enough to make news. It looks mediocre on the page while being the more dependable bet. The filter rewards exactly the strategies whose failures it’s best at hiding.

The riskiest moves look the most reliable, because the filter that hides failure hides the most failure precisely where the spread of outcomes is widest.

That’s why “they took bold risks and persisted” keeps surfacing as the lesson. Bold risk-taking really does correlate with success among the survivors. It also correlates with failure among the people who didn’t survive, and you can’t see them, so the correlation looks one-sided when it isn’t. The trait that explains the win may be doing nothing at all, and the real difference was often luck, timing, or a circumstance the story can’t capture.

How to use it

Start with the obvious question: before you act on a success story, ask who ran the same approach and failed, and whether you’d even know about them. If failures in this domain disappear quietly, treat the visible record as the winning tail of a distribution, not the whole thing.

But don’t stop at “the evidence is incomplete,” because that just leaves you uneasy. Do the thing that corrects it: estimate the denominator. The success story gives you the numerator, the ones who made it. Force a rough number for how many attempted the same move in total. If three companies you can name pulled off that move and raved about it, ask how many tried it in total. Three glowing stories out of fifty attempts is a very different signal than three out of four. You won’t get a precise figure, and you don’t need one. Even a crude guess at the size of the invisible group drags the base rate back into view and pulls your confidence down to where the full evidence would put it.

Then weight by variance. When the success you’re copying came from an aggressive, all-or-nothing move, discount it harder, because that’s the kind of strategy the filter flatters most. A win from a steady, repeatable approach is more trustworthy evidence than a win from a dramatic gamble, even though the gamble makes the better story. So when you’re weighing a growth play, a product bet, or a pricing model off the back of someone’s win, ask not just whether it worked for them but how wide the range of outcomes was. The wider the spread, the more of it you’re not being shown.

And when you genuinely can’t find the failures, treat that as a finding, not a dead end. A domain where losers vanish without a trace, like startups or speculative launches, is one where you should lean on the known base rate over any individual success story, however vivid. The founder who beat 5% odds is real. The 5% is the number that should set your expectations, not the founder.

Why it matters

Most of the strategy advice you absorb arrives pre-filtered, and not by anyone’s bad faith. Wins get documented, celebrated, and packaged into lessons. Losses stay private and get forgotten, so the pool of stories you learn from tilts optimistic before you read a word. The book profiling ten winning founders isn’t lying about the founders. It’s running an operation that looks like analysis and is closer to selection, with the causation assumed and the hundreds of identical failures absent from the dataset everyone is reasoning from.

Running the filter doesn’t turn you cautious or sour on ambition. It stops you mistaking the surviving slice for the whole. The question of where the ones who didn’t make it went is never comfortable to sit with, and it’s the one that keeps your next move anchored to what actually happened rather than to the stories the results left behind.

References

  1. Wald, A. (1943). A method of estimating plane vulnerability based on damage of survivors. Statistical Research Group, Columbia University.
  2. Brown, S. J., Goetzmann, W., Ibbotson, R. G., & Ross, S. A. (1992). Survivorship bias in performance studies. The Review of Financial Studies, 5(4), 553–580.
  3. Denrell, J. (2003). Vicarious learning, undersampling of failure, and the myths of management. Organization Science, 14(3), 227–243.
  4. Elton, E. J., Gruber, M. J., & Blake, C. R. (1996). Survivorship bias and mutual fund performance. The Review of Financial Studies, 9(4), 1097–1120.
  5. Taleb, N. N. (2004). Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets (2nd ed.). Random House.
The newsletter

One tool a week

How you think, decide, lead, focus, and stay steady under pressure. A specific way to practice one move before the next seven days are out. Grounded in evidence, not self-help.

One email a week. Leave whenever. Powered by Buttondown.