The usual explanation for why so few investors beat the market is that markets are efficient: prices already reflect what is knowable, so there is nothing left to exploit. It is a clean story, and it is mostly true. But it points at the wrong cause. Michael Mauboussin, the investment strategist who spent a career untangling skill from luck, offers a sharper one in his 2012 book The Success Equation. Markets did not just get more efficient. The people trading in them got better— nearly all of them, at roughly the same time. And once almost everyone is skilled, something strange happens to the role of luck. It grows. This is what Mauboussin calls the paradox of skill (the counterintuitive rule that as the average level of skill rises and the gap between the best and the rest narrows, luck explains a larger share of who ends up ahead). The better the field, the more the scoreboard is decided by chance.
That sentence sounds backwards, so it is worth slowing down on the mechanism before we put any money on it.
Why no one bats .400 anymore
The cleanest illustration comes not from finance but from baseball, an analogy the paleontologist Stephen Jay Gould first drew and Mauboussin adopted. In 1941 Ted Williams hit .406. No major-league player has batted .400 over a full season since. The tempting read is that hitters have declined. The opposite is true: today’s players are fitter, better coached, and drawn from a far larger global talent pool. So why has the .400 season vanished?
Because the pitchers improved in lockstep with the hitters, and so did everyone else. When the whole field rises together, the distance between the best player and the average player shrinks. Williams could hit .406 in 1941 partly because the gap between him and a replacement hitter was enormous. A modern superstar is just as far ahead of his era’s averagein raw ability, but the average has caught up so much that the spread of outcomes has compressed. Picture two jars: one holds each player’s skill, the other holds the random luck of any given season — a bloop that falls in, a line drive caught. Shrink the spread in the skill jar while the luck jar stays the same size, and luck now accounts for more of the difference between first place and tenth. Nothing about luck changed. Skill converging is what handed luck the bigger vote.
The marginal buyer is now a professional
Now move the same logic to the stock market, because the conditions are almost a caricature of the baseball case. The talent pool in investing is effectively unlimited: anyone with a terminal and a model can compete, and over the past half-century a flood of trained, well-resourced professionals did exactly that. The person on the other side of your trade — the marginal buyer who sets the price — is no longer a distracted amateur. It is an institution with analysts, data, and discipline. The easy edges that an earlier generation harvested have been arbitraged away, not because a textbook says markets are efficient, but because thousands of skilled people are racing to close every gap the moment it opens.
Charles Ellis saw this coming in 1975. In his essay “The Loser’s Game’’ he argued that so many gifted professionals had crowded into money management that it was no longer feasible for any of them to profit from the errors of the others often enough to beat the averages. The dispersion of fund returns confirmed it: the analyst Peter Bernstein, running Gould’s baseball analysis on mutual funds, found the standard deviation of managers’ excess returns steadily shrinking as more skilled entrants arrived. The .400 hitters of investing did not retire. The competition simply caught up to them.
This is the honest reason the long-run scorecards look the way they do. In S&P’s SPIVA report for year-end 2024, which measures active funds against their benchmarks, not one of the twenty-two U.S. equity fund categories had a majority of active managers beat its benchmark over the fifteen-year window. Fama and French, in their 2010 Journal of Financestudy, used bootstrap simulations to separate skill from luck and found the average actively managed fund delivered roughly zero alpha before fees and about negative one percent a year after them — close to what the fees cost. The point is not that managers are dim. It is the paradox: they got good, all together, and a field of equals is a field where luck decides the short race.
What luck dominating actually changes
If luck dominates a single outcome, the practical consequence is brutal and clarifying: you cannot read skill off any one result. A manager who beats the market over three years, a stock pick that triples, a quarter that goes your way — in a high-skill, low-dispersion world, each of those is mostly a draw from the luck jar. Fama and French made this quantitative. Most five-year track records, even strong ones, sit comfortably inside the range you would expect from pure chance. The implication is not despair. It is that the unit of evaluation has to change. A brilliant call proves nothing. Only a repeatable process, applied across hundreds or thousands of decisions, can separate a real edge from a lucky streak, because luck is what averages out over many trials while a genuine edge compounds.
Here is the limitation, stated plainly, because the paradox is easy to over-read. “Luck dominates” applies to short samples and single picks. It does not say skill is dead or that you should surrender to the index and stop thinking. The same math that makes one year noise makes ten thousand decisions signal: a small, consistent tilt in the odds, repeated with discipline over a long horizon, still compounds into a real result. The paradox argues for systematic humility about any single outcome, not for giving up. What it kills is the brilliant-call theory of investing. What it rewards is the patient, rules-based kind.
Process is the only edge that survives
That is precisely the gap a systematic, peer-relative method is built to fill. The paradox punishes two things: the single discretionary call, which luck swamps, and behavioral noise, the buy-high, sell-low impulses that sink discretionary investors before skill ever gets a chance to show. A rules-based process removes both. At Obermatt we score every one of roughly 8,000 stocks the same way, on Value, Growth, Safety, and Sentiment, each ranked from 1 to 100 against a company’s true peers — the handful of similar businesses competing for the same capital — then averaged into a single 360 rank. The edge is not a flash of genius on any one name. It is the same disciplined comparison applied identically across the whole market, thousands of times, so that a small, repeatable tilt has room to compound and a single unlucky pick cannot define the record. That is why we lean on peer-relative ranks rather than absolute thresholds, and why the workflow runs from 8,000 stocks to a shortlist by rule rather than by hunch.
The principle to carry out of all this is narrow and durable: in a market full of skilled people, your edge cannot live in any single decision, because luck owns the single decision. It can only live in a process consistent enough to bend the odds across thousands of them. So the concrete action is to stop grading yourself, or any manager, on the last good call. Write down the rules you will apply to every position the same way, then judge the rules over a long horizon and a large number of decisions — not the outcome of the one in front of you. The paradox of skill is not a reason to give up the game. It is the reason to play it systematically.