Statistics · 1906
Galton's ox
At the West of England Fat Stock and Poultry Exhibition in Plymouth, 787 fairgoers paid sixpence each to guess an ox's dressed weight. Galton, who doubted ordinary people's judgment, found the median guess (1,207 lb) within 9 lb of the true weight (1,198 lb).
Lesson: Butchers, farmers and curious townspeople had different information and guessed privately on tickets, so their errors canceled.
Naval search · 1968
The lost submarine USS Scorpion
When the submarine vanished in the Atlantic, Navy scientist John Craven had experts assign probabilities to several scenarios for what went wrong. The team combined these into one probability map of the sea floor, a technique now called Bayesian search. The wreck was found southwest of the Azores, a few hundred yards from the highest-probability cell. The popular story that experts bet bottles of whisky comes from the book Blind Man's Bluff; the 1971 technical paper on the search does not mention wagering.
Lesson: Pooling diverse expert judgments with a formal method beat any single expert's favorite theory.
Elections · 1988–2004
Prediction markets vs. polls
Joyce Berg, Forrest Nelson and Thomas Rietz compared the Iowa Electronic Markets, where traders buy and sell contracts on election outcomes, with 964 polls across five U.S. presidential elections. The market price was closer to the final result 74% of the time (International Journal of Forecasting, 2008).
Lesson: A price is an aggregation mechanism. Traders with money at stake reveal private information independently.
Lab experiment · 2011
When the crowd stops being wise
In the ETH Zurich study, participants who could see others' estimates converged toward each other without getting more accurate. The researchers named three effects: the social influence effect (less diversity, no better accuracy), the range reduction effect (the truth slides to the edge of the group's range) and the confidence effect (people feel surer anyway).
Lesson: This is the failure case, and it is just as important as the success stories.
Everyday work
Planning Poker in software teams
Agile teams estimating the effort of a task often reveal estimate cards at the same moment, rather than talking first. The ritual exists to protect independence: nobody can anchor on the senior engineer's number before committing to their own.
Lesson: The big outliers then start the discussion, which surfaces hidden risks.
Television
"Ask the Audience"
Surowiecki reports that on Who Wants to Be a Millionaire?, the studio audience's top choice was right about 91% of the time, compared with roughly 65% for the contestant's hand-picked expert friend.
Lesson: A large, varied group voting privately (each with a keypad) can beat one well-chosen expert on general-knowledge questions.