Dr. Wallace's Favorite Mental Models

Clustering Illusion

Learn it → Apply it → Save as Skill

Random data doesn't spread out evenly — it clumps. The clustering illusion is the tendency to see those chance clumps as a hidden pattern, streak, or cause, when a purely random process would have produced something that looks just as "patterned."

Why This Library Is Different

Learn it. Apply it. Save as Skill.

The Dr. Wallace's Favorite Mental Models is designed to turn useful ways of thinking into reusable tools. Each model gives you a fast visual overview, deeper interactive learning, practical application exercises and an AI-ready Markdown skill you can save for future use.

Instead of merely reading about mental models, you can gradually build your own AI skills library: a collection of portable reasoning skills that can help ChatGPT, Claude, Grok and other AI assistants apply the mental models you value.

30-Second Understanding
Clumps happen on their own.

Flip a fair coin 24 times and you will almost always see at least one run of five or six heads or tails in a row — not because the coin is biased, but because that is what randomness looks like at small sample sizes.

Core question: Is this cluster more extreme than pure chance would produce at this sample size — or did I just notice the clump and overlook how much variability small samples naturally show?

A genuinely random sequence

Important: that highlighted run of six heads is not a rigged coin or a "hot streak." A run that long is a routine feature of 24 fair flips, not evidence of a hidden cause.

Mental Model Compass

Use it when a "pattern" might just be noise.

The model is most useful whenever someone has spotted an apparent streak, hot zone, or cluster in data that is at least partly governed by chance.

Pattern-checkPrimary use case
IntermediateDifficulty
3 minUnderstand
10–30 minApply with data
Quality controlPublic health & epidemiologyFinancial chart readingCrime-hotspot mappingSports performance reviewData science & overfitting
Model at a Glance

Notice → Baseline → Compare → Decide.

The clustering illusion is resolved by comparing the observed clump to what chance alone would be expected to produce — not by intuition.

01Notice

Name the specific apparent pattern: a streak, a hot zone, a cluster of similar events in time or space.

02Baseline

Ask what a genuinely random process, at this same sample size, would typically produce.

03Compare

Check whether the observed clustering is actually more extreme than that random baseline, using a calculation, simulation, or known reference rate.

04Decide

Only treat the cluster as a signal worth investigating further if it clearly exceeds what randomness alone would produce.

When Should I Use This?

Recognize the situation.

Open a use case to see what the model changes.

Operations
Defects seem to cluster on one shift

Before reorganizing a shift or blaming a crew, check whether the defect count on that shift is actually unusual for the sample size, or whether a small number of observations naturally produced an uneven-looking split.

Public Health
A disease "cluster" appears in one neighborhood

Rare, independently occurring cases will sometimes land close together in time or space purely by chance. Distinguish a true environmental signal from ordinary clustering using population size, base rates, and formal cluster-detection methods before alarming residents.

Finance
A stock chart seems to show a meaningful pattern

Random price walks routinely produce streaks, "head and shoulders" shapes, and clustered runs that look intentional. Treat a chart pattern as a hypothesis to test against a baseline, not as a signal to trade on by itself.

Sports / Performance
A player looks like they're on a "hot streak"

Before crediting a special cause (confidence, rhythm, a tactical change), check whether the streak length is actually unusual for that performer's normal game-to-game variance.

Security / Crime Analysis
Incidents seem to "cluster" on a map

Test whether the reported clustering exceeds what a random spatial distribution of rare events would produce before reallocating patrols or resources to the apparent hot spot.

Data Science / AI
A model seems to "notice" a pattern in noisy data

Small or noisy datasets will always contain some clusters. Watch for a model — or an analyst — overfitting to a pattern that is really just a sampling artifact.

Worked Example

London, 1944–46: were the rockets aimed, or random?

This is a well-documented historical case used to teach the method.

0 hits: 229 cells (observed)
1 hit: 211 cells
2 hits: 93 cells
3 hits: 35 cells
4+ hits: 8 cells
SITUATIONGerman V-2 rockets struck London; residents believed certain districts were deliberately targeted while others were spared
MEASUREStatistician R. D. Clarke divided south London into 576 equal-area cells and counted strikes per cell (1946)
BASELINECalculated what a Poisson (purely random) distribution of the same total number of strikes would predict per cell
COMPAREObserved counts matched the random-chance prediction closely, cell by cell
INSIGHTThe apparent "targeting" pattern Londoners perceived was consistent with chance, not aim
NEXTTreat a visually striking spatial pattern as a hypothesis to test against a random baseline, not as proof of a hidden cause
Do not conclude: "Clustering never means anything." Clarke's analysis tested a specific claim against a specific baseline and found no departure from chance in that case. A different dataset, tested the same way, can and sometimes does reveal a real signal.
More Examples You'll Recognize

The same illusion, several settings.

History & Accuracy

Where the idea comes from.

Expand for the research lineage behind the model.

Who described the clustering illusion?

Psychologist Thomas Gilovich discussed the effect at length in his 1991 book How We Know What Isn't So, building on the broader "representativeness heuristic" that Amos Tversky and Daniel Kahneman first proposed in their 1972 paper in Cognitive Psychology to explain related misjudgments of randomness, including the gambler's fallacy.

What did R. D. Clarke's 1946 study actually show?

Writing in the Journal of the Institute of Actuaries, actuary R. D. Clarke divided a map of south London into 576 equal cells, counted the number of German V-2 rocket strikes landing in each cell, and compared the resulting distribution to the Poisson distribution that pure chance would predict. The two matched closely, despite many residents' strong impression that the strikes followed a deliberate, non-random pattern.

Is there a general statistical principle behind this?

Statisticians Persi Diaconis and Frederick Mosteller summarized the broader point in a 1989 paper: with a large enough number of opportunities, almost any outrageous-looking coincidence is likely to happen somewhere. The clustering illusion is what happens when people notice the one coincidence without accounting for how many chances it had to occur.

Common Mistakes

Simple does not mean foolproof.

Skipping the baseline

Comparing a cluster to vague intuition about "what's random" instead of an actual calculated or simulated baseline.

Ignoring sample size

Five cases out of 50 people is a very different signal than five cases out of 50,000. Clusters shrink in importance as the denominator grows.

The multiple-comparisons trap

Scanning thousands of neighborhoods, time windows, or charts for "the one that looks clustered" will usually find one under pure randomness alone.

Treating absence as proof

No statistically unusual clustering found is not the same as proof nothing happened. It shifts the burden of proof; it does not close the case.

Using it as a dismissal shield

"It's just the clustering illusion" can become motivated reasoning for ignoring a real, well-evidenced pattern. Use the model to demand better evidence, not to stop looking.

Confusing it with a verdict on cause

Finding that a pattern is consistent with chance does not prove there is no cause; it means chance has not yet been ruled out as a simpler explanation.

When Not to Use It

Some clusters deserve full investigation regardless.

Use formal statistics when...

the stakes are high enough (health, safety, major capital) that a proper hypothesis test, control group, or epidemiological study is available instead of eyeballing a chart.

Use domain expertise when...

a scientifically plausible causal mechanism already links a suspected cause to the effect. The clustering illusion explains why clumps appear by chance; it does not rule out a known mechanism.

Escalate immediately when...

even a possible safety, legal, or public-health signal exists. Investigate first and resolve the statistics afterward; do not use "probably just chance" to delay urgent action.

Counterpoint: an obsession with ruling out chance can itself become a way to avoid acting on a real, inconvenient pattern. The goal is better evidence, not an excuse for inaction.
Combine It With

One model rarely does the whole job.

Try It Yourself

Build a clustering-check prompt.

This browser tool structures your thinking. It does not send your information anywhere or perform AI analysis.

Your AI-ready prompt

Complete the fields, then build your prompt.
Save as Skill

Turn this mental model into a reusable AI skill.

Save as Skill converts the model into portable Markdown instructions that teach an AI when and how to apply the clustering illusion, what questions to ask, what evidence to seek, what mistakes to avoid, and how to structure its analysis.

Build your own Mental Models Skills Library

Save the skills you find useful and organize them into your own reusable library. The Markdown is intentionally model-neutral, so it can be used wherever an AI system accepts uploaded files, project knowledge, custom instructions or reusable text context. Platform capabilities differ, so this is a portable skill file rather than a claim of one-click installation.

Go Deeper

For readers who want the nuance.

Is the clustering illusion the same as the hot-hand fallacy?

No. The clustering illusion is the general tendency to see non-random patterns in random data of any kind — spatial, temporal, or sequential. The hot-hand fallacy is one specific application of it, limited to believing that a streak of successes in a sequential task (like shooting a basketball) predicts continued success. Every hot-hand belief is a clustering illusion; not every clustering illusion is about a hot hand.

What's the actual statistical tool behind this?

Analysts typically compare an observed count distribution to a Poisson distribution (the standard model for independent, rare events occurring over a fixed interval of time or space) using a goodness-of-fit test. If the observed clustering doesn't differ significantly from what the Poisson model predicts, chance remains a sufficient explanation.

Why do humans see patterns in randomness at all?

Pattern recognition is generally a useful survival skill, and the representativeness heuristic — judging likelihood by how closely something resembles a typical case — is a fast, usually helpful mental shortcut. The clustering illusion is a byproduct: people expect even small random samples to "look" random (evenly spread, few streaks), when real randomness is lumpier than intuition predicts. The same underlying tendency produces related effects such as pareidolia (seeing faces in clouds) and apophenia (seeing meaningful connections in unrelated data).