Dr. Wallace's Favorite Mental Models
Why a word, a name, or a complaint you just noticed for the first time suddenly seems to turn up everywhere — and why that feeling almost never means the world around you actually changed.
Situation: A product manager reviewing a batch of ten user interviews notices a complaint about "notification overload" show up in the third interview, then again in the fourth and fifth. By interview five, the PM feels confident this is the single biggest pattern in the research and wants to reprioritize next quarter's roadmap around it immediately.
Applying the model: Before reprioritizing anything, the PM treats the clustering as a signal worth checking rather than a settled fact — because a growing count right after a pattern first catches your attention is exactly what frequency illusion predicts, whether or not the underlying complaint rate actually changed at all. The real question isn't whether the complaint feels common by interview five; it's whether a fair count across the full research set, not just the interviews the PM happens to remember noticing it in, actually supports that impression.
| Approach | What it actually delivers | Where frequency illusion creeps in |
|---|---|---|
| Act on the pattern as soon as it "feels" common across the last few interviews reviewed | A fast decision, based on whatever happened to catch the PM's attention first | Maximum — only the confirming interviews get remembered and counted; the ones that didn't mention it fade from memory |
| Reread every transcript in the batch and tag every mention against the full set, including interviews reviewed before the pattern first stood out | An actual rate — how many of all ten interviews mention it — instead of a felt impression from the last few | Reduced — the count no longer depends on which interviews the PM happens to remember noticing it in |
| Compare this batch's rate to a prior round of interviews or a support-ticket log covering the same question before this round began | A real trend line instead of a single snapshot taken right after attention was first drawn to the issue | Minimized — a genuine increase across batches looks different from a flat rate that merely started getting noticed |
This is a composite, illustrative scenario built to show the mechanism, not a specific published case study. It reflects the general direction of how selective-attention-driven pattern spotting works in qualitative research; exact rates and timelines vary by team, product, and research method.
Answer a few questions and build a ready-to-use prompt for checking whether something you suddenly keep noticing has actually increased, or whether your attention just switched on.
This is the portable skill version of this model — written so you can hand it to any AI assistant and get the same thinking applied to whatever you just started noticing everywhere.
Copied!