The Signal and the Noise
Coaches & Mentors
DropRegion · Lessons from The Signal and the Noise · the author

What Coaches/Mentors Can Learn from The Signal and the Noise

Julian Marsh had a client who improved dramatically after one session and another who seemed stuck for weeks, and Julian found himself ready to declare his new technique a breakthrough based on the first case alone. A rival coach on social media spoke with total certainty about his own method, claiming a near-perfect success rate, though Julian had never seen him track outcomes over time or admit a single failure. Watching his stuck client more closely, Julian noticed small, steady improvements buried under the visible frustration, easy to miss if he only judged progress by dramatic weekly wins. He began to suspect that his own confidence in any given method said less about whether it actually worked and more about how recently he had seen one exciting result.

01 · The Book in One Minute

The whole book, compressed

01Reading One Session
02Treating A Client's Progress As
03Judging Methods By Outcomes
04Coaching As Ongoing

This edition works through 4 core lessons — take them one at a time, not all at once.

02 · Where Are You Now?

What's different for your conditions

Tap whichever ones sound like you. Nothing here is sent or saved — it's just for your own noticing.

Coaches see visible short-term results from clients, and a single strong or weak session is often noise rather than a reliable signal about a method's real effectiveness.
The coaching field rewards confident, dramatic claims of success, often without any real tracking of outcomes across clients over time.
Client progress is usually gradual and uneven, making it easy to mistake a client's plateau for failure or one good week for lasting change.
A coach's own reputation depends on projecting confidence, which can create pressure to sound more certain about a method than the evidence actually supports.
Coaches must weigh their own personal experience against broader patterns, since a method that worked for one client is a small sample on its own.

0 of 5 selected

03 · Core Lessons

The core lessons, applied to you

Reading One Session

Reading one session without overreacting

The idea

Julian's instinct to treat one dramatic session as proof of a breakthrough mistakes a single result for a real signal. A steadier approach looks at a client's progress across many sessions before crediting or blaming any one technique.

What it looks like

Sometimes a single session really does mark a genuine turning point that would be lost by insisting on a longer pattern before believing it. Practice: before declaring a method effective, check whether it produced a similar result with at least one other client.

Try this

Before declaring a method effective, check whether it produced a similar result with at least one other client.

Treating A Client's Progress As

Treating a client's progress as a moving estimate

The idea

Rather than judging a client's trajectory from any single week, Julian can hold his sense of their progress as an estimate that updates gradually with each session, revising slightly as new evidence comes in instead of swinging between hope and doubt after any one outcome.

What it looks like

Clients and their families sometimes need a clear, fixed assessment at a specific checkpoint, which can conflict with a still-evolving picture. Practice: keep short notes across sessions so progress judgments rest on a pattern, not the most recent visit.

Try this

Keep short notes across sessions so progress judgments rest on a pattern, not the most recent visit.

Judging Methods By Outcomes

Judging methods by outcomes, not confidence

The idea

The coach who claims the highest success rate online is not automatically the most effective one, since confident, dramatic claims draw more attention regardless of whether outcomes were ever actually tracked. Julian can build a habit of asking what evidence supports a bold claim before adopting someone else's method.

What it looks like

Some genuinely effective coaches are simply less polished at marketing their track record, so quiet confidence does not always mean weaker results. Practice: before adopting a new method, ask what specific results, tracked over multiple clients, support it.

Try this

Before adopting a new method, ask what specific results, tracked over multiple clients, support it.

Coaching As Ongoing

Coaching as ongoing, humble practice

The idea

The most effective coaches hold their read on any client or method loosely, stay curious about where their own judgment might be wrong, and treat every session as new evidence rather than a final verdict on what works. For Julian, this means resisting both premature celebration and premature discouragement, letting real patterns emerge over time.

When the clusters compete

Julian's sharpest tension is between updating his sense of a method gradually and the pressure, both from clients and from the coaching field, to project bold confidence about results right away. A hedged, still-forming view can undercut a client's motivation to keep going. The way through is to stay genuinely encouraging in tone while keeping his private assessment of what is actually working honest and still open to revision.

04 · Choose Your Priority

Name one thing, honestly

- Which coaching method have you trusted mainly because it was marketed with confidence, rather than because you saw its results tracked over time? - Where have you judged a client's progress, or your own effectiveness, from a single session rather than a longer pattern?


Good. Now look back at the "Try this" line under whichever lesson feels most connected to what you just wrote, and treat that as this week's actual assignment — not all 4 at once.

05 · Put It Into Practice

The practices from this edition

Before declaring a method effective, check whether it produced a similar result with at least one other client.
Keep short notes across sessions so progress judgments rest on a pattern, not the most recent visit.
Before adopting a new method, ask what specific results, tracked over multiple clients, support it.

0 of 3 selected

06 · Small Experiment

Run this for seven days

Before adopting a new method, ask what specific results, tracked over multiple clients, support it.

07 · Remember This
If you remember only 4 things
01Reading One Session. Julian's instinct to treat one dramatic session as proof of a breakthrough mistakes a single result for a real signal.
02Treating A Client's Progress As. Rather than judging a client's trajectory from any single week, Julian can hold his sense of their progress as an estimate that updates gradually with each session, revising slightly as new evidence comes in instead of swinging between hope and doubt after any one outcome.
03Judging Methods By Outcomes. The coach who claims the highest success rate online is not automatically the most effective one, since confident, dramatic claims draw more attention regardless of whether outcomes were ever actually tracked.
04Coaching As Ongoing. The most effective coaches hold their read on any client or method loosely, stay curious about where their own judgment might be wrong, and treat every session as new evidence rather than a final verdict on what works.
08 · Your Next Step

What will you do differently because you read this?

This edition draws only on the core arguments of The Signal and the Noise by Nate Silver, a book originally written for a general audience following forecasting in politics, weather, sports, and economics who wanted a more honest way to weigh confident claims. Coaches and mentors wanting the fuller argument and detail behind these lessons should read the complete book, which this summary can only translate in part.