Evidence

The Trouble With Before-and-After Stories

A format so familiar most readers stopped seeing it as one. Why testimonial pairs persuade more than charts, and what they can and cannot show.

Two blank photo frames side by side on a neutral wall

Two photographs, side by side, a few months apart. A short paragraph underneath in the first person. The format is so familiar that most readers have stopped seeing it as a format at all — it reads as proof rather than as a genre with conventions and a commercial history. And it is persuasive. A testimonial pair moves more people than a well-built chart ever has, which is why it deserves a harder look than it gets.

The genre predates the camera it uses. Nineteenth-century tonic almanacs ran signed letters from grateful strangers, and the claim has never changed shape: this happened to a person, therefore it can happen to you, therefore the product did it — three assertions stacked into one image. The problem is not that the people in these stories are lying. Most almost certainly are not. The problem is structural.

The stories nobody posts

Start with arithmetic. Suppose a program has a thousand participants and its page shows nine stories. The other 991 are not a scandal — they are simply not stories. Someone who drifted away in week three has nothing to announce, and someone for whom little changed does not open a photo app. Non-events generate no content, so they never enter the pool being sampled.

This is survivorship bias in its ordinary domestic form. Anyone who has watched a neighborhood running club knows the pattern: the January signups are a crowd, the March group chat is a handful, and the people still posting in June were always going to be. Reading that chat and concluding the club works is reading the finish line and calling it the field.

A testimonial is not a small study. It is not a study at all. It is the end of a story whose beginning was chosen after the ending was already known.

Selection happens twice, in the same direction

The first filter is volunteering. People who send in an account of their experience are unusual by definition: more enthusiastic, more invested, more inclined to attribute a change to one cause, often motivated to justify a decision they made publicly. The second filter is curation. Out of the accounts that arrive, someone picks which appear, and no editor is obliged to publish the dull ones.

Neither filter is dishonest on its own. What matters is that both point the same way — two sieves in series, catching for the same quality. The reader studies what came through the second while imagining what went into the first.

Regression to the mean, the quiet distortion

Of the effects at work here, this one gets discussed least and may be the largest. People rarely start something on an average day. They start after a bad stretch — a rough month of sleep, a flare of an old complaint, a week when the stairs felt harder than usual. The bad stretch is the trigger, not a coincidence. And measurements taken at an unusually low point tend to look better later regardless of what happens in between, because unusual points are, by definition, not where things usually sit.

The everyday illustration is the common cold. A person reaches for a remedy on day three, when symptoms peak. The cold resolves by day seven, as colds do. The remedy collects credit for a schedule it had no part in setting. That reasoning is not stupid — it is how humans read sequence — but it is not evidence, and the same structure sits under most transformation stories.

The photograph is an argument, not a measurement

Photographers control more than viewers assume. Lighting direction, focal length, camera height, posture, breathing, time of day, whether the shot was taken standing relaxed or standing deliberately — each changes an image, and several change it more than months of anything else would.

Then there is provenance. The second photograph is taken on purpose, by someone who wants it to look a certain way. The first is often a casual snapshot located afterward, chosen because it contrasts. Neither is fake. They were made under different conditions for different reasons, and setting them side by side implies a controlled comparison that was never controlled. The instinct behind reading a label carefully applies here: the presentation is doing work the content isn't.

Worth knowing: the most informative question about any collection of success stories is one it almost never answers — how many people started? Nine accounts out of a dozen participants and nine out of ten thousand look identical on the page and mean entirely different things. Without a denominator, the count mostly measures how energetically stories were solicited.
The common claimWhat actually holds up
"These are real people, so it's real evidence."Real and representative are different properties. A sincere account is genuine data about one person, filtered twice before reaching the page.
"Hundreds of stories can't all be wrong."They can all be true and still mislead. Volume measures collection effort — the unfavorable outcomes were never submitted to be counted.
"The photos speak for themselves."Photos record appearance under particular lighting, posture, and timing. Two images made for different purposes are not a paired measurement.
"It worked for them, so it might work for me."The most defensible version — but a story cannot say what would have happened to that person anyway, which is the whole question.

What testimonials are genuinely good for

None of this makes personal accounts worthless. It makes them useful for narrower questions than they are asked. They describe experience, and experience is real information — just not information about causation or magnitude.

What they cannot do is settle whether something works, for whom, or by how much. That job belongs to comparisons that include the people who didn't post — much the same reason a single study rarely settles anything. The useful reflex when a transformation story lands is not cynicism about the teller. It is a quiet question about everyone outside the frame.

Disclaimer: This is educational content, not medical advice. It describes how testimonial evidence is structured and why it can mislead; it is not an assessment of any specific product, program, or personal account. Decisions about your health belong with a qualified clinician who knows your history.