unspurious.

The measurement illusions · Goodhart's law & the McNamara fallacy

When a measure becomes a target, it stops measuring.

A number that faithfully tracks something you care about will quietly stop tracking it the moment you start rewarding the number. Push on the proxy and people optimise the proxy — not the thing underneath.

Turn up the pressure Each dot is a person. Their true quality never changes — only how hard they're being pushed to score well does.
if the metric were honest
Average metric
Average true quality
Metric ↔ quality correlation

Fig. 1 — The measure comes loose from the meaning. With no pressure, the metric sits along the honest diagonal: a high score really does mean high quality. Turn up the pressure and the scores inflate — the average metric climbs while true quality stays exactly where it was — and the cloud detaches from the diagonal until the correlation between score and quality collapses toward nothing. The number still exists; it has simply stopped meaning what it meant.
The short answer

What is Goodhart's law?

Goodhart's law is the principle that “when a measure becomes a target, it ceases to be a good measure.” Named after economist Charles Goodhart, who observed in 1975 that statistical regularities collapse once they are used for control, it describes how a metric that reliably tracks a goal stops tracking it once people are rewarded for the metric itself — because the easiest way to raise the number is usually to game the gap between the proxy and the real goal, rather than to improve the goal. Examples range from teaching to the test to hospital wait-time gaming to Wells Fargo's millions of fake accounts.

The fast check“What does this metric reward, now that it's a target?”

01 · What just happened

The proxy and the thing are not the same thing

We measure what we can and reward what we measure. A school's exam results stand in for how much its pupils have learned; a hospital's waiting times stand in for the quality of its care; clicks stand in for whether anyone found the article worth reading. These proxies work — at first — because they genuinely correlate with the thing we actually care about. The trouble begins when we forget they are proxies and start treating the number itself as the goal.

The moment a measure carries real consequences — a bonus, a ranking, a budget, a job — the people being measured have every reason to raise the number by the cheapest route available. And the cheapest route is almost never “improve the underlying reality.” It is to find the gap between the proxy and the goal and climb through it. The slider above is that gap opening up: the metric soars, the reality it was standing in for does not move an inch, and the bond between them quietly dissolves.

Notice what doesn't happen in the simulation: nobody's true quality changes. Goodhart's law isn't mainly a story about people getting worse. It's a story about a number getting worse — less honest, less informative — even when nothing real has changed at all.

02 · The law and its lineage

A monetary footnote that turned out to be everywhere

The law is named for the British economist Charles Goodhart, who in a 1975 paper on monetary policy made a dry observation about central banks: “Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.” Central banks had noticed that certain measures of the money supply moved reliably with inflation, and reasoned that if they controlled the measure, they would control inflation. The relationships promptly fell apart — because targeting them changed the behaviour that had produced them in the first place.

The pithy version everyone quotes — “when a measure becomes a target, it ceases to be a good measure” — came later, paraphrased by the anthropologist Marilyn Strathern in 1997, writing about audit culture in British universities. And the same insight had already been stated, arguably first, by the social psychologist Donald Campbell, whose Campbell's law warns that the more any indicator is used to make decisions, “the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt” the very thing it measures. Three thinkers, three fields, one law.

A metric is a handshake between a number and a goal. Goodhart's law says the handshake does not survive being turned into a contract.

03 · Perverse by design

The cobra, the bounty, and the breeders

The most-told illustration is the cobra effect. As the story goes, colonial authorities in Delhi, alarmed by venomous snakes, offered a cash bounty for every dead cobra. It worked — dead cobras poured in, and the metric looked wonderful. Then enterprising locals did the rational thing: they began breeding cobras to kill for the reward. When officials realised what was happening and scrapped the bounty, the now-worthless snakes were released, and the wild population ended up higher than when the scheme began.

The metric thrived; the city did notCobras turned in for the bounty vs. the actual wild population
A BOUNTY ON DEAD COBRAS — AND WHAT IT DID TO THE COBRAS0255075100bounty activebounty scrapped → breeders release stockcobras turnedin (the metric)wild cobrapopulation (the goal)The metric soared, then cratered — while the thing it was meant to fix ended up worse than before.
Fig. 2 — A bounty is a target. “Dead cobras handed in” was a fine proxy for “fewer cobras” — until it became a target, at which point the cheapest way to produce dead cobras was to breed live ones. The metric and the goal didn't just decouple; they moved in opposite directions. (The tale is often told and probably embroidered, but the structure is exactly right, which is why it endures.)

Once you have the shape of it, you see that the gaming is usually not even dishonest — it is obedient. People do precisely what the number asks of them. A Soviet-era parable makes the point: a nail factory judged on the number of nails floods the country with useless tacks; judged instead on the weight of nails, it forges a single monstrous spike. Both factories hit their target perfectly. Neither makes a useful nail.

Hitting the target, missing the pointThe same goal, gamed two different ways
ONE GOAL — “MAKE USEFUL NAILS” — TWO METRICS, TWO ABSURDITIESTARGET: number of nails→ thousands of useless tacksTARGET: total weight→ one giant useless spike
Fig. 3 — You get what you measure, not what you want. The goal — useful nails — is never written into the metric, so the metric is satisfied by absurdities at either extreme. The lesson isn't that the workers were lazy or crooked; it's that a single number could never capture “useful,” and optimisation finds whatever the number forgot to say.

04 · The reach of it

Everywhere a number is rewarded

Goodhart's law is not a curiosity of central banking or colonial India. It is one of the most reliable forces in any system run by numbers, and the modern world runs on numbers. The same machine grinds away in classrooms, hospitals, boardrooms, laboratories, war rooms and feeds.

One law, six disguisesA rewarded metric rising while the goal it stood for stays flat
WHEREVER A NUMBER IS REWARDED, THE NUMBER GETS GAMEDEDUCATIONtest scoresvs real learningTeach to the test; in Atlanta, change the answers.HEALTHCAREA&E wait targetsvs patient careHold patients in ambulances to stop the clock.BUSINESSaccounts per customervs customer valueWells Fargo: millions of accounts nobody opened.SCIENCEcitation countsvs real knowledgeCitation rings; least-publishable-unit salami papers.WARenemy body countvs winning the warVietnam: count rises; the war is lost anyway.SOCIAL MEDIAengagementvs time well spentOptimise for outrage, because outrage clicks.In every panel the blue metric climbs while the dashed goal barely moves.
Fig. 4 — The pattern repeats with eerie fidelity. Reward test scores and you get teaching to the test — and, in Atlanta's notorious case, teachers erasing and correcting pupils' answers. Reward emergency-room wait targets and patients are held in ambulances so the clock never starts. Reward accounts-per-customer and Wells Fargo staff open millions of accounts nobody asked for. Reward citations, and citation rings bloom. In every panel the measured number marches upward while the thing it was meant to represent stands still.

Its sharpest historical form has a name of its own: the McNamara fallacy, after Robert McNamara, the US defence secretary who tried to run the Vietnam War by quantitative indicators, his favourite being the enemy body count. The number rose and rose; the war was lost regardless. The fallacy is the second half of Goodhart's curse — not just that targeted measures get gamed, but that the things which can't be counted at all get treated as if they don't exist. As one telling of the McNamara story has it: what cannot be measured is first set aside, then presumed unimportant, and finally presumed not to exist. The body count was countable; whether the Vietnamese people wanted the Americans there was not, so it fell out of the analysis entirely.

05 · Field notes

Living with measures you can't fully trust

It is structural, not moral. The most important thing to understand about Goodhart's law is that it is not a complaint about cheaters. It bites even when everyone is acting in good faith, because the flaw is in the proxy, not the people. That is why “hire better staff” or “punish the gaming” rarely fixes it — the pressure simply finds the next gap. Treating it as a character problem is itself a way of missing the point.

What actually helps. None of the partial cures are magic, but they share a logic: stop letting a single number stand in for a rich goal. Watch several metrics at once, so that gaming one shows up as distortion in another. Pair every quantity with the judgement of someone who can see the thing itself. Measure outcomes that are close to what you truly want rather than convenient proxies far upstream. Keep some discretion human and unautomated. And hold the metric loosely — the instant it becomes the goal, it has already started to rot.

If you cannot say what a metric would reward someone for doing — including the cynical, lazy and dishonest somethings — you do not yet understand the metric.

So the question to carry is the one in this entry's title bar: what does this number reward, now that it's a target? Ask it of your own dashboards before you ask it of anyone else's. The rest of the compendium is about numbers that mislead by accident; this is the one where the misleading is baked into the act of caring about the number at all. Measure what matters — but never forget that the measure is not the matter.

Continue the field guide

More ways to be honestly wrong