The Analyst's Path

Goodhart's law

Goodhart's law ("when a measure becomes a target, it ceases to be a good measure") names the deeper mechanism: once people are paid on a single number, they optimize the number itself, by whatever means are available, including means that quietly damage the thing the number was meant to track. A claims team paid on speed alone gets faster by closing claims before they should be closed.

4 min readPart of Operating Model & Org DesignOpen in course mode

Advertisement

The final lever asks the question every redesign eventually has to answer honestly: how will you know whether any of this actually worked? A metrics cascade translates one strategic objective, stated once at the top, into measures at each level below it, each a more specific, more locally-actionable version of the objective above, a corporate-level lagging indicator (visible only after the fact, like gross margin or full-year churn), a regional or business-unit leading indicator closer to something a manager can influence day to day (a sell-through rate, a cycle time), and a team-level measure narrow enough that one person can see their own effect on it. Getting the cascade right means every level's metric is a genuine, defensible driver of the level above it, not merely correlated with it, and not merely easy to measure.

How do metrics go wrong, and what is the fix?

Two failure patterns recur constantly enough to name directly. The vanity-metric trap is measuring activity (promotions run, tickets closed) and mistaking it for outcome, when activity can rise sharply while the outcome it exists to serve stays flat or worsens; "promotions run" says nothing about whether any of them protected margin, exactly as Worked Example 4 flags. Goodhart's law ("when a measure becomes a target, it ceases to be a good measure") names the deeper mechanism: once people are paid on a single number, they optimize the number itself, by whatever means are available, including means that quietly damage the thing the number was meant to track. A claims team paid on speed alone gets faster by closing claims before they should be closed. Worked Example 6 shows exactly this occurring, with a real cost attached. The defense is the same discipline both times: pair every activity or speed metric with a quality or outcome guard-metric, and condition the reward on both moving together, not either alone. A metric with no guard partner is not a finished design; it is an invitation to game it.

Advertisement

{
  "skill": "Drafting a first-pass KPI cascade (corporate to regional to team level) with paired guard-metrics against gaming",
  "use": "Have an AI tool draft a structured metrics-tree skeleton from a stated strategic objective, including a candidate guard-metric for every activity or speed metric proposed, as a starting scaffold you then test for whether each lower-level metric genuinely drives the one above it.",
  "tools": ["Chat assistants — Claude, ChatGPT, Gemini", "Spreadsheet/BI tools — for building the actual scorecard with real weights and targets"],
  "prompt": "For the strategic objective '<OBJECTIVE>' at <ORGANIZATION>, draft a three-level KPI cascade (corporate / business-unit-or-regional / team) with one to three metrics per level. For every metric that measures speed or activity volume, propose a paired guard-metric that would catch someone gaming the primary metric, and explain in one sentence how gaming could occur if the guard metric were absent.",
  "verify": "Every proposed metric and its guard partner must be checked against how the incentive would actually play out for a real person facing a real bonus, not accepted because the logic sounds tidy; recompute any weighted-scorecard arithmetic yourself and confirm the guard-metric genuinely constrains the specific gaming behavior you are worried about (Guardrail 1-5) before proposing the cascade to a client.",
  "diy": "You must already understand Goodhart's law and be able to spot which of two candidate metrics is gameable, unaided, before you can tell whether an AI-drafted guard-metric actually closes the gap or merely looks like it does.",
  "market": "US"
}

Advertisement

Part of the course

This page is part of Operating Model & Org Design (CN7.01), in Phase 7: Macroeconomics and how the world economy works. The module's flashcards and its quiz are in the app.