Indicators under audit

Every dashboard is a list of claims. Green says the project is on track. A score says people are content. A figure that rises says something is improving. Rarely does any of them say what it is fit for, in which place, or until when.

Indicators Under Audit takes one indicator at a time and runs it through the Four Questions for Fitness. Which question does it answer? Which does it quietly assume? The series starts with economics, where the habit is oldest, moves to the numbers practitioners meet every week, and ends with an indicator that mostly holds up. One paper each, one argument each, and a limits section in every one, because the approach has not been field-tested and these are desk audits.

Read them in order, or start with the indicator you are being asked to trust this quarter.

  1. AFS Gives One Consistent Test for What Economics Already Half-Knows – GDP and its relatives answer one of the Four Questions for Fitness and presume the rest, a gap economists had half-seen long before.
  2. Velocity Is a Diary, Not a Scoreboard – A team’s velocity answers a planning question for that team alone, and stops meaning anything once it is compared across teams or set as a target.
  3. Utilisation Reads Best Right Before It Fails – The busier everyone looks, the less room the system has to absorb anything unexpected, so the number improves while the capacity to cope disappears.
  4. The Business Case Is a Certificate, Not a Permission – Return on investment answers the question of purpose once, at approval, and is then cited for months without anyone checking whether its conditions still hold.
  5. An Engagement Score Averages the People Who Disagree – One score hides the spread behind it, so a serious problem in a single team can sit comfortably inside a respectable mean.
  6. Green Is a Report About the Reporter – A status light reflects how safe it is to say a project is in trouble, which is why amber arrives late and red arrives later.
  7. Cycle Time Claims Less, and That Is Why It Holds – The one indicator in the series that mostly survives the audit does so by claiming no more than its evidence supports.