Engineering Leadership

Your team is shipping more code than ever. That is not the same as being more productive — and AI makes the gap dangerous.

Activity metrics were always proxies for human effort. AI makes output cheap, so output stops being evidence of value. The only metric that survives AI is the one tied to an outcome someone actually wanted.

Your team is shipping more code than ever.

That is not the same as your team being more productive — and AI is about to make the gap dangerous.

I have seen this gap before AI, and AI widens it. Commit graphs look impressive, PR volume is up, the dashboard is green — and the roadmap still slips. The reason is simple: those numbers were always proxies for human effort. They worked because producing code was expensive, so more code roughly meant more work done. AI breaks that assumption. It makes output cheap, which means output stops being evidence of anything. A team can double its merged PRs and ship less that matters.

The failure mode is measurement, not tooling. When the metric is activity, AI lets you hit it without creating value — and worse, optimizing for it actively rewards the wrong behavior: splitting PRs to inflate the count, generating code nobody needed, mistaking motion for progress. You get a team that looks more productive on every chart while the business outcome it was supposed to move stays flat.

The fix is to measure the thing the activity was always a proxy for: outcomes. Did the change reach production safely? Did it move the metric the team owns? Did the customer get something better? Measure that at the team level, never the individual — the moment you rank people by AI-inflated output, you teach them to game it.

When output gets cheap, counting it tells you less than ever. The only metric that survives AI is the one tied to an outcome someone actually wanted.

Tags
engineering-leadershipai-transformationsystems-thinkingmetrics
Notes by email

The weekly read on signals shaping AI, engineering, and regulated systems — once a week, in your inbox.

One email a week. No spam. One-click unsubscribe.