PostAI engineering & coding

We keep securing the model and trusting the scaffolding around it.

Every control we put on an agent lives in the harness — so once the agent can edit its own prompts, tools and memory, a harness change is a privileged production change.

Lukman Nuriakhmetov
Lukman Nuriakhmetov
1 min read · August 10, 2026

We keep securing the model and trusting the scaffolding around it.

That assumption breaks the moment the agent can edit the scaffolding.

Most agent architectures rest on a quiet division: the model is the untrusted part, and the harness — the prompts, the tools, the memory, the subagent definitions — is the infrastructure that constrains it. Every control we put on an agent lives in that layer.

The newer self-improving harnesses dissolve the division. When an agent can rewrite its own context assembly, register new tools, spawn subagents, and persist state that survives the session, it is no longer just producing answers. It is modifying the machinery that produces every later answer.

So a harness edit is not a runtime detail. It is a privileged production change, and it deserves what production changes get: a version, an author, a diff, a review path, an evaluation gate, and a rollback that actually restores the previous behaviour.

The alternative is not to freeze the harness — that forfeits the improvement. It is to let the agent propose changes in a sandboxed branch, and require the same evidence a human would need to merge one.

If the agent can change the thing that governs it, that thing is not a control any more.

Tags: ai-engineering · ai-governance · systems-thinking · agent-architecture

Related thinking

PostJuly 2, 2026

If an AI output is hard to evaluate, the problem may not be the eval. It may be the product boundary.

Good AI products make verification cheaper — decompose work into reviewable units, attach evidence, make the boundary between decided and inferred visible. Output that cannot be verified cheaply gets trusted blindly or ignored, and both are failures.

AI Engineering
1 min
NoteAugust 24, 2026

The Model Stopped Being the Interesting Variable

Week of August 17, 2026. Mistral tripled accuracy on financial filings — 26.7% to 86% — by changing how the model searches, not which model searches. Two different models from two different labs got the same roughly threefold lift from the same harness. That pattern ran through the week: authorisation splitting into four separate questions, a token optimisation that cut tokens and raised total cost by half, throughput outgrowing the review capacity around it, and execution moving into shared team channels. The leverage kept turning out to sit outside the model. A scan-layer TL;DR, five themes each with an operator move, one taken deep, three counter-signals, and what to track.

Weekly Read
14 min
NoteAugust 10, 2026

Capability Outran Confirmation

Week of August 3, 2026. Frontier models generated 6,080 security patches and roughly a quarter of them worked — while a plausible-but-wrong hint in the prompt cut the success rate to one in six, and the agents followed the hint over their own evidence. The same gap opened everywhere: peak capability diverging from production reliability, agents that cannot verify themselves, operational data capping what any model can automate, and portable artifacts carrying no portable trust. Production got cheap. Confirming what was produced did not. A scan-layer TL;DR, five themes each with an operator move, one taken deep, three counter-signals, and what to track.

Weekly Read
14 min