PostAgents, security & trust

In agentic systems, safe defaults matter more than good warnings — the agent may never read the warning.

As agents run more workflows, security has to live in default-off execution paths, because the agent may never read the warning a human would have caught.

Lukman Nuriakhmetov
Lukman Nuriakhmetov
1 min read · July 15, 2026

In agentic systems, safe defaults matter more than good warnings.

Because the agent may never read the warning.

As AI agents execute more setup, package, and tool workflows, security has to live in default-off execution paths, not optional caution.

I have seen developer workflows depend on a quiet assumption: a human will notice the suspicious step. The install script. The remote URL. The strange dependency. The unexpected command.

That assumption weakens fast when an agent runs the workflow instead of a person. npm turning off install scripts, git dependencies, and remote-URL installs by default is a useful signal — not because it solves supply-chain security, but because it moves the boundary the right way. The safe path becomes the default path, and risky execution has to be explicitly turned on. A warning assumes a reader who pauses. An agent working through a task does not pause at a comment; it acts on the path in front of it. So the protection cannot be advisory — it has to be the default the runtime enforces before the action runs.

The more we let agents act, the less we can rely on a human catching the one risky step in the stream.

A good guardrail is not one the agent promises to respect. It is one the runtime enforces before action.

Tags: ai-security · ai-engineering · systems-thinking · agent-safety

Related thinking

PostJuly 10, 2026

The dangerous agent failure is not always a bad answer. Sometimes it is public input reaching private context.

GitLost showed a crafted public GitHub issue steering an agent with cross-repo read access into posting a private README as a public comment — no stolen credentials, just a context-separation failure. The agent runs on a service-account permission model, not a user one, so no patch closes it; the fix is architectural. If public text can steer private access, the permission model is already broken.

AI Security
1 min
NoteAugust 24, 2026

The Model Stopped Being the Interesting Variable

Week of August 17, 2026. Mistral tripled accuracy on financial filings — 26.7% to 86% — by changing how the model searches, not which model searches. Two different models from two different labs got the same roughly threefold lift from the same harness. That pattern ran through the week: authorisation splitting into four separate questions, a token optimisation that cut tokens and raised total cost by half, throughput outgrowing the review capacity around it, and execution moving into shared team channels. The leverage kept turning out to sit outside the model. A scan-layer TL;DR, five themes each with an operator move, one taken deep, three counter-signals, and what to track.

Weekly Read
14 min
NoteAugust 10, 2026

Capability Outran Confirmation

Week of August 3, 2026. Frontier models generated 6,080 security patches and roughly a quarter of them worked — while a plausible-but-wrong hint in the prompt cut the success rate to one in six, and the agents followed the hint over their own evidence. The same gap opened everywhere: peak capability diverging from production reliability, agents that cannot verify themselves, operational data capping what any model can automate, and portable artifacts carrying no portable trust. Production got cheap. Confirming what was produced did not. A scan-layer TL;DR, five themes each with an operator move, one taken deep, three counter-signals, and what to track.

Weekly Read
14 min