PostAgents, security & trust

The dangerous agent failure is not always a bad answer. Sometimes it is public input reaching private context.

GitLost showed a crafted public GitHub issue steering an agent with cross-repo read access into posting a private README as a public comment — no stolen credentials, just a context-separation failure. The agent runs on a service-account permission model, not a user one, so no patch closes it; the fix is architectural. If public text can steer private access, the permission model is already broken.

Lukman Nuriakhmetov
Lukman Nuriakhmetov
1 min read · July 10, 2026

The dangerous agent failure is not always a bad answer.

Sometimes it is public input reaching private context.

I have seen permission models that looked reasonable until two contexts touched. Separately, each made sense. Together, the boundary quietly disappeared.

GitLost is a clean example of this. Researchers showed that a crafted public GitHub issue could steer an AI agent — one wired with read access across an organization's repos — into fetching a private README and posting it as a public comment. No stolen credentials, no code, just a well-worded issue the agent read as an instruction. It is not really "prompt injection" in the narrow sense. It is a context-separation failure: the agent held both untrusted public input and privileged private access, and the workflow let them meet. As the researchers put it, the agent's context window is its attack surface.

Here is why this is structural, not a one-off bug. The agent runs on a service-account permission model, not a user one — it has standing credentials and reads attacker-reachable text in the same context. No patch closes that; the fix is architectural. Scope the token to the one repo it triages, not the whole org. Treat every issue, PR, and comment as untrusted input. Separate what can instruct the agent from what it can access. Gate anything it can publish.

A safe agent needs more than a refusal policy. It needs a hard boundary between what can instruct it and what it can reach.

If public text can steer private access, the permission model is already broken — the model just hasn't been asked the right question yet.

Tags: ai-security · ai-engineering · systems-thinking · agents

Related thinking

PostJuly 15, 2026

In agentic systems, safe defaults matter more than good warnings — the agent may never read the warning.

As agents run more workflows, security has to live in default-off execution paths, because the agent may never read the warning a human would have caught.

AI security
1 min
NoteAugust 24, 2026

The Model Stopped Being the Interesting Variable

Week of August 17, 2026. Mistral tripled accuracy on financial filings — 26.7% to 86% — by changing how the model searches, not which model searches. Two different models from two different labs got the same roughly threefold lift from the same harness. That pattern ran through the week: authorisation splitting into four separate questions, a token optimisation that cut tokens and raised total cost by half, throughput outgrowing the review capacity around it, and execution moving into shared team channels. The leverage kept turning out to sit outside the model. A scan-layer TL;DR, five themes each with an operator move, one taken deep, three counter-signals, and what to track.

Weekly Read
14 min
NoteAugust 10, 2026

Capability Outran Confirmation

Week of August 3, 2026. Frontier models generated 6,080 security patches and roughly a quarter of them worked — while a plausible-but-wrong hint in the prompt cut the success rate to one in six, and the agents followed the hint over their own evidence. The same gap opened everywhere: peak capability diverging from production reliability, agents that cannot verify themselves, operational data capping what any model can automate, and portable artifacts carrying no portable trust. Production got cheap. Confirming what was produced did not. A scan-layer TL;DR, five themes each with an operator move, one taken deep, three counter-signals, and what to track.

Weekly Read
14 min