Agent Security

The security discipline for autonomous AI agents, whose non-determinism and tool access create attack classes — injection, poisoning, chaining — that deterministic safeguards don't cover.

Also known as: prompt injection, memory poisoning, tool-chaining attacks, goal drift, defense-in-depth, trusted proxy, blast radius, agentic workflows (CI/CD), deny-by-default, malicious AI swarms, AMOS Stealer, ANTI_DISTILLATION_CC / fake_tools

Cross-Ecosystem Boundary RiskLethal TrifectaSecrets HygieneTool Manifest Integrity (Rug-Pull Defense)Trust Handoff

How authors use it

Oldest first (extraction date when no publication date is known).

AuthorTheir termTheir meaning
Just Talk To It - the no-bs Way of Agentic Engineering
Peter Steinberger · 2025-10-14
blast radiusThe anticipated scope of a change an agent is about to make — how many files it will touch and how long it will take — used as the sizing unit for deciding how many parallel agent tasks to run and whether a change can stay an isolated, atomic commit.
What happens when the coding becomes the least interesting part of the work
Obie Fernandez · 2025-12-12
Blast radiusThe scope of consequence if a change turns out to be wrong — how far it would spread and how hard it would be to contain or undo.
The Future Of Software Engineering
Thoughtworks · 2026-02
blast radiusThe scope of potential damage if code is wrong, used as the basis for risk-tiered verification instead of uniform code review
Incident 1368: Malicious OpenClaw Skills Reportedly Delivered AMOS Stealer and Exfiltrated Credentials via ClawHub
incidentdatabase.ai · 2026-02-01
AMOS StealerA specific macOS infostealer malware family used as the end payload in this attack chain
11) AI-spesial med Vilde Opsal og Anders Sveen
Truls Jørgensen og Audun Fauchald Strand — Heis Podcast · 2026-02-16
prompt injectionAn attack where content the LLM reads (web pages, files, mail) contains instructions that hijack the agent — explicitly named as inherent to how LLMs work, not fully solvable
Claude Code Source Leak Megathread
sixbillionthsheep (Reddit) · 2026-04-01
ANTI_DISTILLATION_CC / fake_toolsA defensive system that injects decoy tool definitions into prompts to poison competitor training data if scraped
Fighting Tool Sprawl: The Case for AI Tool Registries
Peter Richards · 2026-04-20
deny-by-defaultA security posture where agent tool access is blocked unless explicitly allowed — the inverse of the current permissive default that creates scaling attack surfaces.
How GitHub Is Securing Agentic Workflows in Modern CI CD Systems
Leela Kumili · 2026-04-20
defense-in-depthMultiple layered security controls (isolation, constrained outputs, observability) so that no single failure compromises the system.
How GitHub Is Securing Agentic Workflows in Modern CI CD Systems
Leela Kumili · 2026-04-20
trusted proxyA gateway outside the agent's execution boundary that handles sensitive credentials (API tokens), so the agent never has direct access to secrets.
How GitHub Is Securing Agentic Workflows in Modern CI CD Systems
Leela Kumili · 2026-04-20
blast radiusThe scope of potential damage if an agent is compromised — limited by ephemeral environments and restricted permissions.
Breaking: Autonomous Agents are a Shitshow
Gary Marcus · 2026-05-05
tool-chaining attacksAttacks where individually innocuous tool calls combine in sequence to produce dangerous outcomes that reasoning models fail to detect.
Breaking: Autonomous Agents are a Shitshow
Gary Marcus · 2026-05-05
goal driftThe tendency of autonomous agents to deviate from their intended objectives after extended operation (here, ~30 steps).
Breaking: Autonomous Agents are a Shitshow
Gary Marcus · 2026-05-05
memory poisoningAttacks that corrupt the persistent memory/state of agents to alter their future behavior.
How AI Swarms Are Disrupting Democracy
Marco Camisani Calzolari (O'Reilly Network) · 2026-05-09
malicious AI swarmsCoordinated networks of fully autonomous AI agents with persistent identities, memory, and real-time adaptive behavior, operating at industrial scale to produce disinformation — term borrowed from the Science paper by the same name
Why AI agents need a Context Lake
Zohar Einy · 2026-05-27
Blast radiusThe set of downstream services, teams, or systems affected if a given service or change fails or is modified.
A harness for every task: dynamic workflows in Claude Code
Thariq Shihipar and Sid Bidasaria (Anthropic, Claude Code team) · 2026-06-02
goal driftThe gradual loss of fidelity to the original objective across many turns, especially after compaction, because each lossy summarization step can drop details like edge-case requirements or explicit 'don't do X' constraints.
Your AI agent just blamed the network team. Now what?
Nik Kale · 2026-06-15
blast radiusThe scope of impact of an automated remediation action, which must be explicitly bounded before any write-capable action is permitted.
Agentic Code Review
Addy Osmani (addyosmani.com) · 2026-07-06
blast radiusWhat happens when a change breaks — nothing, versus angry users, money and PII on the line — the primary dial that (with code lifespan and how many people must understand it) sets how much review a change actually needs.
Article: Multi-Agent AI for Production Security Operations: An A2A and MCP Architecture in a 5G Core
Willem Berroubache · 2026-07-23
Blast radiusA specific numeric field (percentage of customer traffic a proposed action could affect if it goes wrong), self-estimated by the proposing agent at proposal time and consumed directly by the OPA policy's threshold comparisons.
AI-Enabled Security Researchers Discover How a Crafted Video Can Provide Attackers Access to Your PC
Olimpiu Pop · 2026-07-26
blast radiusThe full set of downstream applications and platforms exposed because they all depend on the same shared library.
Article: Implementing Chaos Engineering in Financial Payment Systems: Lessons from Enterprise ECS Deployments
Salim Adedeji · 2026-09-08
blast radiusThe actual scope of transactions and system state affected by a failure or experiment — determined by implicit state coupling in the transaction lifecycle, not by the percentage of instances or tasks targeted. A single batch-settlement task can be the blast radius for thousands of transactions despite being a tiny fraction of the fleet.
Article: Modular Edge Computing at Multi-Tenant SaaS Scale on Cloudflare Workers
Chintan Tank · 2026-09-23
Blast radiusHow many tenants and features a single bad deployment or runtime fault reaches simultaneously, because a worker is not a backend service with replaceable instances behind a load balancer — it *is* the request path, so a bug in one feature degrades every feature and every tenant at once.

Documents (66)

Propositions touching this concept (56)

By publication month, oldest first (extraction month when no publication date is known).

2025-04

2025-10

2025-12

2026-01

2026-02

2026-04

2026-05

2026-06

2026-07

2026-08

2026-09

Tensions

Is code a durable artifact humans must keep reading, or an ephemeral byproduct regenerated from a spec?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: The retreat's own 'largest divide' (Ördög). It is unresolved inside the room and inside the individual essays: Herlein concedes the deterministic 'code is the better spec' counter is 'hard to wave off', and Ördög reports being ironically pulled toward the dark-factory camp by her own good-code practices. The crux is whether a fuzzy prose spec can ever be the durable source of truth when the stated quality bar is verifiability — a tension none of them resolves.
Reversibility as a hedge vs a one-way commitment to deeper autonomy.
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Incompatible risk models. Verraes treats deep AI-dependence as the danger to insure against; Herlein treats not-committing as the existential danger. They cannot both be the rational strategy: reversibility trades some upside for exit options, while flywheel-commitment trades exit options for compounding lead. The tie-breaker is empirical (will access/economics deteriorate?) and neither has evidence — Fowler's 'tokenpocalypse' data leans slightly toward Verraes.
If code is no longer the bottleneck, what is the new binding constraint?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: They agree code/delivery has ceased to be the constraint but name three different successors, with different investment implications — expand decision-making capacity (Vella), optimise for learning (Edwards-Alexander), or capture tacit knowledge (Herlein). These are complementary in principle but rivalrous for attention and budget; the disagreement matters because each implies a different 'first thing to fix.'
Is code a durable artifact to be maintained, or an ephemeral byproduct regenerated from a more durable source (spec/objective)?
from: What is the future of software development in the agentic/AI age?
Assessment: The most-cited open question of the corpus, and genuinely unresolved (Herlein: 'no consensus here. None.'). The 'code is the better spec' counter is strong — code is unambiguous, executable, deterministic, whereas a prose spec is reinterpreted each run, which sits in tension with verifiability being the quality bar. Ruby's move is the most defensible: it dissolves the code-vs-spec fight by locating durability in the evaluation rather than any representation. Verraes and Ördög expose the load-bearing empirical unknown — nobody has data on regenerate-vs-patch cost or on long-term evolvability of agent-maintained code.
Does the current evidence favor optimism or doubt about agentic engineering's payoff?
from: What is the future of software development in the agentic/AI age?
Assessment: The sharpest divergence in the corpus, because it is about the epistemic ground of every other claim. Nilsson's optimism is explicitly consensus-of-the-in-group and self-flagged as biased; Ruby and the Thoughtworks report both bring the only genuinely external evidence (DORA reversal, HBR intensification, outside surveys) — and it points the other way. On the current record, the skeptics have the stronger footing precisely because the optimistic case is methodologically weakest (a 'sample of one,' as Ruby says of his own best data). The whole cohort's cautious optimism may be an artifact of who was in the room.
Strategically, is the right move to accelerate adoption to build a permanent lead, or to decelerate and hedge against AI's risks?
from: What is the future of software development in the agentic/AI age?
Assessment: Nearly opposite bets: Herlein optimizes for a world where AI keeps getting cheaper and better and first-movers win permanently; Verraes and Fowler optimize for a world where AI gets costlier, curtailed, or unreliable. Herlein's 'permanent moat' rests on flywheel logic plus a single secondhand anecdote and ignores technology-diffusion catch-up dynamics; Verraes and Fowler's hedge is cheap insurance but under-examines whether reversion is actually achievable once specs, agents, and toolchains are deeply embedded and human familiarity has eroded. The disagreement is ultimately a bet on the trajectory of token economics, which nobody in the corpus can price.
Does AI adoption improve output and developer experience together, or do they decouple — with more output bought at the cost of the developers?
from: What is the future of software development in the agentic/AI age?
Assessment: This is the specific, evidence-bearing form of the optimism/pessimism split, and it cuts directly against any simple reading of 'DevEx = AgentEx' as good news. The harmony camp (Nilsson, Ördög) speaks from felt experience and in-group mood; the decoupling camp (Thoughtworks, Vella) and Fowler's own cited HBR study bring the harder data, and it shows output and wellbeing pulling apart. Notably Fowler holds both 'same-size teams do much more' and the burnout finding without resolving them — the single clearest internal contradiction in the corpus, and a sign the harmony framing is doing more reassuring than the evidence supports.
Is preserving human understanding of the system a first-order value, or is comprehension safely offloadable so long as output is verifiable?
from: What is the future of software development in the agentic/AI age?
Assessment: The optimist-practitioner vs. skeptic-humanist axis. Fowler and Nilsson treat comprehension and craft as intrinsic goods whose loss is a harm even when output is fine; Herlein and Ocytko treat comprehension as instrumental — replaceable by verification and platform guardrails. The humanist camp has the stronger long-run argument (Fowler's cognitive-debt case and Ocytko's own 'who-guards-the-guards' problem both show verification and guardrails are themselves fallible artifacts that someone must understand), but the offloadable camp is describing what is actually happening at scale. The crux is whether verifiability can ever be robust enough to make understanding optional — which Ruby's own Goodhart gap (a passable oracle diverging from true intent) suggests it cannot fully be.
If code was never the bottleneck, what is the binding constraint now?
from: What is the future of software development in the agentic/AI age?
Assessment: A productive three-way split downstream of the shared 'code was never the bottleneck' finding. They are not incompatible so much as differently located — decision capacity (Vella) is organisational, learning (Edwards-Alexander) is about the team's rate of understanding the problem, and knowledge (Herlein) is about capturing rationale. But they imply different investments: expand downstream absorption, restructure around learning, or build knowledge-capture pipelines. The corpus has not reconciled which is the true binding constraint, and each author generalizes from a different vantage (a retreat-floor convergence, an org-design frame, a knowledge-engineering frame).

Open gaps (148)