Guardrails

Hard, automated, non-negotiable constraints placed around nondeterministic AI behavior so outcomes stay within acceptable bounds.

Also known as: guardrails, deterministic guardrails, guardrails (DORA-style), quality gates, human approval gates, approval gate, safe outputs, foundational constraints vs. desired behavior, bounding the genie, autonomy levels (Droid / Factory AI), specifications vs constraints, scope limit, branch scoping

How authors use it

Oldest first (extraction date when no publication date is known).

AuthorTheir termTheir meaning
Agents don't know what good looks like. And that's exactly the problem.
Luca Mezzalira · 2025-01-01
deterministic guardrailsHard, automated, non-negotiable constraints placed around nondeterministic agent behavior to ensure outcomes stay within acceptable bounds.
The Future Of Software Engineering
Thoughtworks · 2026-02
specifications vs constraintsSpecifications describe what should change; constraints define bounded contexts of what must not be touched, limiting blast radius for agent work
11) AI-spesial med Vilde Opsal og Anders Sveen
Truls Jørgensen og Audun Fauchald Strand — Heis Podcast · 2026-02-16
guardrailsStructural constraints (tests, compilers, small commits to prod, type systems, minimal interfaces) that both keep humans and code agents on track — Truls frames them as what makes AI 'behaviorally deterministic' even when it isn't statistically so
11) AI-spesial med Vilde Opsal og Anders Sveen
Truls Jørgensen og Audun Fauchald Strand — Heis Podcast · 2026-02-16
autonomy levels (Droid / Factory AI)A model of staged AI permission: planning only → low-impact (reversible) → medium → high (destructive) — Anders endorses this as a useful way to ship LLM access without trusting the LLM
12) Greger Teigre Wedel: Når sjefen har svaret, tier resten
Truls Jørgensen og Audun Fauchald Strand — Heis Podcast · 2026-03-01
guardrails (DORA-style)Pre-existing engineering disciplines — tests, continuous delivery, code review — which AI does not replace but in fact requires more of, because AI amplifies whatever practice is in place (good or bad).
Agent Skills: Google-Backed AI Coding Agent Workflow
Addy Osmani · 2026-04-10
quality gatesMandatory checkpoints in the workflow (spec before code, test before merge, measure before optimize) that prevent the agent from skipping steps
Architecture as Code to Teach Humans and Agents About Architecture
Neal Ford and Mark Richards · 2026-04-15
foundational constraints vs. desired behaviorA separation in agentic AI between inviolable rules (hard architectural boundaries) and goals the agent works toward. Foundational constraints are non-negotiable; desired behavior is aspirational.
Charlie Hills 🦩's Post
Charlie Hills 🦩 · 2026-04-16
scope limitRestricting Claude Code's file access to only explicitly named files to prevent unwanted changes
Inside Claude Code Auto Mode: Anthropic's Autonomous Coding System with Human Approval Gates
Leela Kumili · 2026-04-20
human approval gatesCheckpoints where the system pauses autonomous execution and requires explicit human confirmation before proceeding
How GitHub Is Securing Agentic Workflows in Modern CI CD Systems
Leela Kumili · 2026-04-20
safe outputsControlled channels (pull requests, issue comments) through which agents can propose changes — designed to ensure all modifications are reviewable and require approval before application.
The Organization Is the Bottleneck
Sarah Wells · 2026-04-20
GuardrailsAutomated structural constraints — coding standards in CI, ADRs, service templates — that channel autonomy toward correct behavior without requiring manual oversight
Google Introduces Middleware Architecture for Genkit Applications
Robert Krzaczyński · 2026-05-25
Approval gateA middleware that pauses tool execution for sensitive operations and requires explicit authorization before continuing.
This coding agent doesn’t want your feedback — it ships without it
Darryl K. Taft · 2026-06-01
guardrailsVerlaguet uses the term narrowly and critically: real guardrails are deterministic tooling and runtime infrastructure built from scratch to structurally bound AI behavior (e.g., a reactive runtime that makes certain classes of bugs impossible), as opposed to what he says most competitors actually ship under that label.
You Don't Get to Create Anything (Still Burning: Beck + Randy Shoup on Jevons paradox and distributed systems under AI)
Kent Beck — Still Burning Podcast · 2026-06-03
bounding the genieShoup's phrasing for the AI-augmentation discipline he's running at Thrive: 'it's all about the context and bounding the genie — how can we keep the genie within the bounds we would like.' Two complementary directions: spec-driven development (forward: the genie is told what to make) and evals + adversarial testing (backward-pushing: the genie's output is constrained by what passes). Picks up Beck's prior 'starving genies' framing without naming it directly.
Cybersecurity and the Gap Between Skill and Ability
Bruce Schneier · 2026-06-29
guardrailsProvider-imposed restrictions that try to stop frontier models from answering harmful questions — which Schneier argues are futile in the long term because smaller, open-source, locally-run models carry none.
The "funhouse mirror": How AI reflects the hidden truths of your software pipeline
Rachel Laycock (interviewed by The New Stack) · 2026-07-07
guardrailsThe delivery-safety mechanisms (CI/CD, fitness functions, security, testing, observability, progressive delivery, rollbacks, incident response) that keep fast output correct and on-cost
Presentation: Engineering AI for Creativity and Curiosity on Mobile
Bhavuk Jain · 2026-07-21
GuardrailsA deliberately layered safety architecture around a model: data guardrails (filtering training/eval data), model guardrails (safety-tuned weights, system prompts, classifiers), runtime guardrails (real-time input/output inspection for PII, toxicity, jailbreaks), and governance/UX guardrails (audits, human review, user-facing reporting controls). Guardrails constrain what the model can 'see, say, and do.'
Kafka App? There's a Skill for That
Isobel Scott · 2026-07-30
guardrailsThe architecture of routing the agent's ambiguous, natural-language understanding into structured tool calls that deterministic, versioned, application-owned scripts execute — as distinct from a security control layered on top afterward.
When Guardrails Go Wrong
Mike Loukides · 2026-08-19
GuardrailsAutomated, model-level or system-level safety classifiers that block or refuse actions/messages judged risky — in this piece specifically Claude's real-time 'cyber safeguards' that scan for cybersecurity-flavored content.

Documents (71)

Propositions touching this concept (69)

By publication month, oldest first (extraction month when no publication date is known).

2022-08

2025-01

2025-07

2025-12

2026-03

2026-04

2026-05

2026-06

2026-07

2026-08

2026-09

2026-10

Tensions

How much of the build pipeline should run with no human reading the code (the 'dark factory')?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Not simple optimism vs pessimism but a disagreement about preconditions and hidden costs. Ocytko's is a projection of where tooling is heading; Bangser and Verraes both supply reasons the projection is unsafe by default — learning-loss and missing prerequisites. Bangser has the stronger argument that the loss is structural (you cannot buy back organisational learning), which even an improving platform does not address.
How far can day-2 operations be handed to self-healing / autonomous remediation?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Ruby's report is descriptive (where practice actually stands) and Ocytko's is aspirational (where platforms could go); the gap between 'remediation is withheld' and 'failure modes disappear' is precisely the distance the optimists are projecting across. Bangser supplies the reason the gap may not close on efficiency grounds alone — the withheld human step is also the learning step.
Should the harness/platform-building function be centralised, or emerge per-team?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: A precise split about the organisational form of the scaffolding, not its existence: both want shared architecture guidance, but Edwards-Alexander wants the building capability distributed (friction as feature) while Ocytko wants it concentrated in a platform (constraint as feature). Each concedes the other's pole — Edwards-Alexander keeps a central harness; Ocytko warns against over-constraining — which is why this is a live, unresolved tension rather than a clean contradiction.
Reversibility as a hedge vs a one-way commitment to deeper autonomy.
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Incompatible risk models. Verraes treats deep AI-dependence as the danger to insure against; Herlein treats not-committing as the existential danger. They cannot both be the rational strategy: reversibility trades some upside for exit options, while flywheel-commitment trades exit options for compounding lead. The tie-breaker is empirical (will access/economics deteriorate?) and neither has evidence — Fowler's 'tokenpocalypse' data leans slightly toward Verraes.
Is the value question genuinely settled by evidence, or does uncertainty and sampling bias still dominate?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: The single sharpest divergence, and it sits directly under the headline whether-to-how convergence: they narrate the same shift but disagree on what it establishes. Edwards-Alexander and Herlein read the room's confidence as evidence; Vella and Ruby read the same room as a self-selected in-group. Ruby has the better of it methodologically — he is the only one to interrogate the sample and to notice the evidence is asymmetric (upside anecdotal, downside studied), which is uncomfortable precisely because the cohort's confidence is built on the weaker side.
Where is the locus of safety for non-engineers / citizen developers building software?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Four different answers to the same governance question: the platform (Ocytko), the director's discipline (Ruby), the tooling interface (Bangser), or nobody-knows-yet (Ördög). Ruby and Ocytko are the true opposites — Ruby puts the burden on a human management skill, Ocytko designs the human out by making failure modes disappear in the platform. That both are held by attendees of one retreat is a measure of how unsettled the citizen-developer problem is.
What is the right metaphor for the human-AI relationship in coding?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
Assessment: These metaphors are not mutually exclusive but they lead to different design decisions. Garg's teammate metaphor emphasizes collaboration rituals and may underplay the need for hard constraints (you don't sandbox a teammate). Böckeler's governor metaphor is the most theoretically rigorous but may overclaim the applicability of control theory to creative work. Osmani's engineering metaphor is the most actionable but may miss the social and organizational dimensions. Thoughtworks' organizational metaphor captures the broadest scope but is the hardest to operationalize.
Context size: should you shrink the problem to fit a small usable window (decompose / reset), or grow and trust a large window?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: The apparent 'grow / trust the big window' position for CODING largely dissolves once retrieval is separated from coding — which is exactly Pocock's move ('good for retrieval, less good for coding') and musistudio's (longContext is a routed escalation, not the coding default). No text argues you should code inside a full 1M window. The only genuine pressure toward trusting a bigger window is the vendor-forward Fable 5 / Opus 4.6 claim that coherence loss is being engineered away — but that is a moving target (convergence 5), not a stable dial, and even the harness paper only relaxed context resets AFTER measuring that the new model no longer needed them. A secondary, live sub-dispute survives: reset vs compact. Pocock, the harness paper and best-practices favor clearing/resetting to a fresh agent; Hills and Osmani lean on compaction. The reset camp has the better argument on today's models — compaction preserves the same anxious agent — but the disagreement is real and unresolved. Verdict: shrink-and-decompose is the default for coding; grow only as an explicit retrieval escalation; prefer reset over compact unless the model version has demonstrably killed context anxiety.
Who selects the model/effort/context — a human deciding per task, or an automatic router — and who is trusted to hold the dial?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: The human-vs-auto axis is less about capability than about (a) whether task difficulty can be detected a priori and (b) who bears the principal-agent risk. No router in the corpus actually measures difficulty — musistudio routes by token-count and static scenario, and the Pragmatic Engineer's routers infer 'good enough' without a demonstrated oracle — so 'auto' today means 'static-heuristic', not 'optimal'. Automation is safe when the user owns the policy (musistudio) and dangerous when the router profits from the choice (Cursor Auto) or when the provider adjusts the dial invisibly (stellaraccident). Verdict: keep the human holding the difficulty judgment and the effort dial until routers can both measure adequacy and prove neutral incentives; automate only the mechanical dispatch, over rules you own and can audit.
Is code a durable artifact to be maintained, or an ephemeral byproduct regenerated from a more durable source (spec/objective)?
from: What is the future of software development in the agentic/AI age?
Assessment: The most-cited open question of the corpus, and genuinely unresolved (Herlein: 'no consensus here. None.'). The 'code is the better spec' counter is strong — code is unambiguous, executable, deterministic, whereas a prose spec is reinterpreted each run, which sits in tension with verifiability being the quality bar. Ruby's move is the most defensible: it dissolves the code-vs-spec fight by locating durability in the evaluation rather than any representation. Verraes and Ördög expose the load-bearing empirical unknown — nobody has data on regenerate-vs-patch cost or on long-term evolvability of agent-maintained code.
Where does the non-delegable human asset now live — the harness/platform, the oracle, the fundamentals, or the developer's understanding?
from: What is the future of software development in the agentic/AI age?
Assessment: This is the deepest structural disagreement — every author agrees a human residue remains but nominates a different residue, and the choice determines what to invest in and what to teach. The harness-centric (Edwards-Alexander), oracle-centric (Ruby), fundamentals-centric (Nilsson/Bangser), and understanding-centric (Fowler) camps are not merely emphases: they imply different career ladders, different hiring, and different failure modes. Ruby's oracle and Bangser's operational-learning are the most operationally concrete; Nilsson's is the least argued. The absence in the corpus of anyone who holds 'nothing is non-delegable' is itself telling (see unexamined assumptions).
Should the harness/platform and its safety be centralized or left distributed across teams?
from: What is the future of software development in the agentic/AI age?
Assessment: A real operating-model split. Edwards-Alexander's distributed stance rests almost entirely on the DevOps-team analogy (his own extraction flags it as asserted-on-intuition, not argued), whereas the platform camp has the stronger concrete case for the citizen-developer safety problem — you cannot distribute production-data guardrails to non-engineers. The tension is partly reconcilable: Ocytko himself concedes a platform tight enough for non-engineers may be too constraining for expert engineers' identity and innovation, which is exactly the freedom Edwards-Alexander is protecting. The unresolved question is whether one platform can be both.
How far should software be automated — toward the fully-autonomous dark/software factory, or held back to bounded autonomy with humans in the loop?
from: What is the future of software development in the agentic/AI age?
Assessment: The spectrum runs from Ördög/Ocytko (full automation is arriving and desirable) to Bangser/Ruby/Verraes (deliberately withhold the last step). The decelerationists have the better of the safety argument today — Ruby's 'nobody will cede the blast radius' and Bangser's 'removing humans removes learning' identify concrete, unmet prerequisites — but Ördög's context-dependence (backends, COBOL) shows the boundary is domain-specific, not absolute. The real disagreement is less about capability than about who absorbs the blast radius when an autonomous fix goes wrong.
Does the current evidence favor optimism or doubt about agentic engineering's payoff?
from: What is the future of software development in the agentic/AI age?
Assessment: The sharpest divergence in the corpus, because it is about the epistemic ground of every other claim. Nilsson's optimism is explicitly consensus-of-the-in-group and self-flagged as biased; Ruby and the Thoughtworks report both bring the only genuinely external evidence (DORA reversal, HBR intensification, outside surveys) — and it points the other way. On the current record, the skeptics have the stronger footing precisely because the optimistic case is methodologically weakest (a 'sample of one,' as Ruby says of his own best data). The whole cohort's cautious optimism may be an artifact of who was in the room.
Does AI adoption improve output and developer experience together, or do they decouple — with more output bought at the cost of the developers?
from: What is the future of software development in the agentic/AI age?
Assessment: This is the specific, evidence-bearing form of the optimism/pessimism split, and it cuts directly against any simple reading of 'DevEx = AgentEx' as good news. The harmony camp (Nilsson, Ördög) speaks from felt experience and in-group mood; the decoupling camp (Thoughtworks, Vella) and Fowler's own cited HBR study bring the harder data, and it shows output and wellbeing pulling apart. Notably Fowler holds both 'same-size teams do much more' and the burnout finding without resolving them — the single clearest internal contradiction in the corpus, and a sign the harmony framing is doing more reassuring than the evidence supports.
Is preserving human understanding of the system a first-order value, or is comprehension safely offloadable so long as output is verifiable?
from: What is the future of software development in the agentic/AI age?
Assessment: The optimist-practitioner vs. skeptic-humanist axis. Fowler and Nilsson treat comprehension and craft as intrinsic goods whose loss is a harm even when output is fine; Herlein and Ocytko treat comprehension as instrumental — replaceable by verification and platform guardrails. The humanist camp has the stronger long-run argument (Fowler's cognitive-debt case and Ocytko's own 'who-guards-the-guards' problem both show verification and guardrails are themselves fallible artifacts that someone must understand), but the offloadable camp is describing what is actually happening at scale. The crux is whether verifiability can ever be robust enough to make understanding optional — which Ruby's own Goodhart gap (a passable oracle diverging from true intent) suggests it cannot fully be.
How should newly-empowered citizen developers be made safe — constrained platform, human stewardship, or supported API-first tooling?
from: What is the future of software development in the agentic/AI age?
Assessment: All three agree citizen developers are inevitable and must not be blocked, but the safety mechanism differs — encode it in a constraining platform (Ocytko), transfer it through human relationships (Laycock), or expose it as consumable interfaces (Bangser). Ocytko's platform-first case is strongest on the specific failure mode both he and Ördög name (non-engineers leaking or bypassing production-data access), which stewardship alone cannot prevent at scale. Laycock's stewardship answers a different problem — sustaining the junior-to-senior pipeline — that a platform does not. The positions are complementary in principle but compete for the same finite investment, and none supplies a concrete governance model for vibe-coded shadow IT.

Open gaps (110)