Multi-Agent Orchestration

Coordinating multiple specialized AI agents — planners, generators, evaluators, reviewers — with defined roles, handoffs and adversarial checks to overcome single-agent failure modes.

Also known as: multi-agent system, multi-agent, subagents, sub-agent, subagent workflows, Agent Strike Team, planner / generator / evaluator (three-agent harness), generator / evaluator (GAN-inspired pattern), evaluator agent, adversarial review, cross-family review, Rubber Duck, self-evaluation leniency, Supervisor, fleet orchestration, fleet scale / multi-agent workflow, swarm coding, agent swarms, remote agents / agent-team, Freudian architecture, orchestrator, Grace, agentic stack

Cognitive Locality

How authors use it

Oldest first (extraction date when no publication date is known).

AuthorTheir termTheir meaning
Claude Code: Best practices for agentic coding
anthropic.com · 2025-04-18
subagentsSecondary Claude instances the main agent spawns to verify details or investigate specific questions — used especially early in a task to preserve the main context window without much efficiency loss, and to check that an implementation isn't overfitting to its tests
GitHub Copilot CLI combines model families for a second opinion
Nick McKenna · 2026-02
Rubber DuckA focused review sub-agent powered by a model from a different AI family than the primary orchestrator, invoked at key checkpoints to critique the agent's plan and work.
GitHub Copilot CLI combines model families for a second opinion
Nick McKenna · 2026-02
cross-family reviewHaving a model from a different training lineage (e.g., GPT-5.4 reviewing Claude's work) to surface blind spots that same-family self-reflection cannot.
GitHub Copilot CLI combines model families for a second opinion
Nick McKenna · 2026-02
orchestratorThe primary model driving the coding agent session, selected by the user from the model picker.
11) AI-spesial med Vilde Opsal og Anders Sveen
Truls Jørgensen og Audun Fauchald Strand — Heis Podcast · 2026-02-16
remote agents / agent-teamVilde's near-term vision: not one agent paired with one human, but multiple agents (dependency police, vulnerability watch, code-review, consistency) running in parallel as teammates
Harness design for long-running application development
anthropic.com · 2026-03-24
Self-evaluation leniencyThe empirical tendency of an agent asked to grade its own output to praise the work confidently even when quality is mediocre. Especially pronounced for subjective tasks lacking binary verification, but also present on verifiable tasks. Not fully eliminated by separating evaluator from generator, but greatly reduced.
Harness design for long-running application development
anthropic.com · 2026-03-24
Generator / Evaluator (GAN-inspired pattern)An agent architecture borrowed conceptually from Generative Adversarial Networks: one agent produces, a separate agent grades against explicit criteria and writes critique, feedback flows back to generator for next iteration. Author concedes the evaluator is itself an LLM still 'inclined to be generous,' but separating it makes skepticism tractable.
Harness design for long-running application development
anthropic.com · 2026-03-24
Planner / Generator / Evaluator (three-agent harness)The Anthropic-Labs canonical architecture: planner expands a short user prompt into a full product spec; generator builds in sprints (V1) or continuously (V2) against the spec; evaluator drives the running app via Playwright MCP and grades against criteria with hard thresholds, returning detailed feedback.
[MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796
stellaraccident (via https://github.com/anthropics/) · 2026-04-02
fleet scale / multi-agent workflowRunning 50+ concurrent Claude Code agent sessions doing systems programming, each autonomous for 30+ minutes. This is the workflow that collapsed when thinking depth was reduced.
Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development
Leela Kumili · 2026-04-06
evaluator agentA separate AI agent whose sole job is to judge the generator's output using predefined criteria and few-shot examples; it navigates live pages and provides detailed critiques rather than passively reviewing text
Scaling Uber with Thuan Pham (Uber's first CTO)
The Pragmatic Engineer · 2026-04-10
swarm codingOrchestrating multiple AI coding agents working in parallel on related tasks, requiring multi-threaded thinking from the human engineer
Charlie Hills 🦩's Post
Charlie Hills 🦩 · 2026-04-16
subagentsParallel Claude Code agent instances that can handle separate tasks concurrently
Accelerating Delivery: How AI Agents Can Own the Initial Code Draft
Stephen Walker · 2026-04-20
Agent Strike TeamA multi-agent system with specialized roles (planner, architectural reviewer, coder, review agent) that uses internal adversarial feedback loops to produce quality output
Inside Claude Code Auto Mode: Anthropic's Autonomous Coding System with Human Approval Gates
Leela Kumili · 2026-04-20
subagent workflowsScenarios where Claude Code delegates tasks to subordinate agents, creating a chain of execution that needs its own safety checks
Henrik Kniberg's Post
Henrik Kniberg · 2026-04-20
GraceA higher-level coordinating agent that handles stakeholder requests end-to-end (Slack to PR), coordinates other agents, acts proactively, and improves itself by editing the platform it runs on
Radar Trends to Watch: May 2026
Mike Loukides and Claude · 2026-04-20
agentic stackA three-layer architecture (orchestration, execution, review) composed of interchangeable modules for building AI agents
Genie Lessons: Nobody Wants Agents
Kent Beck · 2026-04-23
Freudian architectureBeck's name for the coordinator/implementer/verifier pattern in multi-agent systems — id (rushes ahead), superego (checks/blocks), ego (negotiates between them)
[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero
AI Engineer (channel); speaker: Matt Pocock (AI Hero) · 2026-04-24
sub-agentAn LLM call delegated to an isolated context window that returns only a summary to the parent. Pocock uses it to spend ~94k tokens on exploration without polluting the orchestrator's smart zone.
Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab
Leela Kumili · 2026-05
SupervisorA LangGraph orchestration node that classifies incoming requests, routes them to specialized agents, and controls inter-agent communication and task delegation. Implementation-specific (LangGraph supervisor pattern), not a generic notion.
Project Glasswing: what Mythos showed us
Grant Bourzikas · 2026-05-18
Adversarial reviewPutting a second agent — with a different prompt, a different model, and no ability to emit its own findings — between the initial finding and the queue, deliberately disagreeing with the first agent.
The Production Gap: 5 Patterns for Building Long-Running AI Agents
Addy Osmani and Shubham Saboo (Google Cloud), published in Turing Post · 2026-05-22
Fleet orchestrationManaging multiple long-running agents as a coordinated whole: a coordinator agent decomposes work to specialists (research/scoring/sequencing/outreach/follow-up), each independently versioned with its own identity, tool permissions, and registry entry.
Agent Tools & Interoperability
Kanchana Patlolla, Łukasz Olejniczak, Pier Paolo Ippolito · 2026-06-10
OrchestratorThe role a developer or central agent occupies once protocols remove the need for bespoke integration code: directing high-level intent, discovering and delegating to specialist agents/tools, rather than hand-wiring every connection.
Have your agent record video demos of its work with shot-scraper video
Simon Willison (Simon Willison's Newsletter) · 2026-06-30
cross-family reviewHabitually having one lab's best model review another's output (Anthropic's model reviews OpenAI's work and vice versa) because differing blind spots surface real issues.
The new GPT-5.6 family: Luna, Terra, Sol
Simon Willison · 2026-07-10
Multi-agent (subagents in the core API)A new API feature letting the model spin up subagents for parallel, focused work — the sub-agent pattern now baked into the core API rather than the harness
How to Manage Privilege Drift in Multi-Agent Systems
Janet Wagner · 2026-07-14
Multi-agent system (MAS)Multiple autonomous AI agents working together to complete tasks or solve problems, where the fact of collaboration (shared resources, inter-agent communication, a shared outbound channel) is precisely what multiplies privilege drift beyond the single-agent case.
The Orchestrator's Tax
Rahul Garg (martinfowler.com; edited/guided by Martin Fowler) · 2026-07-28
OrchestratorThe main AI session/thread that spawns and coordinates subagents — the only part of the system that accumulates understanding across a session (design rationale, constraints, prior trade-offs) and therefore the locus that must be protected.
What's an Orchestrator—and Why Does Software Need One?
Tim O'Brien · 2026-08-17
OrchestratorA person who directs delegated-intelligence systems and agentic tools toward production outcomes — technically capable of writing the code themselves but whose job is oversight, direction, and accountability rather than authorship. Contrasted with both 'developer' and 'architect.'

Documents (85)

Propositions touching this concept (123)

By publication month, oldest first (extraction month when no publication date is known).

2024-04

2025

2025-04

2025-09

2025-10

2025-12

2026-02

2026-03

2026-04

2026-05

2026-06

2026-07

2026-08

2026-09

2026-10

Tensions

What replaces PRs?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
Assessment: Three axes of disagreement. (1) How much PR ritual to keep — Laforgia Four Eyes keeps the artefact-shape via trailers; Siessegger keeps PR for solo exceptions; Stepanović eliminates the PR-as-event entirely. (2) Whether to engage AI as part of the answer — Kniberg pushes furthest; Parker names the problem; Beck provides the theoretical basis for why the social architecture around the LLM determines the answer. (3) What the unit of value is — for Laforgia it's the evidence of control; for Stepanović it's throughput; for Beck it's trust accumulation; for Kniberg it's human cognitive bandwidth. The Kniberg position (agent-authored PRs, human verifier) is now further complicated by Beck: a human reviewing an agent's PR alone is in single-player mode — trust-negative even when the compliance and quality boxes are checked. Kniberg's more expansive vision (humans focused on higher-level design in a multi-agent team) may preserve trust; the PR-as-solo-review-act does not.
What is code review primarily FOR?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
Assessment: Beck's addition is the most significant divergence contribution in v2. He fills the 'review-as-cultural-induction' gap the original panel flagged: pairing produces trust-as-induction (the practitioner is changed by being held accountable in structural ways) rather than merely information-transfer-as-induction. This is not in conflict with the other positions — it provides the mechanism that makes those answers work and sustainable. Quality (Siessegger/Stepanović), compliance (Laforgia), and verification (Kniberg) are all downstream of trust accumulation, on Beck's account. The live disagreement is no longer simply 'PR vs not PR' — it is: if trust is the primary function, and trust requires person-to-person interaction that cannot be manufactured by code artefacts or automated review, what is the minimum set of practices that preserves trust in the AI-augmented era? Architecture-coherence review (the senior reviewer who refuses design-wrong changes) remains unaddressed by all panel members including Beck.
Is AI-accelerated coding a feature or a threat to existing workflows?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
Assessment: Beck triangulates between Parker (threat) and Kniberg (feature) with the most analytically precise position in the corpus: the social architecture around the LLM determines whether it's a trust factory or a trust destroyer. This has a direct implication for the PR question: AI-authored code reviewed by a solo human is the worst configuration — two single-player failure modes stacked (AI authoring + human solo review). The crucial remaining gap: no one has produced a synthesis treatment that combines Stepanović's Reinertsen math with Beck's trust-asymmetry argument and Kniberg's agent-as-author shift. Stepanović's framework directly implies AI in-context review could be a near-zero-cost reviewer; Beck's framework implies that same review is trust-negative if done solo. The two arguments together demand a configuration — team-mediated AI code review — that none of the panel members has yet theorised.
Is high-performing software practice context-independent?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
Assessment: Parker is the lone explicit voice for context-dependence. Beck's trust factory framing is implicitly universalist — but his unaddressed gaps echo Parker's concern from a different angle: if trust factories only work in pre-existing high-trust organizational contexts, the adoption prescription fails precisely where it is most needed.
How much of the build pipeline should run with no human reading the code (the 'dark factory')?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Not simple optimism vs pessimism but a disagreement about preconditions and hidden costs. Ocytko's is a projection of where tooling is heading; Bangser and Verraes both supply reasons the projection is unsafe by default — learning-loss and missing prerequisites. Bangser has the stronger argument that the loss is structural (you cannot buy back organisational learning), which even an improving platform does not address.
How far can day-2 operations be handed to self-healing / autonomous remediation?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Ruby's report is descriptive (where practice actually stands) and Ocytko's is aspirational (where platforms could go); the gap between 'remediation is withheld' and 'failure modes disappear' is precisely the distance the optimists are projecting across. Bangser supplies the reason the gap may not close on efficiency grounds alone — the withheld human step is also the learning step.
Should the harness/platform-building function be centralised, or emerge per-team?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: A precise split about the organisational form of the scaffolding, not its existence: both want shared architecture guidance, but Edwards-Alexander wants the building capability distributed (friction as feature) while Ocytko wants it concentrated in a platform (constraint as feature). Each concedes the other's pole — Edwards-Alexander keeps a central harness; Ocytko warns against over-constraining — which is why this is a live, unresolved tension rather than a clean contradiction.
Reversibility as a hedge vs a one-way commitment to deeper autonomy.
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Incompatible risk models. Verraes treats deep AI-dependence as the danger to insure against; Herlein treats not-committing as the existential danger. They cannot both be the rational strategy: reversibility trades some upside for exit options, while flywheel-commitment trades exit options for compounding lead. The tie-breaker is empirical (will access/economics deteriorate?) and neither has evidence — Fowler's 'tokenpocalypse' data leans slightly toward Verraes.
Where is the locus of safety for non-engineers / citizen developers building software?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
Assessment: Four different answers to the same governance question: the platform (Ocytko), the director's discipline (Ruby), the tooling interface (Bangser), or nobody-knows-yet (Ördög). Ruby and Ocytko are the true opposites — Ruby puts the burden on a human management skill, Ocytko designs the human out by making failure modes disappear in the platform. That both are held by attendees of one retreat is a measure of how unsettled the citizen-developer problem is.
Can harness engineering actually solve the AI code quality problem?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
Assessment: This is the central divergence in the literature. Osmani is most optimistic, operating from benchmark evidence that harness changes produce dramatic improvements on coding tasks. Böckeler occupies the middle ground, distinguishing solvable from unsolved harness domains. Beck is most skeptical, questioning whether harnesses address the root cause at all. The disagreement is partly empirical (what do the benchmarks actually measure?) and partly about scope (Osmani focuses on task completion; Beck focuses on long-term code value including flexibility). They may not be contradicting each other so much as talking about different time horizons: harnesses help with immediate task success, but the tarpit emerges over accumulated changes.
What is the right metaphor for the human-AI relationship in coding?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
Assessment: These metaphors are not mutually exclusive but they lead to different design decisions. Garg's teammate metaphor emphasizes collaboration rituals and may underplay the need for hard constraints (you don't sandbox a teammate). Böckeler's governor metaphor is the most theoretically rigorous but may overclaim the applicability of control theory to creative work. Osmani's engineering metaphor is the most actionable but may miss the social and organizational dimensions. Thoughtworks' organizational metaphor captures the broadest scope but is the hardest to operationalize.
Will better models make current harness practices obsolete?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
Assessment: Osmani makes the strongest case for permanence with concrete evidence of scaffolding migration. Beck keeps the door open for the Bitter Lesson hypothesis. The truth likely depends on the type of harness: mechanical safeguards (sandboxes, permission controls) may always be needed, while knowledge-transfer patterns (AGENTS.md, priming docs) may become less necessary as models improve at in-context learning.
Is the model a swappable, commoditized component (so selection is a cost decision), or is model choice load-bearing (so selection is a capability decision)?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: Both camps are right about different task strata, and the tie is broken by the routing camp's own artifact. Commoditization holds on the bulk/background tier (musistudio and the Pragmatic Engineer are correct that a cheap or open model suffices for a large share of tokens), but model choice is load-bearing exactly on the hard tier — the 'hardest 40%' the routing camp routes AWAY (the Pragmatic Engineer's own gap notes 60%-of-token-spend is not 60%-of-value). nrehiew's 6.5x over-editing spread and stellaraccident's collapse are measured on precisely that hard tier. The clincher the swap camp does not concede: musistudio's OWN per-model transformers (tooluse, enhancetool, reasoning, deepseek, gemini) prove the harness is NOT model-agnostic — every model needs bespoke request/response rewriting just to work behind Claude Code, so the 'any model' artifact self-refutes. Delangue even concedes the frontier gap himself. Verdict: select cheap-and-swappable for bulk, and treat the model as a load-bearing capability decision for the hardest slice — the two positions are not competitors but a partition of the task distribution.
Context size: should you shrink the problem to fit a small usable window (decompose / reset), or grow and trust a large window?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: The apparent 'grow / trust the big window' position for CODING largely dissolves once retrieval is separated from coding — which is exactly Pocock's move ('good for retrieval, less good for coding') and musistudio's (longContext is a routed escalation, not the coding default). No text argues you should code inside a full 1M window. The only genuine pressure toward trusting a bigger window is the vendor-forward Fable 5 / Opus 4.6 claim that coherence loss is being engineered away — but that is a moving target (convergence 5), not a stable dial, and even the harness paper only relaxed context resets AFTER measuring that the new model no longer needed them. A secondary, live sub-dispute survives: reset vs compact. Pocock, the harness paper and best-practices favor clearing/resetting to a fresh agent; Hills and Osmani lean on compaction. The reset camp has the better argument on today's models — compaction preserves the same anxious agent — but the disagreement is real and unresolved. Verdict: shrink-and-decompose is the default for coding; grow only as an explicit retrieval escalation; prefer reset over compact unless the model version has demonstrably killed context anxiety.
Effort/reasoning: does more thinking make output better, or does more reasoning make it worse (over-engineering / over-editing)?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: This looks like a head-on collision but is really the corpus resolving a category error, so I keep it as a divergence-under-adjudication rather than a live two-camp fight. The two things bundled into one 'effort' dial are separable: reasoning DEPTH (deliberation and research before acting — what stellaraccident measures as the Read:Edit ratio) versus action SCOPE (how much the model rewrites — what nrehiew measures as over-editing). They are separable but DEFAULT-COUPLED: more reasoning, unconstrained, tends to produce more scope. nrehiew is the empirical bridge — constrained reasoning models are the MOST faithful, proving depth and tight scope combine positively when you address them separately. Fable 5 already acts on this, pairing 'reduce effort' with a distinct anti-over-engineering instruction. The actionable verdict: do NOT cut reasoning depth to fix over-editing (that is stellaraccident's exact grievance and it backfires into shallow, edit-first behavior); keep the depth and add an explicit scope constraint. The failure is treating one knob as if it controls both correctness-depth and edit-scope.
Who selects the model/effort/context — a human deciding per task, or an automatic router — and who is trusted to hold the dial?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: The human-vs-auto axis is less about capability than about (a) whether task difficulty can be detected a priori and (b) who bears the principal-agent risk. No router in the corpus actually measures difficulty — musistudio routes by token-count and static scenario, and the Pragmatic Engineer's routers infer 'good enough' without a demonstrated oracle — so 'auto' today means 'static-heuristic', not 'optimal'. Automation is safe when the user owns the policy (musistudio) and dangerous when the router profits from the choice (Cursor Auto) or when the provider adjusts the dial invisibly (stellaraccident). Verdict: keep the human holding the difficulty judgment and the effort dial until routers can both measure adequacy and prove neutral incentives; automate only the mechanical dispatch, over rules you own and can audit.
Should the harness/platform and its safety be centralized or left distributed across teams?
from: What is the future of software development in the agentic/AI age?
Assessment: A real operating-model split. Edwards-Alexander's distributed stance rests almost entirely on the DevOps-team analogy (his own extraction flags it as asserted-on-intuition, not argued), whereas the platform camp has the stronger concrete case for the citizen-developer safety problem — you cannot distribute production-data guardrails to non-engineers. The tension is partly reconcilable: Ocytko himself concedes a platform tight enough for non-engineers may be too constraining for expert engineers' identity and innovation, which is exactly the freedom Edwards-Alexander is protecting. The unresolved question is whether one platform can be both.
How far should software be automated — toward the fully-autonomous dark/software factory, or held back to bounded autonomy with humans in the loop?
from: What is the future of software development in the agentic/AI age?
Assessment: The spectrum runs from Ördög/Ocytko (full automation is arriving and desirable) to Bangser/Ruby/Verraes (deliberately withhold the last step). The decelerationists have the better of the safety argument today — Ruby's 'nobody will cede the blast radius' and Bangser's 'removing humans removes learning' identify concrete, unmet prerequisites — but Ördög's context-dependence (backends, COBOL) shows the boundary is domain-specific, not absolute. The real disagreement is less about capability than about who absorbs the blast radius when an autonomous fix goes wrong.
Is preserving human understanding of the system a first-order value, or is comprehension safely offloadable so long as output is verifiable?
from: What is the future of software development in the agentic/AI age?
Assessment: The optimist-practitioner vs. skeptic-humanist axis. Fowler and Nilsson treat comprehension and craft as intrinsic goods whose loss is a harm even when output is fine; Herlein and Ocytko treat comprehension as instrumental — replaceable by verification and platform guardrails. The humanist camp has the stronger long-run argument (Fowler's cognitive-debt case and Ocytko's own 'who-guards-the-guards' problem both show verification and guardrails are themselves fallible artifacts that someone must understand), but the offloadable camp is describing what is actually happening at scale. The crux is whether verifiability can ever be robust enough to make understanding optional — which Ruby's own Goodhart gap (a passable oracle diverging from true intent) suggests it cannot fully be.
How should newly-empowered citizen developers be made safe — constrained platform, human stewardship, or supported API-first tooling?
from: What is the future of software development in the agentic/AI age?
Assessment: All three agree citizen developers are inevitable and must not be blocked, but the safety mechanism differs — encode it in a constraining platform (Ocytko), transfer it through human relationships (Laycock), or expose it as consumable interfaces (Bangser). Ocytko's platform-first case is strongest on the specific failure mode both he and Ördög name (non-engineers leaking or bypassing production-data access), which stewardship alone cannot prevent at scale. Laycock's stewardship answers a different problem — sustaining the junior-to-senior pipeline — that a platform does not. The positions are complementary in principle but compete for the same finite investment, and none supplies a concrete governance model for vibe-coded shadow IT.

Open gaps (169)