Agent Harness
The code, config and execution logic wrapped around a model — prompts, tools, hooks, context management, feedback loops — and the engineering discipline of designing and evolving it.
Also known as: harness, harnesses, harness engineering, agent harness, harness (outer / user harness), harness (implicit), extension layer / harness, tool harness, scaffolding, agent scaffolding, orchestration layer, harnesse (en språkmodell), HaaS (Harness-as-a-Service), HaaS, environment, middleware, middleware (in Genkit), the factory, harness era / harness phase, harnessability, harness templates
Agent Harness Control PlaneAgent SkillsAgentic vs. Deterministic System DesignAgent Context Files (CLAUDE.md / AGENTS.md)HooksLoop Engineering
How authors use it
Oldest first (extraction date when no publication date is known).
| Author | Their term | Their meaning |
|---|---|---|
| Harness Engineering Birgitta Böckeler · 2026-02-17 | Harness | The tooling and practices — mixing deterministic approaches (linters, structural tests) and LLM-based approaches (context-providing agents, periodic 'garbage collection' agents) — used to keep AI coding agents in check and their output maintainable, adopted from OpenAI's and Mitchell Hashimoto's usage. |
| Agents Over Bubbles Ben Thompson (Stratechery) · 2026-03 | harness | The software layer that controls the model, manages tool use, and orchestrates agentic workflows (e.g., Claude Code). The harness is what differentiates agents from raw models. |
| The Anatomy of an Agent Harness Vivek Trivedy · 2026-03-10 | Harness | Every piece of code, configuration, and execution logic around a model that is not the model itself — defined by exclusion ('if you're not the model, you're the harness') specifically to force attention onto designing systems around model intelligence rather than drawing a messier internal boundary. |
| 13) Tobias K. Torrissen om kodekvalitet, konferanser og AI Truls Jørgensen og Audun Fauchald Strand — Heis Podcast · 2026-03-16 | harnesse (en språkmodell) | To wrap and constrain a language model so it produces code of quality matching the team's standards — explicit design context, ADRs, practices, observable feedback. Camp 2 in the taxonomy. |
| Harness design for long-running application development anthropic.com · 2026-03-24 | Harness | The orchestration scaffolding surrounding one or more Claude agents — agent roles, prompts, tools (MCPs), inter-agent communication mechanisms, and loop logic — that enables the model to perform a complex task that it cannot do in a single inference pass. Implicitly treated as a stack of removable 'components,' each encoding an assumption about a specific model weakness. |
| Claude Code Source Leak Megathread sixbillionthsheep (Reddit) · 2026-04-01 | Orchestration layer | The system wrapped around the model -- memory, tools, coordination, permissions, web search pipelines, session management -- as distinct from raw model capability |
| Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development Leela Kumili · 2026-04-06 | harness | A structured multi-agent workflow that coordinates distinct agents (planner, generator, evaluator) through defined handoffs — the scaffolding around the AI, not the AI itself |
| Don't train the model, evolve the harness Akshay · 2026-04-06 | harness | The complete non-model software wrapping the LLM — the runtime that feeds it context, runs its tool calls, and decides when a run ends; concretely the 12 components (orchestration loop, tools, memory, context management, prompt construction, output parsing, state, error handling, guardrails, verification loops, subagent orchestration). 'If you're not the model, you're the harness.' |
| Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering Chenyu Zhou, Huacan Chai, Wenteng Chen, Zihan Guo, Rong Shan, Yuanyi Song, Tianyi Xu, Congming Zheng, Jiachen Zhu, Zeyu Zheng, Zhuosheng Zhang, Xingyu Lou, Zhihui Fu, Jianghao Lin, Weinan Zhang · 2026-04-09 | harness engineering | The unification layer that coordinates memory, skills, and protocols into governed execution; the infrastructure that makes external modules reliable |
| Meta's new model is Muse Spark, and meta.ai chat has interesting new tools Simon Willison · 2026-04-10 | tool harness | The set of tools (browse, code interpreter, image gen, visual grounding, sub-agents, etc.) wired into a chat interface that extend a model's capabilities beyond text generation |
| Alex Wang's Post Alex Wang · 2026-04-16 | environment | The configuration and tooling layer surrounding Claude Code (CLAUDE.md, skills, hooks, plan mode) as opposed to the prompt itself |
| Generative AI in the Real World: Aishwarya Naresh Reganti on Making AI Work in Production Ben Lorica and Aishwarya Naresh Reganti · 2026-04-16 | harness | |
| Agent Harness Engineering Addy Osmani · 2026-04-20 | harness | Every piece of code, configuration, and execution logic that isn't the model itself — prompts, tools, context policies, hooks, sandboxes, subagents, feedback loops, and recovery paths |
| Agent Harness Engineering Addy Osmani · 2026-04-20 | harness engineering | The discipline of designing, iterating, and maintaining the scaffolding around an AI model so it can reliably complete tasks; coined by Viv Trivedy |
| Agent Harness Engineering Addy Osmani · 2026-04-20 | HaaS (Harness-as-a-Service) | The shift from building on LLM APIs (which give a completion) to building on harness APIs (which give a runtime with loop, tools, context management, hooks, and sandbox primitives) |
| Accelerating Delivery: How AI Agents Can Own the Initial Code Draft Stephen Walker · 2026-04-20 | Harness engineering | The practice of building autonomous agent workflows that handle end-to-end coding tasks, from ticket to PR — term attributed to OpenAI and Stripe |
| Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle Michael Parker · 2026-04-20 | the factory | The personal configuration of AI agents, rules files, MCP servers, sub-agents, and prompt engineering that a developer builds to orchestrate code generation — as opposed to writing code directly |
| Harness engineering for coding agent users Birgitta Böckeler · 2026-04-20 | harness (outer / user harness) | The user-configurable layer of guides, sensors, and feedback loops that a coding agent user builds around the agent, on top of the agent builder's built-in harness |
| Harness engineering for coding agent users Birgitta Böckeler · 2026-04-20 | harnessability | The degree to which a codebase's properties (type system, module boundaries, framework abstractions) make it amenable to effective harness controls |
| Harness engineering for coding agent users Birgitta Böckeler · 2026-04-20 | harness templates | Pre-defined bundles of guides and sensors matched to common service topologies (API services, event processors, dashboards), justified by Ashby's Law of Requisite Variety as a variety-reduction move |
| How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code) Lenny's Podcast · 2026-04-23 | harness | The product scaffolding (prompts, tools, UI) built around the model to elicit maximum capability from its current level |
| Developer Newsletter: higher usage limits, dreaming for Claude Managed Agents, and Claude Security Claude Team · 2026-05 | Extension layer / harness | The configuration, tooling, MCP servers, sub-agents, and skills wrapped around the model in a deployment — claimed to 'shape performance as much as the model does.' |
| The Week AI Grew Up AI Daily Brief · 2026-05-01 | agent harness | The surrounding product infrastructure (UI, orchestration, monitoring, context management) in which an AI model operates — distinct from the model itself |
| Hugging Face's Clem Delangue: Stop Comparing Engines to Cars Turing Post (Ksenia Se interviewing Clem Delangue) · 2026-05-02 | harness | The surrounding infrastructure around a model: tools, routing, prompts, agent frameworks, APIs. Harnesses built for proprietary APIs make local/open models appear weaker than they are. |
| Agent Skills Addy Osmani · 2026-05-09 | harness | The complete scaffolding around an AI model — prompts, tools, hooks, context policies, skills, session logs — that determines agent behavior; skills are one layer of this |
| How Claude Code works in large codebases: Best practices and where to start Claude · 2026-05-14 | Harness | The ecosystem built around the model — specifically five extension points (CLAUDE.md, hooks, skills, plugins, MCP servers) plus two additional capabilities (LSP integrations, subagents) — that the article argues determines Claude Code's large-codebase performance more than the model itself. |
| Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 | Harness | The orchestration layer around the model — a multi-stage pipeline of narrow, parallel, adversarially-validated agents (Recon, Hunt, Validate, Gapfill, Dedupe, Trace, Feedback, Report) that converts raw model output into actionable findings. Not a chat interface; closer to a distributed system in which the model is a component. |
| Bliki: Vibe Coding Martin Fowler · 2026-05-21 | Harnesses | The surrounding tooling/scaffolding around an LLM that shapes what it can do (linked to his harness-engineering article). |
| GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. https://github.com/Doorman11991/ · 2026-05-21 | harness (implicit) | The entire surrounding engineering layer — context manager, tool parser, planning system, model profiles, governor, escalation — that the project provides on top of a raw local LLM endpoint. Never named explicitly in the README, but every feature is justified as part of this layer. |
| Why Google Isn't Chasing Claude Code AI Daily Brief · 2026-05-21 | harness | The product/agent layer wrapped around a base model that turns it into a usable agent (e.g. Claude Code, Codex, Antigravity). Distinct from the model itself. |
| This Week in AI: Rethinking the Agent Harness Michelle Smith · 2026-05-22 | agent harness | The scaffolding around a model — tools, skills, control loops, environment integrations — that determines what the agent can actually do, exemplified by Claude Code. Treated as a layer distinct from both the model and the bespoke application. |
| This Week in AI: Rethinking the Agent Harness Michelle Smith · 2026-05-22 | harness era / harness phase | The latest stage in an evolutionary arc (document completion → chat loops → tool-calling agents → DAG workflows → harnesses) characterized by general-purpose, skill-driven agents. |
| Google Introduces Middleware Architecture for Genkit Applications Robert Krzaczyński · 2026-05-25 | Middleware (in Genkit) | A programmable interception layer inserted around generate() calls, model invocations, and tool execution within an agent's tool loop. Stackable, ordered, and inspectable via the Developer UI. |
| The New SDLC With Vibe Coding: From ad-hoc prompting to Agentic Engineering Addy Osmani, Shubham Saboo, Sokratis Kartakis · 2026-06-15 | harness | Everything around the model that turns a raw model into a working agent: instructions/rule files, tools, sandboxes, orchestration logic, guardrails/hooks, observability. Expressed as 'Agent = Model + Harness.' Team-owned surface area, not the model provider's. |
| Google Just Dropped a Masterclass on Agentic Engineering (It's SO Good) Cole Medin · 2026-06-24 | harness (10% / 90% split) | The model is only about 10% of what determines a coding agent's output; the remaining 90% is the harness — instructions, tools, guardrails, orchestration, observability — that the team, not the model provider, controls and can improve. |
| Software Design in the Agentic Age: Placing Your Bets aardling.eu · 2026-07-03 | harness engineering | Engineering the surrounding pipeline/tooling around agents to guarantee outcomes reliably, independent of adoption style. |
| Fragments: July 6 Martin Fowler · 2026-07-06 | harness engineering | The (newly named) discipline of building the scaffolding around models; notable here for how fast it arose — 'wasn't even a term in Utah' |
| Software Design in the Agentic Age: Place Your Bets Mathias Verraes · 2026-07-07 | harness engineering | Building and improving the scaffolding around agents to guarantee outcomes; broadly endorsed at the retreat regardless of agentic style |
| Viability of local models for coding Martin Fowler (martin@martinfowler.com) — memo by Birgitta Böckeler · 2026-07-07 | Harness | The coding agent tool (OpenCode, Pi, Claude Code) plus its own configuration (skills, MCP servers) wrapped around the model — a source of context-window overhead and tool-call schema variance that becomes a bigger constraint locally than in the cloud. |
| The Anatomy of an Agent Harness Akshay · 2026-07-08 | agent harness | The complete non-model software infrastructure wrapping an LLM — orchestration loop, tools, memory, context management, state persistence, error handling, guardrails, verification. 'If you're not the model, you're the harness.' The harness is the machinery; the 'agent' is the emergent goal-directed behavior it produces. Von Neumann framing: the harness is the operating system around the model-as-CPU. |
| ChatGPT Just Became A Work Agent AI Daily Brief (Nathaniel Whittemore) · 2026-07-11 | harness | The product layer wrapped around a foundation model — connectors to external systems (Notion, Google Drive, Microsoft 365), persistent/cloud execution, and enterprise access controls — that turns raw model capability into something usable for real knowledge work. |
| The Almedra Token-Efficiency Benchmark, Updated For GLM 5.2 Lucena.One · 2026-07-13 | harness (implicit: Lucena Coder, OpenCode, Copilot, Continue, Kilo Code, Pi) | The six competing coding-agent products/tools under test, each wrapping the identical GLM 5.2 model with its own prompting, context-management and tool-calling strategy. |
| Software Factories, Light and Dark AddyOsmani.com · 2026-07-20 | Harness | The walls around a loop: the sandbox it runs in, the tools it can reach, the memory that survives between runs, and the gates that decide what 'done' means. The loop is the behavior; the harness is the environment. |
| Fragments: July 21 Martin Fowler · 2026-07-21 | harness engineering | Named in the quoted Thoughtworks headline as 'emerging as a distinct, ownable discipline' — but Fowler does not himself define, elaborate, or return to the term anywhere in the body of this post. |
| Stop Overengineering Your Agent Harness Hugo Bowne-Anderson · 2026-07-22 | agent harness | The complete non-model software and infrastructure the LLM relies on at runtime — the 'body' to the LLM's 'brain' — covering the loop, tool execution, context management, state, and safety. |
| Addy Osmani's Post Addy Osmani · 2026-08-01 | harness | The environment, tooling and operating-system layer around the agent — the place quality control moves to once it can no longer live in human code review. Used interchangeably with 'environment' and 'operating system around the agent.' |
| Downstream #1: Where Do Our Tokens Go? Johannes Gehrke · 2026-08-01 | harness | The scaffolding wrapped around a model: the code that manages context, runs tools, and decides when to stop. Treated as a first-class variable, on par with or more important than the model itself, in determining both behavior (why an agent stalls) and cost. |
| Stop being skeptical about AI for development with Charity Majors Gergely Orosz (interviewing Charity Majors, CTO/co-founder of Honeycomb) · 2026-08-12 | harness | The engineering layer wrapped around a model (Claude Code, specifically) that turns raw model capability into usable, serious infrastructure — Majors treats the harness, not the underlying model, as the variable that actually flipped her assessment of AI's generational significance. |
| The AI-Native SDLC playbook Louis Claxton · 2026-08-21 | Harnessability (implicit contrast) | Not used by this author, but relevant: the piece never uses the word 'harness' at all, instead decomposing the same underlying concept into named components (CLAUDE.md, skills, hooks) treated as separate plays rather than as parts of a single named layer. |
| From AI Code to Trusted Software: Harness Engineering in Practice Travis Frisinger · 2026-09-04 | Harness engineering | The discipline of imbuing a repository with an organization's own standards so the repository itself enforces them: permissions/boundaries on what any actor may touch, quality gates that fail closed, evidence attached to every change, and observability that spans runs rather than moments. |
| Presentation: The Agent Harness: Control Planes, Invariants, and Approval Boundaries for Production AI Agents Vinoth Govindarajan · 2026-09-21 | Harness | The non-model system around the LLM that decides whether a model's proposal becomes a committed, provable production action — the layer that owns state, orders mutations, bounds work, constrains authority, and proves outcomes. Not just 'the code around the model' in a loose sense; specifically the boundary that holds production accountability the model itself cannot hold. |
| AI Sovereignty: Bargaining with Big Tech and the Promise of Full Stack Open Source AI Nicole Butterfield · 2026-09-22 | agent harness | The orchestration layer sitting above model weights, cited (via Mozilla CTO Raffi Krikorian) as where capability is now concentrating and which closed labs are 'welding shut' — making open harnesses (not just open weights) a key sovereignty battleground. |
Documents (86)
- 12-Factor Agents: Patterns of reliable LLM applications — Dex Horthy, HumanLayer AI Engineer · 2026-10-08 Reader 🖥️
Reliable production LLM agents are built not by adopting an agentic framework that hides the hard parts, but by applying ordinary software-engineering discipline — owning your prompts, your control flow (the loop/switch-statement/context-window triad), and your execution/business state — to what is fundamentally a stateless-function (LLM) called inside a small, deterministic, developer-controlled loop. - Agent Skills: Bridging AI and Senior Engineer Practices Addy Osmani · 2026-10-08 source ↗ Reader 🖥️
AI coding agents are capable junior engineers with no instinct for the invisible, non-diff parts of senior engineering — specs, tests, reviews, scope discipline, verification — so Agent Skills exists to make those parts structurally non-negotiable, because they are no longer optional even when the 'engineer' is a model. - AI Sovereignty: Bargaining with Big Tech and the Promise of Full Stack Open Source AI Nicole Butterfield · 2026-09-22 Reader 🖥️
Genuine AI sovereignty requires building and sustaining an interoperable, full-stack open-source AI ecosystem — spanning agent harnesses, inference engines, protocols, data stores, and observability tooling, not just open-weight models or vendor-branded 'sovereignty' offerings — because dependency and acquisition pressure persist at every layer that stays closed or commercially controlled. - Cloudflare Introduces the Agent Development Lifecycle to Replace Traditional SDLC Olimpiu Pop · 2026-09-21 source ↗ Reader 🖥️
Because AI models have made code generation fast, the bottleneck in software delivery has shifted downstream to testing, deployment, and maintenance, so Cloudflare argues the entire SDLC must be rebuilt as an event-driven 'Agent Development Lifecycle' — with Workflows as the orchestration primitive, OpenTelemetry-style observability into agent reasoning, and machine-speed security enforcement (short-lived scoped credentials plus a dynamically-narrowing 'Trust Ratchet') replacing human-paced review gates. - Presentation: The Agent Harness: Control Planes, Invariants, and Approval Boundaries for Production AI Agents Vinoth Govindarajan · 2026-09-21 source ↗ Reader 🖥️
The reliability of a production AI agent depends not on the model but on its harness — whether every fact an agent depends on has a single owner and replay path, concurrent state mutations are serialized through one ordered commit path, every unit of work has a bounded lifecycle, every approval is a scoped and expiring authority object rather than a remembered click, and every action is proven with a receipt that crosses the user-visible edge — because a model can only propose an action, and it is the harness, not the model, that commits it and proves it happened. - Zero to Agent in 30 Minutes: Build a Sports Concierge Agent with Chester Ismay Michelle Smith · 2026-09-21 Reader 🖥️
A minimal-infrastructure pattern — a single markdown policy file plus pre-fetched data, scoped tool permissions, and ordinary OS scheduling — is enough to turn a recurring personal decision into a reliable, unattended weekly agent, without needing dedicated agent-orchestration infrastructure. - Brownfield Agentic Engineering Addy Osmani · 2026-09-14 source ↗ Reader 🖥️
Agentic engineering in an old (brownfield) codebase succeeds by making hidden, undocumented constraints explicit and the cost of a wrong change cheap and visible — through human-drawn risk zones, durable research artifacts, characterization tests, migrations completed as whole units, and review that scales with blast radius rather than code volume — not by maximizing agent autonomy or parallelism first. - Own the Outer Loop Addy Osmani · 2026-09-09 source ↗ Reader 🖥️
Because agents supply capability but cannot inherit consequence, engineers must own the 'outer loop' of agentic systems — the boundary where Quality (checks/evidence), Verdict (the ship/block decision), and Answerability (the guarantee of being able to explain why) live — which means personal, attributable accountability, not code-writing skill, is what becomes scarce and valuable as harnesses, loops, fleets, and software factories absorb the inner work. - Zero to Agent in 30 Minutes: Build a Supply Chain for Agent Context with Maxim Salnikov Michelle Smith · 2026-09-08 source ↗ Reader 🖥️
Because agent skills, instructions, hooks, and other customizations now spread across machines, harnesses, and codebases with no record of their origin or whether they've changed, teams should manage agent context the way modern software already manages code dependencies — versioned, pinned, sourced from a vetted registry, and audited for drift in CI — using a purpose-built package-manager tool (APM) rather than ad hoc installation. - How Anthropic Builds And How Engineering Will Change Soon | Thariq Shihipar Ryan Peterman · 2026-09-07 Reader 🖥️
Inside Anthropic, engineering is already organized around treating Claude as a thought partner wrapped in an increasingly sophisticated harness/loop rather than around hand-writing code, and this shift will diffuse into the rest of the industry — leaving the durable human value in judgment, taste, verification design, and self-directed visibility rather than in code production itself. - From AI Code to Trusted Software: Harness Engineering in Practice Travis Frisinger · 2026-09-04 Reader 🖥️
The bottleneck in AI-assisted software delivery has shifted from code generation to verification, so engineering effort should go into 'harness engineering': wiring an organization's standards into the repository itself (fail-closed gates, evidence attached to every change, cross-run observability) so the repository — not the model, and not a document nobody enforces — becomes the mechanism of trust, up to and including the repository taking on the shape of a governed mini-organization. - Portal by Spotify cut my Claude Code token usage by 90% Dimitri Mazmanov · 2026-09-03 source ↗ Reader 🖥️
Because most of what a coding agent does is I/O rather than reasoning, routing that I/O-bound work (bulk file reads, pattern-following boilerplate generation) to a cheap worker model — and enforcing that routing deterministically via harness-level hooks rather than relying on advisory instructions the model can ignore — cuts Claude Code's token spend by around 90% on the delegated work while reserving the frontier model for editing, debugging, and anything safety-critical. - Loop Engineering: Building Blocks, Adoption, and Impact Jai Lal Lulla; Vahram Nersesyan; Seyedmoein Mohsenimofidi; Christoph Treude; Sebastian Baltes · 2026-08-28 Reader 🖥️
"Loop engineering" has a stable, practitioner-agreed definition and set of building blocks (triggers, stop conditions, persisted state, verifiers, budgets, escalation points) for designing systems that repeatedly prompt coding agents instead of a human doing so turn by turn, but an exploratory mining study of 36,710 open-source repositories finds confirmed autonomous agent loops in only 0.59% of them, and shows that while loops' triggering configuration gets committed to version control, almost none of the prescribed runtime building blocks — state files, verifiers, budgets, machine-checkable goal conditions — do, leaving the practice's claimed value almost entirely untested by evidence. - Audit your Agent files AddyOsmani.com · 2026-08-27 source ↗ Reader 🖥️
Coding-agent configuration (CLAUDE.md/AGENTS.md, skills, hooks, MCP servers, memory) has a half-life because models and harnesses keep improving past what the rules were written for, so instead of accumulating it indefinitely or purging it wholesale, developers should audit it on a recurring cadence — using tools like /doctor, questioning whether each item's original reason still holds, and testing removal before committing to it. - The AI-Native SDLC playbook Louis Claxton · 2026-08-21 source ↗ Reader 🖥️
Once agentic coding collapses the build phase to hours, the traditional SDLC's human-speed controls (committees, meetings, line-by-line review) become the bottleneck and stop matching reality, so organizations should rebuild the lifecycle as a non-linear loop of six stages (plan, design, build, test, deploy, maintain) where every stage commits a version-controlled artifact the next stage reads, human judgment concentrates at artifact-acceptance gates rather than at the point of production, and governance is enforced as code (hooks, branch protection, managed settings) rather than through periodic human review bodies. - Is Open-Source AI Really the Dangerous Path? Raffi Krikorian · 2026-08-18 source ↗ Reader 🖥️
The real fight over open-source AI's danger is a decoy: model weights can't meaningfully be 'revoked' once released and are becoming an interchangeable commodity, so the actual site of power and value is the agentic harness wrapped around the model — and whether that layer stays open is being decided right now by ordinary developers' architecture choices, not by policymakers or safety rhetoric. - Stop being skeptical about AI for development with Charity Majors Gergely Orosz (interviewing Charity Majors, CTO/co-founder of Honeycomb) · 2026-08-12 Reader 🖥️
AI skepticism about software development, though rational as recently as 2025 given the industry's track record of over-promised transformative technologies, has become irrational in 2026 because the model-plus-harness combination (Opus 4.5 running inside Claude Code) crossed a genuine, cloud-computing-in-2010-scale capability threshold — so the live question for engineers is no longer whether to adopt AI but how to build the validation discipline (tests, evals, conformance checking, observability) that makes shipping AI-written, unread code safe. - Addy Osmani's Post Addy Osmani · 2026-08-01 source ↗ Reader 🖥️
Because agents can now generate more code than people can read, software quality control must move from human inspection of the code itself into deterministic constraints (tests, checks, metrics) engineered into the harness and environment around the agent. - Downstream #1: Where Do Our Tokens Go? Johannes Gehrke · 2026-08-01 source ↗ Reader 🖥️
The cost of agentic coding is set less by which model you use than by how the harness manages context, exploration, and stopping — so engineering leaders should invest in harness discipline, per-workflow model evaluation, and cost visibility rather than wait for cheaper tokens to fix agent economics. - AI Root Cause Analysis Shifts from Model Reasoning to Context Engineering Mark Silvester · 2026-07-25 Reader 🖥️
The hard part of AI-assisted root cause analysis has shifted from model reasoning -- which recent evidence suggests is largely solved by frontier and even many open-weight models given the same prepared context -- to context engineering: the harness work of correlating signals and assembling a compact, unmisleading context before the model is ever called. - Stop Overengineering Your Agent Harness Hugo Bowne-Anderson · 2026-07-22 source ↗ Reader 🖥️
Most builders should reject the coding-agent-derived harness checklist (memory, compaction, sub-agents, hooks) as a default and instead size their harness to where a given task actually falls on two independent axes — action complexity and context complexity — because harness features are provisional, encoding assumptions about model limitations that expire as models improve (the 'Kirby effect'), so the discipline is to build the minimum viable harness for the job and prune it as capability arrives. - Fragments: July 21 Martin Fowler · 2026-07-21 source ↗ Reader 🖥️
This is not a single-thesis essay but a set of retreat dispatches with no forced unifying claim; the headline findings from the underlying Thoughtworks report are quoted up front but only two of the five (the executive/engineer expectation gap, and — more thinly — verification-as-bottleneck) are actually elaborated in the body, while the recurring thread that does run through the fragments that follow is a practitioner's-eye skepticism about the gap between AI hype and what people who actually work with LLMs observe — in board expectations, incident response, vibe-coding governance, and even the felt experience of reading AI-touched prose. - My AI Kept Pushing Me to Ship, So I Asked It Why Andrew Stellman · 2026-07-21 source ↗ Reader 🖥️
Agentic coding models exhibit a structural default the author names continuation pressure — every turn is built as a handoff that leaves a next action queued rather than genuinely finishing — which surfaces as deferral and velocity pressure, resists naming and phrase-banning because it simply relocates to unconstrained vocabulary, and can only be suppressed (not eliminated) by a structural rule that makes an explicit 'done, nothing queued' resting state a legitimate way to end a turn. - Software Factories, Light and Dark AddyOsmani.com · 2026-07-20 source ↗ Reader 🖥️
Because verification, not generation, is the real bottleneck of an AI-driven 'software factory,' an engineer's central job is to decide loop by loop how much autonomy each part of the pipeline can earn — full automation ('dark') only where a check is cheap, fast, and hard to fake, human judgment ('lit') everywhere else — with the human's own role relocating from writing code to owning and verifying that outer decision. - Podcast: Strands Agents with Clare Liguori InfoQ Podcast; host: Thomas Betts; guest: Clare Liguori (AWS, technical lead, Strands Agents SDK) · 2026-07-20 source ↗ Reader 🖥️
Building reliable production AI agents means resisting the instinct to constrain them with deterministic workflow logic -- which Strands's own case-study testing shows is measurably less accurate and more brittle than trusting the model -- and instead investing in a minimal model-driven design (system prompt, tools, model) supplemented by targeted runtime controls (evals, stateful 'steering hooks' backed by a full tool-call ledger, continuous evaluation against live traffic) that inject determinism only where and when the model actually needs it, with the harness's job now expanding from running a short reasoning loop toward sustaining long-running, resumable, self-tracking agentic work as the underlying models keep improving. - Zero to Agent in 30 Minutes: Build a Workflow Agent with John Berryman Michelle Smith · 2026-07-20 source ↗ Reader 🖥️
An AI agent is, at bottom, simply an LLM wrapped in an outer conversation loop and an inner tool-use loop, and the right way to build one is 'outside in' — get the non-AI application working first, stub the AI, then incrementally swap in a minimal validated agent, a small fixed toolkit, and a natural-language 'skill' — because this staged sequencing both de-risks the build and produces instructions plain enough that domain experts, not just engineers, can read and correct them directly. - Google's Genkit Ships Agents API with Detached Turns and Human-in-the-Loop for TypeScript and Go Steef-Jan Wiggers · 2026-07-14 source ↗ Reader 🖥️
Google's new Genkit Agents API asserts that a single chat() agent abstraction — spanning one-shot replies, streamed conversations, human-gated approval pauses, and detached long-running tasks — can absorb agent complexity as it grows, letting Genkit differentiate in a crowded framework field on full-stack breadth (server logic, typed client SDKs, deployment flexibility) rather than by out-building LangChain's ecosystem. - What is “loop engineering?” The Pragmatic Engineer · 2026-07-14 Reader 🖥️
“Loop engineering” — designing the orchestration around an AI coding agent (goals, completion checks, state persistence, fresh-context iteration) rather than hand-writing one-off prompts — is a real practice that originated as a DIY workaround (the “Ralph loop”) for small context windows, but by mid-2026 major harnesses had absorbed most of it into a native /goal primitive, so for most developers besides those building AI infrastructure, it is a largely-already-commoditized skill rather than a durable new discipline. - The Almedra Token-Efficiency Benchmark, Updated For GLM 5.2 Lucena.One · 2026-07-13 Reader 🖥️
Running the same prompt and repo through six different coding-agent harnesses against the identical GLM 5.2 model, Lucena Coder again produced a working result using roughly a third to a fifteenth of the tokens and cost of its rivals, showing that harness design — not the underlying model — is the dominant lever on coding-agent token efficiency, and that upgrading the model (GLM 5.1 to 5.2) narrows but does not close that gap. - 11 Tips For AI Coding With Ralph Wiggum Matt Pocock · 2026-07-11 source ↗ Reader 🖥️
Autonomous agent loops ("Ralph") become reliably productive only when the human stops writing code and instead wraps the loop in disciplined scaffolding — an explicit end-state/stop-condition, an externalized progress file, commit-blocking feedback loops, small steps, risk-first sequencing, stated quality expectations and a sandbox — scaffolding that compensates for the agent's lack of judgment and cross-session memory and that, unguardrailed, would let the loop accelerate software entropy. - ChatGPT Just Became A Work Agent AI Daily Brief (Nathaniel Whittemore) · 2026-07-11 Reader 🖥️
The decisive competitive battle in AI has shifted from which model is smartest to which company builds the best harness — the connectors, execution environment, and access controls — for wrapping that model around real knowledge work, as shown by OpenAI's ChatGPT Work launch directly targeting the market Claude Cowork opened and that Cursor's in-development 'Sand' agent is also chasing. - GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. musistudio · 2026-07-11 source ↗ Reader 🖥️
Claude Code's harness should be decoupled from Anthropic's models: by running a local proxy that intercepts its API requests and routes each sub-task — background, thinking, long-context, web-search — to the cheapest capable model across many providers, with per-provider transformers normalizing each vendor's API dialect into Claude Code's Anthropic-shaped protocol, you keep Anthropic's coding harness and its updates while freely choosing, mixing, and cost-optimizing the model behind it. - The Anatomy of an Agent Harness Akshay · 2026-07-08 Reader 🖥️
An agent harness is not monolithic prompt-glue but a decomposable system of roughly twelve components (orchestration loop, tools, memory, context management, prompt construction, output parsing, state, error handling, guardrails, verification, subagents) plus seven design-decision axes, and naming the parts is what lets you reason about, debug, and — because the parts are treated as separable and independently improvable — evolve agent behavior; yet as delivered the list reads as a convergent practitioner checklist organized by mechanism and vendor vocabulary rather than an orthogonal, coupling-minimizing decomposition with defined interfaces. - Experiences with local models for coding Birgitta Böckeler · 2026-07-08 source ↗ Reader 🖥️
Running small, locally-hosted open models for agentic coding is not yet a plug-and-play substitute for frontier models — it remains frustrating and far below frontier capability, and is viable today only for a narrow class of small, well-scoped, often pre-planned tasks, with the choice of task (more than the model or harness) being the dominant factor that determines whether it works. - Notes from FOSE Europe Giles Edwards-Alexander · 2026-07-07 source ↗ Reader 🖥️
Five months into the agentic era the value of agentic engineering is now settled ('the evidence is in'), so the live frontier of the debate has moved from the tools themselves to the socio-organisational questions they raise — how to design your organisation (Optimiser vs Learner), where engineering rigour and human judgement now live, and how to coordinate agentic work across teams and enterprises — none of which is yet resolved. - Addy Osmani's Post (Agent Skills 0.6.3 release) Addy Osmani · 2026-07-07 source ↗ Reader 🖥️
Addy Osmani's 0.6.3 release of Agent Skills deepens the code-review skill specifically, on the premise that review -- not planning or generation -- is now the bottleneck limiting how much autonomy a coding agent can safely be granted, so the release invests in structural code-review depth (a 'reduce, don't relocate' lens, a Structural Remedies catalog, a file-size gate, severity-ranked findings) and adds a project-wide Definition of Done and an observability checklist, rather than expanding what agents are allowed to do unsupervised. - Prompting Claude Fable 5 Claude Platform Docs · 2026-07-07 Reader 🖥️
Prompting Claude Fable 5 well means steering a markedly more capable, longer-horizon, strongly-instruction-following model with brief goal-and-intent-first directives and asynchronous, memory- and subagent-aware scaffolding — and pruning the enumerated rules, guardrails, and hand-holding that prior, weaker models required. - Software Design in the Agentic Age: Place Your Bets Mathias Verraes · 2026-07-07 source ↗ Reader 🖥️
In the agentic age, code-level quality becomes automatable but high-level software design and rigorous (ideally executable) specifications remain decisive human-led work, so under deep uncertainty about AI's payoffs and externalities teams should bet on design rigour, executable specifications, and the ability to revert from agent generation back to human engineering. - Viability of local models for coding Martin Fowler (martin@martinfowler.com) — memo by Birgitta Böckeler · 2026-07-07 source ↗ Reader 🖥️
The practical viability of local models for agentic coding is not a property of the model alone but an emergent, hard-to-predict outcome of interacting hardware (RAM, processing power, memory bandwidth), model (parameters, architecture, quantization, reasoning) and harness (context overhead, tool-calling schema) factors — which is why local coding assistants are still not a reliable 'plug and play' option for developers, even though specific configurations already deliver acceptable results for narrow tasks. - Fragments: July 6 Martin Fowler · 2026-07-06 source ↗ Reader 🖥️
Agentic software development has crossed from aspiration into established practice — the debate is no longer whether it changes software engineering but how — and the central live question is whether classic design and architecture fundamentals still matter, with Fowler's emerging answer being that they do, both because agents use the same constructs humans do and because good design hedges against escalating token costs and the risk of losing affordable access to AI. - Software Design in the Agentic Age: Placing Your Bets aardling.eu · 2026-07-03 Reader 🖥️
Even though no one yet has evidence that classic code-design and domain-modeling discipline is necessary for agentic development, the author bets on maintaining it anyway — high test coverage, sound domain models and Ubiquitous Language, disciplined Bounded Contexts, and code quality — because doing so is the dominant strategy under uncertainty (cheap to unwind if unnecessary, expensive to retrofit if not) and because it preserves the option to revert an organization from agentic code generation back to human engineering if AI's economics or reliability falter. - Developer Newsletter: New models, Claude Tag, and dynamic workflows Claude Team · 2026-07-01 source ↗ Reader 🖥️
This release wave moves Claude's agentic surface further from 'better chatbot' toward a governed, team-embedded multi-agent platform: models get faster and cheaper, Claude Code gains the ability to author its own task-specific multi-agent harnesses at runtime, and Claude becomes something teams tag into their own communication and identity infrastructure (threads, MCP connectors, enterprise IdPs) rather than a tool used only inside a terminal or chat window. - How to Actually Prompt Fable 5, Straight From the Team That Built It CyrilXBT · 2026-07-01 Reader 🖥️
This thread is essentially Anthropic's official Fable 5 prompting guide, compressed and repackaged for practitioners as a six-step migration checklist — it restates the guide's core techniques (latency/timeouts, effort tiers, progress-auditing, proactivity constraints, memory, subagents, final-response format, refusal fallback) nearly verbatim while dressing a public-doc summary in 'straight from the team that built it' authority framing and layering in a few uncited specifics (the ultrathink/ultracode keywords, a sub-5% refusal rate, an 'audit beat softer phrasings' test) that the official extraction does not contain. - Google Just Dropped a Masterclass on Agentic Engineering (It's SO Good) Cole Medin · 2026-06-24 Reader 🖥️
A developer's or team's AI-coding results are determined far more by the harness they deliberately engineer around a model — specs, context, guardrails, verification, and the discipline of continuously improving that system — than by which model they use, so investing upfront in 'agentic engineering' over ad-hoc 'vibe coding' is the highest-leverage move available right now, even though it costs more to start. - AI models can disappear overnight. Is your engineering team built to survive it? Bill Doerrfeld · 2026-06-17 source ↗ Reader 🖥️
Because AI model and provider availability can vanish overnight (as Anthropic's Mythos and Fable models did, three days after launch, under a national-security export-control order), engineering teams should stop building their stack around any single model or provider and instead invest in a model-agnostic 'harness' (tools, memory, prompts, routing, evaluations kept independent of the model) plus open-source/open-weight models, so any given model can be swapped without rebuilding core infrastructure. - The New SDLC With Vibe Coding: From ad-hoc prompting to Agentic Engineering Addy Osmani, Shubham Saboo, Sokratis Kartakis · 2026-06-15 Reader 🖥️
As AI increasingly handles code generation itself, what separates production-grade 'agentic engineering' from risky 'vibe coding' is not which AI tool a team uses but how deliberately it designs and maintains the harness, verification (tests + evals), and context around the model — so the discipline a team already has is what AI amplifies, for better or worse. - Vibe Coding Agent Security And Evaluation Sokratis Kartakis, Aron Eidelman, Wafae Bakkali, Meltem Subasioglu · 2026-06-08 Reader 🖥️
Operationalizing vibe coding in the enterprise requires redefining trust across two distinct, jointly necessary axes — a defence-in-depth 'Security' architecture (seven pillars: infrastructure, data, model, application/runtime, identity, observability/SecOps, governance) that proves an agent stayed inside its boundary, and a seven-dimension 'Evaluation' framework that proves what happened inside that boundary was actually worth shipping — because a vibe-coded agent can pass every security check while still misreading intent, and no single check (deterministic or AI-judged) covers both questions at once. - Loop Engineering Addy Osmani · 2026-06-07 Reader 🖥️
Loop engineering means replacing yourself as the person who prompts the coding agent turn-by-turn with a designed system — automations, worktrees, skills, plugins/connectors, and sub-agents, plus externally-persisted state — that prompts the agent for you; but because that system can't distinguish between someone using it to move faster on work they understand and someone using it to avoid understanding the work at all, the engineer's judgement doesn't disappear, it relocates one level up, from prompting to system design, which Osmani argues is harder, not easier. - A harness for every task: dynamic workflows in Claude Code Thariq Shihipar and Sid Bidasaria (Anthropic, Claude Code team) · 2026-06-02 source ↗ Reader 🖥️
Because a single, continuously-running context window degrades on long, parallel, structured, or adversarial tasks through three specific failure modes — agentic laziness, self-preferential bias, and goal drift — Claude Code should let the model write and orchestrate a custom, task-specific multi-agent harness (a dynamic workflow) on the fly, rather than relying on one generic static harness for every task. - Google Introduces Middleware Architecture for Genkit Applications Robert Krzaczyński · 2026-05-25 source ↗ Reader 🖥️
Google's new Genkit middleware turns agentic application reliability, safety, and orchestration from prompt-time concerns into a programmable, stackable interception layer wrapped around generation, model calls, and tool execution. - This Week in AI: Rethinking the Agent Harness Michelle Smith · 2026-05-22 source ↗ Reader 🖥️
In mid-2026 the strategic locus of AI value has shifted from model selection to harness design, so practitioners — including non-developers — should build their own skill-driven agent harnesses rather than depend on bespoke applications or wrapped commercial products. - Bliki: Vibe Coding Martin Fowler · 2026-05-21 source ↗ Reader 🖥️
Vibe coding — building software by prompting an LLM without ever looking at the generated code — is a distinct practice from agentic programming, useful only for disposable software, because forgetting the code exists produces serious risks in security, maintainability, and correctness. - GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. https://github.com/Doorman11991/ · 2026-05-21 source ↗ Reader 🖥️
A well-engineered harness — context budgeting, forgiving tool-call parsing, patch-first editing, two-stage tool routing, decomposed planning, and per-model profiles — can extract production-grade agentic coding work from small (7B-20B), locally-hosted LLMs that would otherwise be considered too weak for the task, making local, private, frontier-free coding agents viable. - Why Google Isn't Chasing Claude Code AI Daily Brief · 2026-05-21 source ↗ Reader 🖥️
Google I/O 2026 reveals that Google is not trying to win the Claude Code / agentic-coding race the way Anthropic and OpenAI are — instead it is hedging across a sprawling consumer agent surface backed by a distribution moat, while Demis Hassabis quietly pursues a different prize (world models / scientific singularity), leaving Google's overall AI strategy coherent only if you accept it is playing a different game. - Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 source ↗ Reader 🖥️
Frontier security-focused LLMs (exemplified by Mythos Preview) have made a real qualitative jump in exploit-chain construction and proof generation, but their value at production scale is unlocked not by faster patching or smarter single-agent use, but by wrapping them in a multi-stage harness of narrow, parallel, adversarially-validated agents and by hardening the architecture around vulnerabilities so that the gap between disclosure and patch matters less. - How Claude Code works in large codebases: Best practices and where to start Claude · 2026-05-14 source ↗ Reader 🖥️
At scale — multi-million-line monorepos, decades-old legacy systems, and organizations with thousands of developers — Claude Code's effectiveness is determined less by the underlying model than by a deliberately built harness (CLAUDE.md, hooks, skills, plugins, MCP servers, plus LSP integrations and subagents) and, just as importantly, by a durable organizational ownership structure (a dedicated owner or team, cross-functional governance, scheduled re-review as models evolve) that keeps good setups from staying tribal and adoption from plateauing. - Agent Skills Addy Osmani · 2026-05-09 source ↗ Reader 🖥️
AI coding agents default to the shortest path to 'done' and systematically skip the invisible senior-engineer work (specs, tests, reviews, scope discipline) that separates reliable software from code that breaks — skills are portable, workflow-shaped markdown files that bolt that scaffolding back on by making it impossible for the agent to rationalize skipping it. - Hugging Face's Clem Delangue: Stop Comparing Engines to Cars Turing Post (Ksenia Se interviewing Clem Delangue) · 2026-05-02 source ↗ Reader 🖥️
Open-source AI is not behind closed AI -- they serve different purposes with different trade-offs -- and the path forward requires massively expanding who can build AI by lowering barriers through open models, local deployment, agent-native platforms, and physical robotics. - The Week AI Grew Up AI Daily Brief · 2026-05-01 source ↗ Reader 🖥️
The AI industry crossed from subsidized experimentation into mature economic infrastructure in the week of April 28, 2026 — visible simultaneously in pricing model shifts, cloud earnings, geopolitical treatment, and the industrialization of agent harnesses — and everyone from developers to governments must now operate accordingly. - Developer Newsletter: higher usage limits, dreaming for Claude Managed Agents, and Claude Security Claude Team · 2026-05 Reader 🖥️
Anthropic is repositioning Claude from a chat model into a managed agent platform: more compute headroom for Claude Code, persistent and self-improving agents ('dreaming'), enterprise-grade isolation (self-hosted sandboxes, MCP tunnels, AWS GA), and a security product (Claude Security beta) — together signaling that the next competitive surface is not the model but the governed runtime around it. - How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code) Lenny's Podcast · 2026-04-23 Reader 🖥️
In an era of rapidly improving AI models, the PM role must shift from multi-quarter planning and cross-functional coordination toward radical speed of execution, product taste, and the ability to continuously adapt the product harness to extract maximum value from each new model generation. - Agent Harness Engineering Addy Osmani · 2026-04-20 source ↗ Reader 🖥️
The performance gap between what current AI models can do and what users actually experience is primarily a harness-engineering gap — the scaffolding of prompts, tools, hooks, context management, and feedback loops wrapped around the model — and closing it requires treating that scaffolding as a continuously evolving engineering artifact shaped by observed failures. - Accelerating Delivery: How AI Agents Can Own the Initial Code Draft Stephen Walker · 2026-04-20 source ↗ Reader 🖥️
Autonomous AI agent workflows can reliably automate the journey from a Jira ticket to a first pull request if teams wrap inherently probabilistic LLMs in deterministic guardrails (branch scoping, hooks, orchestration) and multi-stage adversarial review loops that enforce architectural standards before human eyes ever see the code. - Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle Michael Parker · 2026-04-20 Reader 🖥️
AI-assisted development is creating a polarized experience — joyful for greenfield builders, miserable for legacy-code maintainers — and closing this 'joy gap' requires better planning and review tooling, organizational structures like AI platform teams, and cultural practices that reconnect developers with each other and with the customer problems they are solving. - Harness engineering for coding agent users Birgitta Böckeler · 2026-04-20 source ↗ Reader 🖥️
Coding agent users should engineer an outer harness of feedforward guides and feedback sensors — distributed across computational and inferential execution types and across the change lifecycle — to reduce review toil and increase system quality, but the behavioural harness (ensuring functional correctness) remains the hardest unsolved problem. - Alex Wang's Post Alex Wang · 2026-04-16 Reader 🖥️
Claude Code becomes more reliable when you move recurring, deterministic, and structural concerns out of ad-hoc prompts and into the environment (CLAUDE.md, skills, hooks, plan mode). - Generative AI in the Real World: Aishwarya Naresh Reganti on Making AI Work in Production Ben Lorica and Aishwarya Naresh Reganti · 2026-04-16 source ↗ Reader 🖥️
Shipping generative AI in production requires inverting the traditional software effort profile — spending most resources on post-deployment calibration, data understanding, cross-functional collaboration, and workflow-level design rather than on initial build — because the natural-language interface opens an unbounded error surface that only continuous human-in-the-loop refinement can tame. - Technology Radar, Volume 34 Thoughtworks (Technology Advisory Board) · 2026-04-14 source ↗ Reader 🖥️
AI-assisted, agentic software development is moving faster than the industry's ability to evaluate it, which means teams must simultaneously retain long-held craftsmanship principles (testability, deliberate design, feedback loops) and rethink team/agent topologies, trust boundaries and metrics that were built for a pre-agent world. - The biggest advance in AI since the LLM Gary Marcus · 2026-04-11 source ↗ Reader 🖥️
Claude Code's leaked source code reveals a neurosymbolic architecture — classical symbolic pattern-matching at its core rather than pure LLM — which Marcus argues is the single biggest advance in AI since the LLM and vindicates the neurosymbolic research programme he and others have long advocated. - Meta's new model is Muse Spark, and meta.ai chat has interesting new tools Simon Willison · 2026-04-10 source ↗ Reader 🖥️
The AI frontier is advancing simultaneously on two fronts — model capability (Meta's Muse Spark, Z.ai's GLM-5.1) and model danger (Anthropic's Mythos finding decades-old vulnerabilities at scale) — and the industry's response to both fronts reveals how the relationship between open and closed AI is being renegotiated under pressure from security realities. - Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering Chenyu Zhou, Huacan Chai, Wenteng Chen, Zihan Guo, Rong Shan, Yuanyi Song, Tianyi Xu, Congming Zheng, Jiachen Zhu, Zeyu Zheng, Zhuosheng Zhang, Xingyu Lou, Zhihui Fu, Jianghao Lin, Weinan Zhang · 2026-04-09 Reader 🖥️
Practical progress in LLM agents increasingly depends not on improving model weights but on externalizing cognitive burdens into external infrastructure — memory, skills, protocols, and harness engineering — which together form a systems-level framework of cognitive artifacts. - Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development Leela Kumili · 2026-04-06 source ↗ Reader 🖥️
Splitting long-running AI development tasks among three specialized agents — planner, generator, and evaluator — with structured handoff artifacts solves the two core failure modes of autonomous coding sessions (context loss and self-evaluation bias), producing higher-quality and more consistent outputs. - Don't train the model, evolve the harness Akshay · 2026-04-06 Reader 🖥️
For a model you don't control — a frozen, rented commodity whose weights you can't change — the reliable leverage on agent performance lives in the harness (the code that feeds the model context, runs its tool calls, and decides when a run ends), not in the weights: a benchmark score conflates model and harness, so most apparent 'model failures' are harness failures (often mundane output-plumbing, not reasoning), and the disciplined way to capture that leverage is an automated fitness-selection loop that adds one mechanism at a time and keeps it only when it clearly beats the current best — a process that compounds until the harness runs out of tricks and the residual misses are genuine capability gaps. - Claude Code Source Leak Megathread sixbillionthsheep (Reddit) · 2026-04-01 source ↗ Reader 🖥️
The Claude Code source leak revealed that the competitive advantage in AI coding tools lies not in model capability but in the orchestration layer -- memory, multi-agent coordination, web search pipelines, session management, and autonomous background agents -- and the community's response exposed collective assumptions about code quality, IP ownership of AI-generated code, and the governance gap in agentic systems. - Harness design for long-running application development anthropic.com · 2026-03-24 Reader 🖥️
Harness design for long-running autonomous coding should be approached as a moving target: build a multi-agent architecture (planner, generator, evaluator) that compensates for the current model's specific weaknesses on long-horizon, subjective-judgment tasks, then aggressively strip components as model capability advances — because every harness component encodes an assumption about what the model can't do alone, and those assumptions go stale. - 13) Tobias K. Torrissen om kodekvalitet, konferanser og AI Truls Jørgensen og Audun Fauchald Strand — Heis Podcast · 2026-03-16 source ↗ Reader 🖥️
In the age of LLM-generated code, the durable value of an engineering leader is not in writing code but in cultivating the engineering practices, explicit design discipline, and craft community that determine whether a long-lived system can be understood, maintained, and adapted — and code quality, understood as 'obvious over clever,' matters more in this era, not less. - The Anatomy of an Agent Harness Vivek Trivedy · 2026-03-10 source ↗ Reader 🖥️
A harness is everything that is not the model — system prompts, tools, filesystem, sandboxes, memory, context-management strategies, and long-horizon execution patterns — and each harness primitive exists to compensate for a specific thing today's models cannot do out of the box; as models absorb more of these capabilities natively through model-harness co-training, harness engineering won't disappear but will shift from patching deficiencies to engineering systems that make any model's intelligence more effective. - How I write software with LLMs stavros.io · 2026-03-09 source ↗ Reader 🖥️
A solo practitioner can now sustain multi-week, tens-of-thousands-of-line AI-written software projects at a lower defect rate than hand-writing, but only by replacing 'ask one model to do everything' with a fixed division of labor across models (a strong model as architect doing interactive up-front design, a cheaper model as developer doing strict implementation, and one-to-three structurally independent models as reviewers) plus explicit human approval gates -- and only on technology the human already understands well enough to catch bad architectural decisions before the agent compounds them. - Agents Over Bubbles Ben Thompson (Stratechery) · 2026-03 source ↗ Reader 🖥️
The emergence of AI agents — which integrate models with software harnesses and multiply the output of a small number of agentic humans — means the massive AI infrastructure investment is justified demand rather than speculative bubble, and positions integrated model-plus-harness companies (Anthropic, OpenAI) as the durable winners in the value chain. - Harness Engineering Birgitta Böckeler · 2026-02-17 source ↗ Reader 🖥️
Harnesses — the mix of deterministic tooling and LLM-based practices that keep coding agents reliable and maintainable at scale, as demonstrated by OpenAI's 5-month, 1M+-line, no-manually-typed-code project — are likely to become the next generation of service templates, which implies that trustworthy AI-generated code requires giving up some generation-time flexibility (converging on fewer tech stacks and enforced architectural boundaries) in exchange for maintainability, and that retrofitting a harness onto an existing, high-entropy legacy codebase may often not be worth the effort. - Harness engineering: leveraging Codex in an agent-first world Ryan Lopopolo (OpenAI) · 2026-02-11 source ↗ Reader 🖥️
Building a product with zero manually-written code at scale (one million-plus lines, five months, a team that grew from three to seven engineers with throughput that increased rather than degraded) required redefining engineering work from writing code to designing environments, pushing all team knowledge into repository-local legible artifacts, mechanically enforcing architectural invariants and documentation freshness, and relaxing human-paced process norms (blocking merge gates, manual cleanup) in favor of continuous, agent-driven correction — because human time and attention, not code production, is the one truly scarce resource the whole system must be organized to protect. - Coding Agent Development Workflows Nick Tune · 2026-01-07 source ↗ Reader 🖥️
Making an autonomous coding agent reliable enough to go from ticket to mergeable pull request requires converting as much of the surrounding process as possible into explicit, versioned, tool-agnostic artifacts — deterministic scripts, a single shared source of truth for conventions that every agent and review tool reads, and structured task templates that reject underspecified work — because agent reliability is bounded by the explicitness of what surrounds it, not by the model's capability alone; and the harder unsolved problem this creates for teams and organizations is deciding how explicit conventions must be, who owns them, and at what level (team vs. org) they should be standardized. - No Vibes Allowed: Solving Hard Problems in Complex Codebases – Dex Horthy, HumanLayer AI Engineer · 2025-12-02 source ↗ Reader 🖥️
Solving hard problems in large, brownfield codebases with coding agents requires treating the context window itself as the scarce, team-visible resource to be engineered — through a research/plan/implement workflow with deliberate, frequent compaction — rather than either unreviewed 'vibes' or an over-literal, semantically diffused 'spec-driven development'; and the harder, still-unsolved problem is adapting team workflow, review practice, and culture to a world where most shipped code is AI-authored, not improving the agent tooling itself. - Just Talk To It - the no-bs Way of Agentic Engineering Peter Steinberger · 2025-10-14 source ↗ Reader 🖥️
As coding-agent models (specifically GPT-5-Codex) get good enough to read a codebase and follow short, direct instructions on their own, most agentic-engineering 'harness ceremony' — subagents, RAG, elaborate plan files, custom hooks, MCP servers — becomes charade that works around older model limitations rather than exploiting current model capability, so the highest-leverage practice for a solo developer is to talk to the model directly and let judgment (about blast radius, context budget, and when real structure is needed) develop through intuition rather than process. - Claude Code: Best practices for agentic coding anthropic.com · 2025-04-18 source ↗ Reader 🖥️
Because Claude Code is deliberately low-level and unopinionated, its effectiveness on your problem is set by the harness you engineer around the model — the context, tools, and workflow you supply — not by the raw model alone. - The Future of Work by Henrik Kniberg Jfokus · 2025-02-09 source ↗ Reader 🖥️
AI agents are rapidly maturing from autocomplete tools into autonomous colleagues capable of researching, coding, communicating, and even improving their own platform via human-reviewed pull requests — shifting the developer's job from writing code to directing, evaluating, and choosing where to spend increasingly scarce attention.
Propositions touching this concept (241)
By publication month, oldest first (extraction month when no publication date is known).
2025-04
- explicitA CLAUDE.md file, automatically pulled into context when a conversation starts, is the primary place to give Claude persistent project context: common commands, core files, code style, testing instructions, repo etiquette, environment setup, and project-specific warnings.
- implicitThe model's effective performance on your codebase is bounded by the harness you assemble around it — CLAUDE.md context, the curated tool allow-list, MCP servers, and custom bash scripts and slash commands — not by the raw model weights alone, so configuring that context-and-tool layer is the user's highest-leverage action.
2025-10
- explicitAs models like GPT-5-Codex get better at reading the codebase themselves and following short, direct instructions, most harness ceremony — subagents, RAG, elaborate plan files, custom hooks, generic persona-prompting — becomes 'charade' that works around older model limitations rather than exploiting current model capability; the highest-leverage practice is to talk to the model directly and develop intuition through use.
- explicitHe switched his daily-driver harness from Claude Code to the Codex CLI mainly for larger usable context (~230k vs. ~156k tokens), slower token-fill rate, true message queuing, raw speed (Codex rewritten in Rust vs. multi-second freezes and gigabyte memory blowups in Claude Code), and tone (Codex pushes back and is more careful; Claude's sycophantic 'absolutely right' and false '100% production ready while tests fail' language affected his mental health) — an impressionistic comparison, not a formal benchmark.
2026-02
- explicitOpenAI's harness for a 1-million-plus-line, 5-month, no-manually-typed-code product mixes deterministic and LLM-based components across three categories: context engineering (a continuously enhanced knowledge base plus access to dynamic context like observability data), architectural constraints (enforced by both LLM agents and deterministic linters/structural tests), and 'garbage collection' agents that periodically fight documentation and architectural decay.
- explicitHarnesses are likely to become the next generation of 'service templates': organizations will pick from a small set of harnesses for common application topologies, then diverge from them over time, risking the same forking and synchronization problem that already affects service-template adoption.
- explicitAs coding shifts from typing to steering generation, organizations may converge on fewer tech stacks and codebase topologies than today, selected partly for 'AI-friendliness' — availability of a good harness — rather than purely for human developer experience or technical merit.
- explicitRetrofitting a harness onto an existing, high-entropy legacy codebase may often not be worth the effort, because such codebases are frequently 'so non-standardized and full of entropy' that harnessing would surface an overwhelming volume of violations — comparable to running a static-analysis tool for the first time on a codebase that's never had one.
- explicitA genuinely effective harness is substantially more work than generating and maintaining a set of Markdown rules/instruction files — it requires extensive deterministic tooling plus significant code-design work, since code design itself is a large part of what an agent uses as context.
- explicitWhen the agent failed at a task, the team's diagnostic response was never 'try harder' — it was always to ask what capability was missing and make it both legible and enforceable for the agent, treating failure as a signal about the environment rather than about the model's effort or ability.
- explicitAs agent throughput increased, conventional engineering norms (strict blocking merge gates, blocking on flaky-test investigation before merging) became counterproductive and were relaxed, because once agent throughput far exceeds human attention, corrections are cheap and waiting is expensive — a tradeoff the team explicitly says 'would be irresponsible in a low-throughput environment' but is 'often the right tradeoff' here.
- explicitThe team's own retrospective frames its central lesson as: discipline in agent-generated software now shows up in the scaffolding (environments, feedback loops, control systems) rather than in the code itself — reframing 'engineering discipline' away from code-level craft and toward environment design as the locus of rigor.
2026-03
- explicitcorroboratedAgents represent a qualitative break from chatbots and reasoning models because they integrate models with harnesses and deterministic tools to verify results autonomously.
- explicitcorroboratedModel-harness integration is the point of differentiation in the AI value chain, not the model alone.
- implicitApple's strategy of licensing Gemini and building its own harness (Siri) may be insufficient for agent-quality experiences.
- explicitdevelopedEvery component in a harness encodes an assumption about a current model weakness; those assumptions are model-version-dependent and go stale as models improve.
- explicitestablishedWhen a stronger model lands, the right methodology is to remove harness components one at a time, measure the impact on output, and keep only the load-bearing pieces.
- explicitcontestedInter-agent communication via files (where one agent writes, another reads and responds) is sufficient orchestration for a three-agent harness.
- explicitThe space of interesting harness combinations does not shrink as models improve — it moves outward to more complex problems.
- implicitThe harness-vs-solo quality differential justifies a 20x cost multiplier ($200 vs $9, 6h vs 20min) when the task sits beyond solo capability.
- implicitThe right cadence for re-examining harness design is at each model release.
- explicitdevelopedHuman review of model traces on realistic problems remains essential to harness tuning — there is no shortcut around reading logs to find where the agent's judgment diverges from yours.
- explicitEven within a working evaluator-led harness, deeply nested features remain under-tested and small layout/interaction issues persist — verification has continuous headroom.
- explicitThere are three current camps of developers regarding AI: (1) those who refuse to engage, (2) those who harness LLMs into quality-engineering workflows, (3) those who run large-scale parallel agentic work without engaging with code as an abstraction.
- explicitAn effective harness must support multiple vendors' models (ruling out single-vendor-locked harnesses like Claude Code, Codex CLI, or Gemini CLI) and must let agents call each other directly, or the human ends up manually ferrying information between separate LLM sessions.
- explicitA harness is defined by exclusion: every piece of code, configuration, and execution logic that is not the model itself — including system prompts, tools/skills/MCPs, bundled infrastructure (filesystem, sandbox, browser), orchestration logic, and hooks/middleware for deterministic execution.
- explicitThe filesystem is the most foundational harness primitive because it gives agents durable storage, lets work be incrementally offloaded instead of held entirely in context, and acts as a natural shared collaboration surface for multiple agents and humans working through the same files.
- explicitGiving agents a general-purpose code-execution tool (bash) rather than a fixed, pre-designed set of tools is a better solution to autonomous problem-solving, because the model can design its own tools on the fly instead of being constrained to what harness designers anticipated in advance.
- explicitSandboxes are necessary not just for safety but for scale: running agent-generated code locally is risky and a single local environment doesn't scale to large agent workloads, whereas sandboxed environments can be created on demand, fanned out across many tasks, and torn down when done.
- explicitThree distinct context-management techniques — compaction (summarize/offload when context nears full), tool-call offloading (keep only head/tail tokens of large tool outputs), and skills (progressive disclosure, loading only front-matter until needed) — exist because today's harnesses are, in large part, delivery mechanisms for good context engineering against context rot.
- explicitcontestedLong-horizon autonomous execution requires harness primitives to compound together — durable filesystem/git state, Ralph-loop-style forced continuation across fresh context windows, planning decomposition, and self-verification against a test suite — because no single primitive alone solves early stopping, decomposition failure, or cross-context incoherence.
- explicitToday's coding-agent products (Claude Code, Codex) are post-trained with their harness in the loop, which makes the model more capable within that specific harness but creates an overfitting side-effect — illustrated by the Codex-5.3 apply_patch tool: a truly general model should switch patch methods easily, but harness-coupled training makes it brittle to tool-logic changes.
- explicitThe best harness for a given task is not necessarily the one the model was post-trained with — demonstrated by Opus 4.6 scoring far below its Terminal Bench 2.0 performance in Claude Code when run in a different harness, and by the author's own prior work improving a coding agent from Top 30 to Top 5 on that leaderboard purely by changing the harness, with the model held constant.
- explicitcontestedAs models absorb more harness-level capabilities natively (planning, self-verification, long-horizon coherence), harness engineering will matter less in the sense of patching deficiencies, but will remain valuable for the same reason prompt engineering still is: well-configured environments, tools, state, and verification loops make any model more efficient regardless of its base intelligence.
2026-04
- explicitestablishedA decent model with a great harness beats a great model with a bad harness.
- explicitestablishedThe gap between what today's models can do and what users see them doing is largely a harness gap.
- explicitcorroboratedModels get post-training coupled to the harness they were trained against, creating overfitting to specific tool implementations.
- explicitcontestedAs models improve, the space of interesting harness combinations doesn't shrink — it moves to new failure modes at higher capability levels.
- explicitcorroboratedThe right harness for your codebase is shaped by your failure history and cannot be downloaded as a generic package.
- explicitdevelopedTop coding agents (Claude Code, Cursor, Codex, Aider, Cline) look more like each other than their underlying models do — harness patterns are converging.
- implicitThe model-harness co-training loop means the 'best' harness for a given model is not necessarily the one the model was trained inside.
- implicitdevelopedHarness engineering will eventually move from static configuration to dynamic, compiler-like assembly of tools and context.
- explicitestablishedReliability improves when structure is moved from the prompt into the environment.
- implicitThere is a maturity progression from ad-hoc prompting to structured environment configuration.
- explicitHuman oversight remains necessary for initial calibration and quality validation even in automated harnesses
- explicitAs AI models improve, the harness's role will shift — some tasks will move to next-generation models directly, while improved models will enable harnesses to tackle more complex work
- implicitcorroboratedGood harness design requires ongoing experimentation and adjustment as model capabilities evolve — there is no stable final configuration
- implicitThe quality of the handoff artifact — what state information is captured between agents — is the critical design variable in a context-reset harness
- explicitcontestedCoding agent users can and should build an outer harness on top of the agent builder's built-in harness.
- explicitA well-built outer harness serves two goals: increasing the probability the agent gets it right initially (feedforward), and self-correcting issues before they reach human eyes (feedback).
- explicitcorroboratedFeedforward-only or feedback-only harnesses are each insufficient; both control directions are necessary.
- explicitThe maintainability harness is the easiest to build because substantial pre-existing tooling exists; the behavioural harness is the hardest and least solved.
- explicitdevelopedA codebase's harnessability is determined by its technical properties: strong typing, clear module boundaries, and framework abstractions increase it.
- explicitcontestedHarnesses are an attempt to externalize the implicit knowledge that human developers bring, but can only partially succeed.
- explicitdevelopedThe goal of a good harness is not to eliminate human input but to direct it to where it is most important.
- explicitcorroboratedLegacy codebases with high technical debt face a paradox: the harness is most needed where it is hardest to build.
- explicitcorroboratedBuilding the outer harness is an ongoing engineering practice, not a one-time configuration.
- implicitThe cybernetic framing (feedforward + feedback = governor) accurately describes what harness engineering is doing.
- explicitcorroboratedTeams may start choosing tech stacks partly based on what harnesses are already available, rather than purely on technical merit.
- explicitdevelopedAsking the model to introspect on its own mistakes reveals what misled it, enabling you to fix the harness.
- implicitdevelopedThe competitive advantage in AI coding tools resides in the orchestration layer (memory, multi-agent coordination, web search, session management) rather than raw model capability.
- implicitThe factory/manufacturing mental model is the default frame most organizations bring to product development operations, and it is the wrong frame.
- explicitFor a frozen model with zero weight changes, rewriting only the harness can match a frontier model's headline benchmark metric at roughly 7x lower cost per task — the leverage sits in the code around the model, not in the weights.
- explicitcorroboratedA benchmark score measures the model and its harness together; until the harness is fixed it is impossible to know which one failed.
- explicitMany apparent 'model failures' are mundane harness failures: the single biggest gain came from file handling — an automatic step that lands the deliverable exactly where the judge expects — not from intelligence, and with zero extra model tokens.
- explicitcorroboratedHarness improvement can be automated as a selection loop: a Claude proposer adds exactly one mechanism per iteration and an outer loop keeps it only if it clearly beats the current best, so accepted mechanisms compound.
- explicitdevelopedCode-layer harness fixes transfer across models, but prompt playbooks do not — the same harness lifted a smaller same-family model by 14 points, while the tuned prompts hurt a different model family on tasks it could already finish.
- explicitHarness choice dominates all other factors: with the same model, judge, and tasks, five different harnesses scored anywhere between 3.5% and 80.1%.
- explicitHarness gains eventually flatten; the residual misses look like real capability gaps, and past that point the model itself must carry the work.
- implicitdevelopedThe model is a fixed, substitutable commodity you rent rather than an asset you improve, so leverage accrues to the layer you own and can iterate cheaply — the harness — because model gains are exogenous and arrive on someone else's schedule.
- implicitcorroborated'Evolve the harness' means running a fitness-selection process that adds AND removes mechanisms to fit the current model — not monotonically growing scaffolding; the same author's deep-dive holds that harness complexity should DECREASE as models improve (Manus rebuilt 5x removing complexity; the future-proofing test rewards performance that scales with stronger models WITHOUT added complexity).
- implicitFor most teams the practical choice is harness-vs-nothing, not harness-vs-fine-tuning: because you cannot change a rented frontier model's weights, harness engineering is the only lever actually available, and the 'don't train' framing reframes where to look rather than adjudicating a live tradeoff.
- explicitTwo products built on identical models can differ wildly in performance based solely on harness design; the harness (orchestration loop, tools, memory, context management, verification, guardrails) is the product and is not a commodity layer.
- explicitModels are increasingly post-trained with specific harnesses in the loop, so model and harness co-evolve; the tight coupling means changing tool implementations can degrade performance, and a sound harness is one whose performance scales up with more powerful models without added complexity.
- explicitThere is a historical progression from weights to context to harness in how agent capability is delivered.
- explicitHarness engineering is not just another form of externalization but serves as the unification layer that governs the other three.
- explicitSelf-evolving harnesses and shared agent infrastructure represent the frontier of externalization.
- explicitestablishedFrontier models are converging on capability; competitive advantage now lies in the harness and application layer rather than model selection.
- implicitdevelopedThe tool harness surrounding a model (browsing, code execution, image analysis, sub-agents) is becoming as important as the model itself
- explicitAI is making technology evaluation itself harder, not just technology adoption, because semantic diffusion (overlapping new terms like 'spec-driven development' and 'harness engineering') and extremely short tool half-lives (some tools under a month old, built by one person with a coding agent) outpace the normal maturation cycle a radar relies on.
2026-05
- explicitThe longer the agent run, the more senior-engineer scaffolding must be enforced rather than merely suggested.
- explicitcorroboratedThe harness around the model is now as decisive for production performance as the model itself.
- explicitThe harness built around the model — not the model's raw benchmark capability — determines how Claude Code performs in a large codebase more than the model alone; teams who evaluate only model benchmarks are focused on the wrong lever.
- explicitThe harness has an intentional build order across five extension points — CLAUDE.md, hooks, skills, plugins, MCP servers — each layer building on what came before, plus two further capabilities (LSP integrations, subagents) that round out the setup.
- implicitThe article's whole harness-and-ownership prescription presupposes that engineering leadership is willing to fund a dedicated owner or team purely for agent-ecosystem management before usage data exists to justify the headcount — a resourcing commitment the article recommends but never quantifies in cost or ROI terms.
- explicitcorroboratedComparing open-weight models to closed APIs is a category error because APIs bundle models with harnesses, routing, and tooling that raw model weights don't include.
- explicit⚡ disputed & corroboratedOpen-source models appear weaker than they are because agent harnesses and surrounding tooling were optimized for proprietary APIs.
- explicitLimitations of vibe coding are a moving target tied to model and harness capability.
- explicitCross-cutting concerns (retries, fallbacks, logging, approvals, access control) are common enough across agentic apps to warrant a shared middleware vocabulary and prebuilt components.
- explicitMiddleware components should be stackable in defined order — execution order matters for correctness.
- explicitObservability of middleware behavior is part of the contract, not an afterthought — the Developer UI is co-released.
- implicitBorrowing the term 'middleware' from HTTP frameworks will make agentic-app authors immediately productive.
- explicitThe harness you build around a model now matters more than which model you pick.
- explicitcorroboratedAI product development has evolved through a sequence of phases: document completion → chat loops → tool-calling agents → DAG-based workflows → the harness era.
- explicitA step change in model capability in late 2026 (November-December of 'last year' from the article's perspective, i.e., late 2025) enabled the harness phase.
- explicitcorroboratedReplacing a bespoke application with a skills-driven agent harness lets domain experts read and modify agent behavior in plain English, without developer intermediation.
- explicitSkills-driven harnesses give domain experts a kind of control that wrapped commercial agent products do not.
- explicitStanford research shows performance gaps between a bare model and a well-designed harness now often matter more than which underlying model is used.
- explicitA future 'open agent protocol' will let agents move between environments and receive environment-specific skills from each environment.
- implicitReadability-by-domain-experts is the right measure of a good harness.
- implicitHarness design is a layer with its own engineering discipline, separable from model R&D and from application development.
- implicitThe right unit of comparison is bare model vs. well-designed harness (not bare model vs. bare model, or harness vs. harness).
- explicitReachability tracing (Stage: Trace) — determining whether attacker-controlled input actually reaches a bug from outside the system — is the harness stage that matters most.
- explicitHarnesses can be bootstrapped by asking the model itself to help improve the harness ('we used Mythos Preview to build on, tailor, and improve our original harnesses to suit its strengths').
- explicitCloudflare's harnesses are deliberately tuned to over-report (more noise, less missed), implying the harness must do downstream noise removal rather than upstream precision.
- explicitA SmallCode-style harness allows a 4B-active model to achieve 87% on some unspecified coding benchmark.
- explicitdevelopedEven the best harness will sometimes hit hard failures with small models, requiring cloud escalation as a fallback.
- implicitdevelopedThe harness, not the model, is the dominant lever in agentic coding performance — at least at the small-model end of the spectrum.
- implicitdevelopedCoding tasks are bounded enough that a 7B-20B model with a sufficiently constrained harness can complete them — i.e. the relevant agentic 'reasoning' is mostly about navigation, format compliance, and decomposition, not about latent intelligence.
- implicitThe agent harness — not the model — is where product differentiation and value creation now happen
2026-06
- explicitcorroboratedA model-agnostic 'harness' — tools, memory, data layer, permissions, prompts, routing, and evaluations — should be designed independently of the model, with the model plugged in only at the last step.
- explicitGoose is not incentivized to be token-verbose, unlike some proprietary agent harnesses (implying proprietary harnesses have a financial incentive to inflate token usage).
- implicitBuilding and maintaining a model-agnostic harness across multiple providers is assumed to be affordable and effective enough in practice that its benefit outweighs its engineering cost, and that swapping models behind such a harness preserves output quality.
- explicitcorroboratedClaude Code can now write and orchestrate its own custom multi-agent harness at runtime — a dynamic workflow — tailored to a specific task, rather than relying only on the one generic default harness.
- explicitStatic workflows (built with the Claude Agent SDK or `claude -p`) must be generic because they need to handle all edge cases in advance; dynamic workflows are possible now because the underlying model (Claude Opus 4.8) is capable enough to write a harness custom-built for one specific use case instead.
- explicitDynamic workflows use significantly more tokens than the default harness, so they are best reserved for complex, high-value tasks rather than default/regular coding tasks — the operative question is 'does this really need more compute?'
- explicitestablishedA team-scale agent harness must do three things a personal harness never needed to: remember decisions across people and sessions, coordinate several agents working in parallel without collision, and give a human a checkpoint for judgment calls — the same role a reviewer plays on a pull request.
- explicitA raw AI model is not an agent; it only becomes one when wrapped in a harness — the scaffolding that provides state, tool execution, feedback loops, and enforceable constraints — so securing vibe coding means securing the harness, not the model's code syntax.
- explicitEveryday agent failures most often trace back to a missing tool, a vague rule, or an absent guardrail — i.e., harness configuration gaps — which motivates replacing static Identity-as-a-Perimeter models with a dynamic 'Context-as-a-Perimeter' model.
- explicitThe large language model used by an AI coding assistant accounts for only about 10% of system quality; the other 90% is the harness — instructions, tools, context, guardrails, orchestration, and observability.
- explicitThe 'system evolution mindset': when a coding agent's output requires more iteration or correction than expected, the team should treat that as a signal to improve the harness itself (rules, workflows, guardrails) rather than only fixing the immediate bug, so that the system as a whole becomes more reliable over successive encounters with the same class of problem.
- explicitcontestedContrary to the source whitepaper's framing that developers should keep moving fluidly between 'conductor' (hands-on, file-level) and 'orchestrator' (goal-level, delegated) modes, a developer with a sufficiently reliable harness and rule set can 'graduate' to living in orchestrator mode essentially permanently, reserving conductor-level granularity mainly for deep debugging or initial exploration rather than as a recurring operating mode.
- explicitVibe coding has low upfront cost but high ongoing cost (burning large volumes of tokens iterating on unstructured, sloppy code because there is no system for the AI to follow); agentic engineering inverts this — high upfront investment in building the harness, then output that is three to ten times more reliable and cheaper at scale, with the crossover reached quickly enough to justify diving in early.
- explicitIn agentic engineering, the developer's primary output is the system that produces code — specifications, agents, tests/quality gates, feedback loops, and guardrails — not the code itself (the factory model).
- explicitestablishedThe model is only one input into a working agent; the harness (prompts, tools, context policies, hooks, sandboxes, sub-agents, observability) dominates the behaviour developers actually experience, demonstrated by harness-only changes moving a coding agent from outside the Top 30 to the Top 5 on Terminal Bench 2.0, and a separate LangChain study raising a score 13.7 points on the same benchmark by changing only the system prompt, tools, and middleware around a fixed model.
- explicitcorroboratedMost agent failures, examined honestly, are configuration (harness) failures — a missing tool, a vague rule, an absent guardrail, or a noisy context window — rather than model failures, even though the first instinct is to blame the model.
- implicitA team's incentive structure must actually reward the upfront CapEx investment (writing tests/evals before code, maintaining AGENTS.md as reviewed code, owning harness components as shared infrastructure) for agentic engineering's economics to pay off — otherwise the easier, cheaper-looking vibe-coding path wins by default under normal shipping-speed pressure.
- explicitdevelopedLoop engineering sits "one floor above" agent-harness engineering: the harness is the environment a single agent runs inside, the loop is the outer system that runs the harness on a timer, spawns little helpers, and feeds itself.
2026-07
- explicitcorroboratedAutonomous loops are the terminal stage of a discipline progression — vibe coding, then planning, then multi-phase plans, then Ralph — in which each stage trades more human prompting for more scaffolding; Ralph's specific advance is replacing a fresh human-written prompt per phase with one looped prompt plus a self-maintained TODO/progress state.
- explicitA loop is the smallest unit of agentic work — one agent gathering context, acting, checking the result, and repeating until a condition is met — and everything above it (harness, factory) is loops stacked on loops.
- explicitA harness is the environment around a loop (sandbox, tools, memory, done-gates) that makes an otherwise-unbounded model useful and safe to run; a raw model with no harness will spin forever.
- explicitIn the factory's closed-loop diagram, every stage is near-zero cost (generation, tests, static analysis, scanning) except the review gate, where human judgment lives — the sole expensive, non-scaling box in the pipeline.
- explicitOpenAI shipped ChatGPT Work, a harness extending Codex's agentic approach to general knowledge work: connectors for Notion, Google Drive, and Microsoft 365, cloud execution that keeps running after the user closes their laptop, and enterprise-grade access controls.
- implicit⚡ disputed & corroboratedFrontier model capability at the top labs is converging closely enough that competitive advantage is migrating from the model layer to the product/harness layer.
- implicitcorroboratedVendor-reported productivity claims for a new harness (OpenAI citing its own sales/finance teams and a partner's testimonial) are being treated as adequate evidence of real-world effectiveness.
- explicitThe hard part of AI-assisted root cause analysis is no longer the model's reasoning ability, but the harness/pipeline that decides what data reaches the model and in what shape.
- explicitdevelopedDeterministic pipelines that correlate signals up front and hand the model one fixed context let a wrong answer be attributed unambiguously to the model, whereas agent-based designs (and their bespoke tool-fetching choices) confound reasoning failure with harness failure.
- implicitBecause Coroot tested only one experimental scenario (one fault type, one set of anticipated confounds), the conclusion that reasoning is 'basically solved' generalizes a result from an in-domain, pre-anticipated case to AI RCA as a whole, without evidence about how models or the harness perform on incident types the correlation pipeline wasn't designed to expect.
- explicitLucena Coder achieved the lowest billed cost ($0.011665) and the lowest total token count (34,102, across 8 model calls) of any harness tested on GLM 5.2.
- explicitdevelopedGLM 5.2 (versus the prior GLM 5.1 run of this same benchmark) compressed the cost/token spread across harnesses but did not erase it — the heavier harnesses still spent materially more tokens even with aggressive caching.
- implicitcorroboratedHarness design, not the underlying model, is the dominant driver of token/cost efficiency differences among coding agents when the model is held constant.
- explicitdevelopedThe agent harness is the complete non-model software wrapping an LLM (orchestration loop, tools, memory, context management, state, error handling, guardrails, verification); the 'agent' is the emergent behavior, the harness is the machinery — 'if you're not the model, you're the harness,' and 'when someone says I built an agent, they mean they built a harness and pointed it at a model.'
- explicitEngineering the model's environment nests in three concentric levels: prompt engineering (the instructions) is inside context engineering (what the model sees and when), which is inside harness engineering (both plus tool orchestration, state, error recovery, verification, safety, lifecycle). The harness is not a wrapper around a prompt.
- explicitcorroboratedA production harness decomposes into a fixed set of named components — the prose walks through eleven (orchestration loop, tools, memory, context management, prompt construction, output parsing, state management, error handling, guardrails/safety, verification loops, subagent orchestration) under a 'twelve components' heading — synthesized across Anthropic, OpenAI, LangChain and the practitioner community.
- explicitThe orchestration loop is mechanically trivial — 'often just a while loop,' a 'dumb loop' where all intelligence lives in the model; the harness's complexity lives in everything the loop MANAGES (tools, context, memory, verification), not in the loop itself.
- explicitErrors compound multiplicatively — a 10-step process at 99% per-step success still yields only ~90.4% end-to-end — so the harness must classify failures (transient->retry-with-backoff, LLM-recoverable->return-as-ToolMessage, user-fixable->interrupt, unexpected->bubble-up) and cap retries (Stripe caps at two).
- explicitcorroboratedEvery production framework implements the same underlying pattern — an LLM-call node and a tool node joined by a conditional edge that loops until no tool calls remain — so the harness is a convergent, real architecture rather than an ad-hoc wrapper (Anthropic query()/dumb loop, OpenAI Runner + Codex three-layer, LangGraph state graph, CrewAI roles, AutoGen conversation patterns).
- explicitdevelopedBeyond the components, every harness architect faces seven design decisions, each a spectrum with empirical tradeoffs: single- vs multi-agent (maximize single first; split past ~10 overlapping tools), ReAct vs plan-and-execute (LLMCompiler 3.6x speedup), context-window strategy, verification design, permission architecture, tool scoping (Vercel removed 80% of v0's tools and improved; ACON 26-54% token reduction at 95%+ accuracy), and harness thickness.
- explicitdevelopedHarness complexity should DECREASE as models improve — scaffolding is temporary infrastructure removed when the building is complete (Manus rebuilt 5x, each rewrite removing complexity); the 'future-proofing test' is that a design is sound if performance scales up with more powerful models WITHOUT added harness complexity.
- explicitModel and harness co-evolve: models are increasingly post-trained with specific harnesses in the loop, so the coupling is tight — Claude Code's model learned to use its specific harness, and changing tool implementations can degrade performance.
- explicitThe harness is the product: two products on identical models can differ wildly in performance based solely on harness design (TerminalBench: a harness-only change moved agents 20+ ranking positions), so the harness is where the hard engineering lives, not a commodity layer — even as the field trends toward thinner harnesses, the harness never disappears.
- implicitcorroboratedDomain teams, not a central platform/governance team, should own the semantic definition and business logic of their data products, while a shared, centrally-run orchestration layer (the mesh/gateway) handles cross-cutting standardization, discovery and enforcement.
- implicitAnthropic's Claude Code harness is valuable independently of Anthropic's models and can — and should — be decoupled from the model behind it, so you keep the harness and its updates while choosing the model.
- implicit⚡ disputed & corroboratedThe model is a swappable, commoditized component; the durable value sits in the harness — the agent loop, tools, and UX — that wraps it.
- explicitClaude Code can now orchestrate subagents from a script Claude itself writes, triggered by the keyword 'ultracode' or by asking Claude to 'use a workflow' — generating task-specific subagent structures for codebase audits, large migrations, and cross-checked research, rather than using one generic harness for every task.
- explicitSwapping the coding harness (OpenCode vs. Pi) made little difference on the hardest tasks.
- explicitA colleague (Jigar Jani) does almost all of his coding with Qwen 35B MoE (4BIT) on a 48GB MacBook against a real-world Python and React codebase by continuously enhancing his harness with skills (Graphify, Understand Anything), while stressing that code review is essential.
- implicitAs model capability drops, more of the burden shifts to the harness and the human — deliberate harness engineering (skills, code-search/understanding tools) is what makes near-all-local coding workable.
- implicitViability is a relation among model, task, harness, and hardware rather than a property of the model alone, so a personal, intuition-building practice ('knowing when to reach for it') is currently the only reliable selection method.
- explicitcorroboratedThe field moves so fast that 'harness engineering' became a widely-discussed term within months, though it was not even a term at the earlier Utah retreat.
- explicitcorroboratedLLMs imitate and amplify the existing code they see, so pre-existing design problems get magnified rather than corrected — even with a good harness.
- explicitThe Thoughtworks report's five headline findings from the retreat are: code generation is no longer the bottleneck (verification is), 'harness engineering' is emerging as a distinct discipline, organizations face a real apprenticeship crisis, the executive/engineer expectation gap is a bigger risk than any technical limitation, and legacy modernization is the clearest near-term value pool.
- implicitMulti-agent orchestration in Genkit is an application-layer composition of the same chat() primitive (middleware injects a delegation tool per sub-agent) rather than a separate architecture requiring dedicated infrastructure.
- explicitFable 5's safety classifiers (offensive cybersecurity, biology/life sciences, extraction of summarized thinking) return stop_reason 'refusal' as an HTTP 200 (not an error), so error handling must check stop_reason separately from HTTP status; configure fallback to Opus 4.8 (SDK middleware provided). Refusals affect under ~5% of typical developer queries; Mythos 5 removes the cyber classifiers (Glasswing partners only), and for everyone else cyber-adjacent work routes to Opus 4.8 at Opus pricing.
- explicitWorkflow-heavy agent architectures are too brittle to handle real-world unpredictable inputs (e.g. compound questions); the model-driven approach -- system prompt, tools, and a model -- is both easier for developers to adopt and more reliable than heavy scaffolding.
- explicitThe more scaffolding and workflow structure is built around a model, the worse the agent performs -- over-architecting for rare failure cases degrades performance in the common, happy-path cases.
- explicitThe real payoff of the model-driven approach is that adopting a more capable new model should require changing as little as one line of code (the model identifier) -- which only holds if the team hasn't built heavy custom scaffolding tightly coupled to the current model's specific limitations.
- explicitAn agent framework is essentially a while loop -- cycling through model calls and tool execution until the model yields; an agent harness is the additional layer (context management, memory, persist-and-resume state, self-tracking tools like task lists) needed to sustain long-running, complex, multi-turn tasks beyond what a bare loop supports.
- explicitComfort with discarding previously built, hand-written scaffolding as newer models make it unnecessary is a difficult but necessary engineering habit specific to this domain -- unlike traditional software, where written code tends to persist rather than be actively unwound.
- explicitThe Optimiser model risks a software equivalent of 'grey goo' — unbounded agentic change — which can be mitigated by a continuously evolving central, shared harness of architecture guidance and engineering rigour.
- explicitHarness engineering teams are already emerging, but dedicating separate teams to harnesses likely repeats the DevOps-team mistake, because the friction of each team building its own harness is generative and creative rather than pure waste.
- explicitBecause skills are plain Markdown files, the same skill pack can function as harness-agnostic infrastructure across essentially every major coding-agent surface, rather than being tied to one vendor's tool.
- implicitCursor's decision to publish these efficiency statistics is itself a competitive signal — it frames Composer as low-cost and reminds builders that matching Cursor's caching efficiency in a home-rolled agent harness is non-trivial.
- explicitdevelopedBy May 2026 [article's timeline, likely meant 2025], all three major AI coding harnesses (Codex, Hermes, Claude Code) had shipped a native /goal command that reproduces the Ralph loop's behavior in a single command, collapsing what used to require custom DIY setup.
- explicitestablishedWhen migrating from Opus 4.8, treat the capability jump as a prompt to re-evaluate and prune existing instructions, tools, and guardrails — some prior scaffolding is no longer needed.
- explicitcorroboratedRestructure harnesses for asynchronous, long-running execution — adjust client timeouts, streaming, and progress indicators, and check runs asynchronously (e.g., scheduled jobs) rather than blocking — because individual hard-task requests can run for many minutes at higher effort and autonomous runs for hours.
- explicitAvoid surfacing explicit context-budget or remaining-token counts to the model; if the harness must show them, add reassurance ('you have ample context remaining') — this prevents Fable 5 from prematurely suggesting a new session, summarizing, or trimming its own work (context anxiety).
- explicitAn agent harness is the non-model software — the loop, tool execution, context management, state, and safety layer — that surrounds the LLM at runtime, distinct in scope from prompt engineering (a single call) and context engineering (what the model sees).
- explicitHow much harness a task needs is determined by two independent variables: action complexity (tools, decisions, dependencies, handoffs to coordinate) and context complexity (information to gather, retain, retrieve) — and the two can move independently (e.g., a support agent can be action-heavy but context-light).
- explicitThe core reasoning loop of a functioning coding or search agent can be implemented in roughly 60-130 lines of Python, showing the underlying agentic-loop pattern stays small even as the surrounding harness that builders actively extend (AGENTS.md instructions, skills, evals) grows large.
- explicit⚡ disputed & corroboratedHarness features expire as models improve because each component encodes an assumption about a model limitation that becomes false once the model absorbs the capability (the 'Kirby effect') — concretely: chain-of-thought prompting was absorbed into reasoning models trained via RL on CoT traces, and Amp removed its experimental 'plan mode' once models could reliably obey a single 'plan, don't edit' instruction.
- explicitMajor agent products have had to substantially rebuild their harnesses repeatedly to keep pace with model improvements: Manus was re-architected five times in a year, LangChain's Open Deep Research was rebuilt multiple times, and even Anthropic rips out Claude Code's harness as Claude improves.
- explicitA production support agent (Maven Assistant, at Maven Clinic) reached single-turn resolution for essentially all initial external conversations and needed almost no memory or compaction, while still requiring domain routing to sub-agents, tools bounded per sub-agent, deterministic guardrails run before the LLM, and explicit human-handoff rules (e.g., automatic transfer on self-harm language) — i.e., low context complexity but moderate action complexity, resolved with a different harness toolkit than a coding agent's.
- implicitBecause harness needs are read off a task's position on the two complexity axes rather than off its being 'an agent' at all, the coding-agent harness playbook currently dominating public discourse is a poor default for most other builders, and copying it produces over-engineered, over-costly systems for tasks that don't need it.
- implicitPublic discourse about harness engineering is disproportionately generated by coding-agent and personal-agent builders even though the author states most builders will build support, sales, and enterprise agents instead — an availability-bias skew the essay names but does not explain.
- explicitWhether eval/testing infrastructure counts as part of 'the harness' is a genuinely unsettled definitional boundary among practitioners: Vivek Trivedy's account treats the harness as runtime-only, while Hamel Husain argues the eval harness belongs inside the definition too — and the author defers resolving it to a future conversation.
- explicitRegardless of complexity level, a fixed set of harness fundamentals remains durable: reasoning loops with tools/state/control-flow, prompt and tool-schema design, context and memory management, structured outputs/traces for debugging, guardrails and human handoffs, using SDKs/MCP without outsourcing system design, scheduled/event-driven work via hooks, and evals covering task success, tool use, guardrails, and handoffs.
- explicitcontestedBefore reaching for compaction, memory, handoffs, or sub-agents, builders should map the task on the action-complexity/context-complexity axes; if both are low, keep the harness small, add infrastructure only when a real observed failure demands it, and revisit or remove additions whenever a stronger model arrives.
- implicitBecause the Kirby effect makes harness components' usefulness time-bounded, engineering effort invested in a harness feature has a built-in short amortization horizon — a component built to work around today's model limitation is, by design, waste once a future model no longer needs it.
- explicitHarness overhead (system prompt size, number of tools, active skills/MCP servers) consumes context budget that is scarcer locally than in cloud setups, making harness choice a resource decision as much as a UX one.
- explicitDifferent coding harnesses use inconsistent parameter names for the same basic tool operations (e.g. edit-file arguments), and this schema variance itself contributes to small models' tool-calling failures.
2026-08
- explicitQuality control relocates into the harness, environment, and operating system surrounding the agent, rather than residing in the code or in code review.
- explicitThe long-term destination for agentic platforms is a single orchestration layer that people interact with exclusively (like an event broker composing a wedding), replacing today's model of agents sprinkled on top of an unchanged platform -- this requires rebuilding the platform's core, not adding a layer to it.
- explicitCoding-agent configuration has a half-life: as models improve and harnesses add capabilities, instructions written for an older state stay behind and lose value, but the file doesn't shrink on its own.
- implicitPeople keep configuration items around less because they are still useful and more because removing them feels unsafe — usually an unexamined bet that the model and harness have not actually improved since the rule was written.
- explicitCharity's own turning point toward seeing AI as generational change came in November 2025, driven more by the coding harness (Claude Code) becoming serious infrastructure than by the underlying model (Opus 4.5) itself.
- implicitThe legitimacy of updating from 'skeptical' to 'not skeptical' rests on tracking the harness/tooling layer around a model, not just the model's raw capability — implying that AI-skepticism assessments should be re-run whenever the harness materially changes, not only when a new model ships.
- explicitThe cost of coding agents is driven not only by the task or the model, but by randomness and by the harness — the scaffolding that manages context, runs tools, and decides when to stop.
- explicitdevelopedPublic benchmarks, even good ones built from real work like SWE-bench, are insufficient for engineering decisions — organizations need their own evals, built as shadow comparisons of a candidate model or harness against an incumbent on the same production work.
- implicitTreating model selection as a standalone decision (frontier vs. cheap) is a category error — the model, harness, context architecture and execution environment must be evaluated and chosen together as one coupled system.
- explicitAs models become cheaper and more interchangeable, power and differentiation shift to the agentic harness — the software layer between users and model that decides what an application can access, remember, and act on — rather than remaining in the model weights.
- explicitBig AI labs are quietly locking up the harness layer, analogous to tractor manufacturers who kept farmers as owners on paper but renters in practice by retaining control of the embedded software.
- implicitThe loudest AI-safety arguments arrived around the same time models became cheap and interchangeable enough that real competition had to move up to the harness layer, suggesting the safety framing functions partly as competitive positioning rather than purely disinterested concern.
- explicitLoop engineering sits one abstraction level above harness engineering in a four-layer trajectory (prompt → context → harness → loop), where each layer subsumes the previous one and the harness layer refers specifically to the outer harness developers assemble.
- explicitLoop engineering's novelty as a discipline is genuinely contested among practitioners — critics call it 'a renamed cron job' and argue that explicit loop-building will be absorbed into tool vendors' default harness features (e.g., /loop, /goal), making the current explicit practice transitional.
- explicitIf loops become a common operating mode, the unit for evaluating coding agents should shift from a single bounded-task benchmark run to a loop operating over time — where convergence, cumulative cost, drift, and escalation quality matter — extending the already-open problem of harness-level evaluation.
2026-09
- explicitReal AI sovereignty requires open-source technology to proliferate beyond open-weight models into every layer of the stack: agent harnesses, inference engines, orchestration/data protocols, vector/knowledge stores, and observability/evaluation tooling.
- explicitThe orchestration layer above model weights (agent harnesses) is where capability is now concentrating, and closed labs are already 'welding it shut' — making open harnesses strategically as important as open weights.
- explicitBecause agents act at machine speed, prompt-based instructions cannot serve as a security boundary — enforcement must instead happen structurally, at the network and harness layers, via short-lived, task-bound credentials with a capability ceiling.
- explicitHarness engineering is the discipline of imbuing a repository with an organization's standards so the repository itself enforces them: permissions/boundaries, fail-closed quality gates, evidence attached to every change, and cross-run observability.
- explicitMultiple firms (Thoughtworks, LangChain, and others) independently converging on the term 'harness engineering' around the same time indicates they are naming the same underlying structural problem, not coining unrelated marketing terms.
- explicitYou can buy model access, but you cannot buy the harness, because the harness is an organization's own standards made enforceable in its own repositories.
- explicitWhen the gate-checking infrastructure itself has a problem (e.g. an error probing which required checks passed, or a spend limit hit mid-run), the harness should stop the day's work outright rather than continue or silently degrade, because silent degradation destroys trust and can blow through budgets.
- explicitAs a harness matures, human code review shifts from reading every diff to auditing verdicts and sampling deeply where the evidence looks thin — the same quality bar held at a higher operating altitude, not a lowered one.
- explicitcorroboratedOrganizational governance of AI-augmented engineering can be compressed into four elements — Purpose (what the work is for), Articles (what must remain true), Actors (who/what does delegated work), Artifacts (what is preserved and remembered) — with the harness making Articles executable, people and agents staffing Actors, and evidence/ledgers becoming Artifacts.
- implicitInvesting in a harness produces, in effect, a development organization operating inside the repository that reports to its owner, not merely a smarter delivery pipeline.
- explicitAs models get smarter, the harness around them must grow more complex, not simpler — capability growth increases rather than eliminates the need for harness engineering.
- explicitAnthropic's own incident rate has risen as a byproduct of higher development velocity, and the countermeasure under active development is to use Claude to build a better testing/deployment environment (replaying real requests against mock fixtures, broad chaos testing) rather than slowing code velocity down.
- explicitIndividually-built, informal tooling and harness experimentation (personal Claude Code setups, scheduling bots, multi-pane sessions) is common at Anthropic and treated as part of the job, with successful experiments later folded into the shared product.
- explicitModern LLMs enable a new architectural primitive — an orchestration layer that dynamically reasons across specialized data systems — rather than replacing databases.
- explicitThe orchestration layer should be decoupled from any single LLM provider, with model fallback for throttling resilience, to avoid architectural lock-in as pricing and model quality shift.
- explicitPAIR integrates with existing local inference services such as Ollama and LM Studio without requiring changes to the underlying architecture or agent harness, acting as a proxy in front of the familiar local interface the agent already expects.
- explicitEvery customization should be kept in the codebase rather than scattered across a developer's machine, a harness's install folder, or enterprise-level defaults, so anyone on a new machine or using a new harness ends up with the same setup as everyone else.
- explicitRebuilding an environment exactly from a logged file-and-hash history (a frozen/locked install) is more reliable for team consistency than re-resolving a manifest from scratch each time.
- explicitEngineers must own the outer loop — the accountability for agentic systems (harnesses, loops, fleets, software factories) — and this becomes more true, not less, as more powerful models become available.
- explicitAn agent is a model plus a harness (files, tools, memory, skills, sandboxes, permissions, observability, recovery); a loop is investigation, implementation, verification, repeat; a factory is what running many loops at scale creates.
- explicitAt the heart of the factory is a careful boundary: inside the system, agents do capability work (investigate, implement, verify); outside the system, humans exercise agency (decide, verify, approve, own); evidence is what crosses the boundary.
- explicitAccountability is what scales the factory: without someone owning the consequence of a decision, high agency produces only chaos, because only people — not agents — can choose and inherit consequence.
- implicitAccountability is treated as an individually-held property — a named person's Verdict and signature — rather than something that can be distributed to a committee, a policy document, or the harness itself.
- explicitThe value of AiKA modes lies in the router/harness layer (mode definitions plus hooks, scripts, and skills), not in the specific worker model chosen — modes are reusable across projects, shareable across a company, composable into new roles (doc-writer, reviewer, translator), and decouple the routing decision (the plugin's job) from the response (the mode's job).
- implicitThe router/harness layer, not the choice of worker model, is what makes the pattern reusable, shareable, and composable across projects and teams.
- explicitProduction AI agent failures largely occur not from model hallucination but from harness gaps, where the model behaves coherently but the surrounding system fails to record, order, bound, authorize, or prove its actions.
- explicitA model can only propose an action; the harness decides whether the proposal becomes reality, and the receipt is the evidence that it did.
- explicitWhen two writers can touch the same mutable state, 'last writer wins' is not a valid consistency model; the harness must own and enforce a single ordered commit path (serialize same-process writes with a queue, protect cross-process writes with a lock).
- explicitcorroboratedThe Harness Blueprint (event -> session key -> lane -> throttle -> tools -> audit trail) generalizes across essentially all agent products — personal assistants, coding agents, support agents — because in every case the model's API is stateless between turns and the harness must reassemble working context each time.
- implicitBecause the harness, not the model, is what makes an agent auditable and recoverable, harness quality is the binding constraint on whether an agent can be safely operated in production, independent of model capability.
2026-10
- explicitA tool call is not a qualitatively different, ethereal agent-environment interaction; it is an LLM emitting JSON that deterministic code then acts on, structurally identical to any other JSON-producing LLM call.
- explicitAgent Skills is a system for bolting senior-engineer scaffolding back onto an AI agent by making the invisible, critical steps non-negotiable rather than optional best practice.
- explicitWhen an engineer orchestrates a fleet of autonomous agents instead of writing code directly, the engineer's actual job becomes building and operating 'the factory' — the system that manages parallel agents handling implementation.
- explicitIn an agentic workflow, test-driven development stops being optional ceremony and becomes the mandatory safety system that prevents the factory from stalling or shipping incorrect output.
- explicitThe engineer's role in 2026 shifts from hands-on coding to designing the environment (systems, scaffolding, leverage) in which agents write the code, and this shift confers a meaningful head start to those who adopt it early.
Tensions
What kind of problem is AI adoption in software development, and who is the responsible actor for fixing it?
from: Is skepticism/rejection of AI for software development still rational in 2026 — and where exactly do practitioner "adopt fully" and "abstain entirely" positions actually diverge: on the facts (does AI work), the values (what counts as harm), or the frame (individual choice vs. systemic problem)?
- Stop being skeptical about AI for development with Charity Majors (Charity Majors): An engineering and organizational-leadership problem, solved inside the firm by building validation discipline and rebuilding trust between camps.
- I'm done using AI (Brett Codes): A personal ethical problem, solved by individual non-participation.
- The growing AI backlash (Gary Marcus): A political/regulatory problem, solved by governments constraining the industry.
Assessment: These aren't competing answers to the same question — they're answers to three different questions about where causal and moral leverage lies (org-technical, individual-ethical, political-collective), and the corpus never stages a direct confrontation between them. The weakest of the three on its own terms is Brett's: his abstention argument depends on an untested demand-signaling causal claim, and Marcus's own regulatory framing implicitly undercuts it — if the effective lever is political, one person's abstention is symbolic rather than causally load-bearing, however psychologically necessary it may be for him. Majors's org-engineering frame is the most operationally developed but explicitly scopes itself to teams that already have the discipline to execute it — it has nothing to offer someone in Brett's actual position (an individual contributor under a leadership mandate, with no control over org-level tooling investment).
Does verification/validation substitute for human care and authorship as the basis of software quality?
from: Is skepticism/rejection of AI for software development still rational in 2026 — and where exactly do practitioner "adopt fully" and "abstain entirely" positions actually diverge: on the facts (does AI work), the values (what counts as harm), or the frame (individual choice vs. systemic problem)?
- Stop being skeptical about AI for development with Charity Majors (Charity Majors): Yes — trust can and should relocate from authorship to process; once validation is good enough, shipping code nobody read is not a quality failure.
- I'm done using AI (Brett Codes): No — quality is constituted by care, which only a human relationship to the artifact supplies; verification does not substitute for it, even AI reviewing AI.
Assessment: A genuine values disagreement, not a disguised factual one, and under-argued on both sides. Majors asserts a substitution (trust moves from person to process) as self-evidently sufficient without ever specifying what validation would need to guarantee to make 'comfortable shipping unread code' true in practice — a gap her own extraction already flags. Brett asserts the opposite from pure introspection, without considering that his felt alienation might be a contingent response to a personal transition rather than a fact about what quality requires in principle — plenty of trusted professional domains (structural engineering, aviation, pharma) run on process-based rather than personal-craft-based trust and aren't usually accused of producing 'uncared for' outputs. Neither side defends its definition of quality against the other's; each asserts its own as obvious.
Does sustained, earnest, disciplined AI use degrade or improve a competent practitioner's skill and output?
from: Is skepticism/rejection of AI for software development still rational in 2026 — and where exactly do practitioner "adopt fully" and "abstain entirely" positions actually diverge: on the facts (does AI work), the values (what counts as harm), or the frame (individual choice vs. systemic problem)?
- Stop being skeptical about AI for development with Charity Majors (Charity Majors): AI use, wielded by disciplined teams, produces real capability gains without degrading quality, provided validation investment keeps pace.
- I'm done using AI (Brett Codes): Sustained AI use degraded his skill, care, and output quality over more than a year, despite being an experienced, motivated, initially-skeptical, earnestly-trying practitioner.
Assessment: Both are single-case evidence dressed as general claims, and the corpus offers a plausible reconciling variable neither author controls for: Parker's joy-gap data shows the split tracks codebase type (greenfield/small-product vs. legacy/enterprise) more cleanly than it tracks practitioner discipline or virtue. Fin is not described as legacy-constrained, and Brett's own most damning anecdote — the Linear/Claude Code project built 'without editing a line of code' — is closer to greenfield vibe-coding than to his day-to-day legacy work. The Majors/Brett disagreement may therefore be less a disagreement about AI's general effect on skilled practitioners and more two data points from different ends of Parker's spectrum, each over-generalized past its actual scope.
Is a moderate, bounded middle path between full adoption and full abstention psychologically and practically stable?
from: Is skepticism/rejection of AI for software development still rational in 2026 — and where exactly do practitioner "adopt fully" and "abstain entirely" positions actually diverge: on the facts (does AI work), the values (what counts as harm), or the frame (individual choice vs. systemic problem)?
- Stop being skeptical about AI for development with Charity Majors (Charity Majors): Yes — bounded, disciplined use is not only viable, it's the responsible default: small deliberate acts of withheld participation (no-AI Wednesdays), a rule against sending unread AI output, and validation discipline are all presented as workable, sustainable practices.
- I'm done using AI (Brett Codes): No — for him, moderate/trivial-only use was tried and did not hold; he kept reverting to using AI for everything, and concluded the choice is effectively binary.
Assessment: The sharpest values/psychology divergence in the corpus, and arguably what the central question is actually asking about, since 'is skepticism/rejection rational' presupposes a real choice-menu with a stable middle rung. Majors's evidence for stability (a team ritual everyone follows together) is a much weaker test than Brett's (a year of earnest solo attempt at bounded use against colleagues' and management's full-throttle adoption) — a shared team policy is a different psychological ask than one individual holding a line alone, which is closer to Brett's actual situation. On the specific question of whether bounded use holds under social/organizational pressure to go further, Brett's case is more probative than Majors's, even though his conclusion ('so it must be all-or-nothing') over-generalizes a personal finding into a universal claim.
Is 'skepticism' (doubting AI's capability) the same stance as 'rejection/abstention' (refusing to use AI), and does 'still rational in 2026' apply equally to both?
from: Is skepticism/rejection of AI for software development still rational in 2026 — and where exactly do practitioner "adopt fully" and "abstain entirely" positions actually diverge: on the facts (does AI work), the values (what counts as harm), or the frame (individual choice vs. systemic problem)?
- Stop being skeptical about AI for development with Charity Majors (Charity Majors): Effectively treats them as one stance: her essay is titled 'stop being skeptical about AI for development,' and her prescription for skeptics is to use AI more, with more validation discipline.
- I'm done using AI (Brett Codes): Demonstrates, without arguing it explicitly, that the two stances are separable: he is not skeptical of AI's capability, yet rejects use entirely on other grounds.
Assessment: This is the central question's own hidden ambiguity, and the corpus resolves it by demonstration rather than argument. Brett is a live counterexample to the premise, embedded in Majors's own title, that 'not being skeptical' (updating on capability evidence) and 'using AI' are the same move. Once separated, Majors's essay is only an argument against doubting-that-it-works, and has nothing to say to someone who concedes capability and objects on different grounds. So 'is skepticism still rational in 2026' and 'is abstention still rational in 2026' are different questions the corpus never poses side by side — and the practitioner discourse largely collapses them into one fight when they aren't the same fight. On the narrower question Majors actually argues (is doubting AI's capability still rational), the corpus evidence favors her: nobody, including Brett, disputes that current tools work. On the broader question the central question is really asking (is abstention still rational), the corpus offers no resolution at all — only two incompatible frames (organizational-engineering vs. individual-ethical) that never engage each other directly.
What replaces PRs?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
- Laforgia (Four Eyes): Replace PRs with a composite control: policy + commit trailers + enforcement hooks + telemetry + quarterly sampling audit. Pair programming is the substance; structured artefacts capture the evidence.
- Laforgia (T*D): The convergent T*D pattern (TDD + TBD + TFD) makes the question moot. Review is continuous; no separate replacement needed.
- Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle (Parker): Fundamental SDLC redesign required, but the endpoint is unclear. Names the problem rather than the replacement.
- Developer ramp-up time continues to accelerate with AI (Engineering Enablement): Silent — operates inside PR paradigm. Implicit: keep PRs, just compress the cycle.
- Henrik Kniberg's Post (Kniberg): Agents author the PRs; humans review the output. The PR becomes a transactional artefact between agent producer and human verifier.
- On Pair Programming (Siessegger): Pair by default, PR for exceptions (solo production changes). Explicit middle path.
- From Async Code Reviews to Co-Creation Patterns (Stepanović): Maximal co-creation. Drive PR transaction cost to zero by making review continuous. Optimal batch size approaches 1 line.
- Trust Factory (Beck): No direct prescription for a PR replacement, but 'slow development to create space for person-to-person interaction' implies pairing and mob programming as the structural answer. Beck's logic further implies that solo PR review — whether reviewing human or AI-authored code — is itself trust-negative: the single-player problem applies to the reviewer, not just the author. Laforgia's Four Eyes composite control is the closest existing instantiation of what Beck is gesturing at: it operationalizes the trust-preserving form of review (pair programming as substance) rather than solo PR review as artefact-checking.
Assessment: Three axes of disagreement. (1) How much PR ritual to keep — Laforgia Four Eyes keeps the artefact-shape via trailers; Siessegger keeps PR for solo exceptions; Stepanović eliminates the PR-as-event entirely. (2) Whether to engage AI as part of the answer — Kniberg pushes furthest; Parker names the problem; Beck provides the theoretical basis for why the social architecture around the LLM determines the answer. (3) What the unit of value is — for Laforgia it's the evidence of control; for Stepanović it's throughput; for Beck it's trust accumulation; for Kniberg it's human cognitive bandwidth. The Kniberg position (agent-authored PRs, human verifier) is now further complicated by Beck: a human reviewing an agent's PR alone is in single-player mode — trust-negative even when the compliance and quality boxes are checked. Kniberg's more expansive vision (humans focused on higher-level design in a multi-agent team) may preserve trust; the PR-as-solo-review-act does not.
What is code review primarily FOR?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
- Siessegger / Stepanović: Quality production + accelerated learning. Review's purpose is built in at the moment of writing.
- Laforgia (Four Eyes): Compliance evidence is real; quality is what pairing produces; the two are separable controls.
- Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle (Parker): Quality at scale. Worries about reviewing 10,000-line PRs OR 10,000 single-line PRs — neither is feasible. Quality is the dominant lens.
- Henrik Kniberg's Post (Kniberg): Verification of agent output. Review is the human safety check on autonomous production.
- Trust Factory (Beck): Trust manufacture between practitioners. Every team practice is primarily a trust production mechanism: trustworthy behavior → trustworthy software → trust between humans. Quality and learning are downstream effects, not primary purposes. The practitioner is changed by the practice (trustworthy behavior becomes structural, not effortful), not just the product.
Assessment: Beck's addition is the most significant divergence contribution in v2. He fills the 'review-as-cultural-induction' gap the original panel flagged: pairing produces trust-as-induction (the practitioner is changed by being held accountable in structural ways) rather than merely information-transfer-as-induction. This is not in conflict with the other positions — it provides the mechanism that makes those answers work and sustainable. Quality (Siessegger/Stepanović), compliance (Laforgia), and verification (Kniberg) are all downstream of trust accumulation, on Beck's account. The live disagreement is no longer simply 'PR vs not PR' — it is: if trust is the primary function, and trust requires person-to-person interaction that cannot be manufactured by code artefacts or automated review, what is the minimum set of practices that preserves trust in the AI-augmented era? Architecture-coherence review (the senior reviewer who refuses design-wrong changes) remains unaddressed by all panel members including Beck.
Is AI-accelerated coding a feature or a threat to existing workflows?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
- Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle (Parker): Threat. The joy gap is asymmetric harm; AI overwhelms the parts of the workflow it doesn't help.
- Henrik Kniberg's Post (Kniberg): Feature. Agents become teammates; the human team gets to focus on higher-level work.
- Developer ramp-up time continues to accelerate with AI (Engineering Enablement): Feature. Faster ramp-up is intrinsically good (with caveats).
- Laforgia (both), Siessegger, Stepanović: Silent / predates AI. Their frameworks still apply but they don't engage the question.
- Trust Factory (Beck): Structurally a threat when deployed in single-player mode (one human + LLM genie, bypassing team interaction). Potentially trust-preserving when deployed in multi-player or team-mediated form (pairing with LLMs inside the team structure, not replacing it). Beck distinguishes the technology from the deployment architecture — the LLM is not inherently anti-trust; the single-player usage pattern is.
Assessment: Beck triangulates between Parker (threat) and Kniberg (feature) with the most analytically precise position in the corpus: the social architecture around the LLM determines whether it's a trust factory or a trust destroyer. This has a direct implication for the PR question: AI-authored code reviewed by a solo human is the worst configuration — two single-player failure modes stacked (AI authoring + human solo review). The crucial remaining gap: no one has produced a synthesis treatment that combines Stepanović's Reinertsen math with Beck's trust-asymmetry argument and Kniberg's agent-as-author shift. Stepanović's framework directly implies AI in-context review could be a near-zero-cost reviewer; Beck's framework implies that same review is trust-negative if done solo. The two arguments together demand a configuration — team-mediated AI code review — that none of the panel members has yet theorised.
Is high-performing software practice context-independent?
from: Are pull requests still necessary in software engineering, given trunk-based development and pair programming alternatives, AND given AI-accelerated code generation that radically changes the volume and nature of code authorship?
- Laforgia (both), Siessegger, Stepanović: Yes — high performance has a coherent shape (DORA/Accelerate orthodoxy).
- Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle (Parker): No — the joy gap is context-dependent. Greenfield and legacy diverge sharply.
- Henrik Kniberg's Post (Kniberg): Implicit yes — Abundly's practice extrapolates.
- Developer ramp-up time continues to accelerate with AI (Engineering Enablement): Implicit yes — aggregate metric across 400 companies.
- Trust Factory (Beck): Silent on context-dependence; the trust factory claim is presented as universal. However, Beck's own unaddressed gaps (the cultural specificity of trust, whether XP worked because of practices or pre-existing high-trust subculture) suggest a context-dependence he does not engage.
Assessment: Parker is the lone explicit voice for context-dependence. Beck's trust factory framing is implicitly universalist — but his unaddressed gaps echo Parker's concern from a different angle: if trust factories only work in pre-existing high-trust organizational contexts, the adoption prescription fails precisely where it is most needed.
Is code a durable artifact humans must keep reading, or an ephemeral byproduct regenerated from a spec?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Code is potentially ephemeral — a disposable byproduct the agent regenerates from the spec on demand; the spec, where a developer's taste now lives, is the thing that matters.
- Why did Martin Fowler invite 60 engineers to a ski resort? (Ivett Ördög): Code must remain human-legible and maintained; agents behave better as 'engineers' moulding a persistent codebase than as 'compilers' regenerating from scratch.
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Skeptical of throwaway regeneration; unconvinced code can be discarded and regenerated at will — bets that code largely stays.
Assessment: The retreat's own 'largest divide' (Ördög). It is unresolved inside the room and inside the individual essays: Herlein concedes the deterministic 'code is the better spec' counter is 'hard to wave off', and Ördög reports being ironically pulled toward the dark-factory camp by her own good-code practices. The crux is whether a fuzzy prose spec can ever be the durable source of truth when the stated quality bar is verifiability — a tension none of them resolves.
How much of the build pipeline should run with no human reading the code (the 'dark factory')?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): Toward a largely self-evolving software factory where a feature request is 'magically built' into the system; humans build and operate the factory and intervene only at explicit hand-off points.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Deliberately bounded autonomy — keep humans in the loop.
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Dark factories are only safe for organisations that already have high test coverage, skilled engineers, and a high-quality engineering culture; most should cover their fundamentals first.
Assessment: Not simple optimism vs pessimism but a disagreement about preconditions and hidden costs. Ocytko's is a projection of where tooling is heading; Bangser and Verraes both supply reasons the projection is unsafe by default — learning-loss and missing prerequisites. Bangser has the stronger argument that the loss is structural (you cannot buy back organisational learning), which even an improving platform does not address.
Should the harness/platform-building function be centralised, or emerge per-team?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Notes from FOSE Europe (Giles Edwards-Alexander): Dedicated harness-engineering teams are a mistake; the friction of each team building its own harness is generative and creative.
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): A centralised platform / 'software factory' with tight, low-friction constraints should absorb operational concerns and guide both citizen developers and their agents from the first prompt.
Assessment: A precise split about the organisational form of the scaffolding, not its existence: both want shared architecture guidance, but Edwards-Alexander wants the building capability distributed (friction as feature) while Ocytko wants it concentrated in a platform (constraint as feature). Each concedes the other's pole — Edwards-Alexander keeps a central harness; Ocytko warns against over-constraining — which is why this is a live, unresolved tension rather than a clean contradiction.
Reversibility as a hedge vs a one-way commitment to deeper autonomy.
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Build systems that can revert from agent generation back to human engineering.
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): Head toward a self-evolving software factory — a progressive, largely one-directional build-out of autonomy and platform capability.
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Commit early and hard, because adoption is a compounding flywheel and the lead becomes a permanent structural moat.
Assessment: Incompatible risk models. Verraes treats deep AI-dependence as the danger to insure against; Herlein treats not-committing as the existential danger. They cannot both be the rational strategy: reversibility trades some upside for exit options, while flywheel-commitment trades exit options for compounding lead. The tie-breaker is empirical (will access/economics deteriorate?) and neither has evidence — Fowler's 'tokenpocalypse' data leans slightly toward Verraes.
Is the value question genuinely settled by evidence, or does uncertainty and sampling bias still dominate?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Notes from FOSE Europe (Giles Edwards-Alexander): The evidence is in; the value is clearly here and here to stay.
- Finding Comfort in the Uncertainty (Annie Vella): Nobody has it figured out; there is more uncertainty than certainty, and the shared set of questions is the real outcome.
- What Survived Contact (Sam Ruby): 'Rigor migrates' is about as settled as this young field gets, but the room is a non-random, incumbent-tilted sample, and the doubt is currently better evidenced than the hope.
Assessment: The single sharpest divergence, and it sits directly under the headline whether-to-how convergence: they narrate the same shift but disagree on what it establishes. Edwards-Alexander and Herlein read the room's confidence as evidence; Vella and Ruby read the same room as a self-selected in-group. Ruby has the better of it methodologically — he is the only one to interrogate the sample and to notice the evidence is asymmetric (upside anecdotal, downside studied), which is uncomfortable precisely because the cohort's confidence is built on the weaker side.
If code is no longer the bottleneck, what is the new binding constraint?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Finding Comfort in the Uncertainty (Annie Vella): Decision capacity and downstream absorption — 'humanity is not ready for this much software'; decision fatigue is becoming the real bottleneck.
- Notes from FOSE Europe (Giles Edwards-Alexander): Learning is the constraint now, not engineering delivery.
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Knowledge — the tacit, unwritten 'why' behind past decisions — is the scarce resource, not code.
Assessment: They agree code/delivery has ceased to be the constraint but name three different successors, with different investment implications — expand decision-making capacity (Vella), optimise for learning (Edwards-Alexander), or capture tacit knowledge (Herlein). These are complementary in principle but rivalrous for attention and budget; the disagreement matters because each implies a different 'first thing to fix.'
Does low-level code quality matter intrinsically, or only instrumentally (via token economics)?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Code-level quality is automatable and he is 'unsure it matters much in its own right apart from token cost'; you bet on it via an asymmetric payoff, not intrinsic worth.
- Why did Martin Fowler invite 60 engineers to a ski resort? (Ivett Ördög): Code quality matters intrinsically because code good for AI and code good for humans are the same thing.
- Fragments: July 6 (Martin Fowler (Jul 6)): Contested and leaning toward design mattering, but on new grounds — token cost as a proxy for architectural quality.
Assessment: The disagreement is about the grounds of the fundamentals-revival, not just its truth. If quality matters only via token cost (Verraes, and Fowler's proxy), the case for it is contingent on token economics and evaporates if tokens get cheap; if it is intrinsic (Ördög), it survives cheaper tokens. This makes the popular slogan 'quality still matters' quietly unstable — the same conclusion rests on incompatible foundations.
Will the classic fundamentals (especially DDD / domain modelling) actually deliver this time — is the revival evidenced or merely asserted?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Notes from FOSE Europe (Giles Edwards-Alexander): Skeptical: domain modelling kept being proposed, but it is not a new idea and never became the standard before — why would it suddenly work now?
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Evidenced: feeding an agent an explicit domain model first yields better code structure and database performance, and bounded contexts also reduce token cost.
- Jimmy Nilsson's Post — reflections after the Thoughtworks 'Future of Software Development' retreat (Jimmy Nilsson): Asserted: DDD, XP, TOC, TDD, BDD, CD are 'more important than ever' in the agentic age.
Assessment: The single slogan 'fundamentals matter more' spans concrete evidence (Verraes), unargued assertion with admitted bias (Nilsson), and active skepticism (Edwards-Alexander) — from attendees of one retreat. This directly exposes the 'the fundamentals are agreed' assumption below: the cohort's flagship convergence is doing a lot of work with very uneven support underneath it.
Can harness engineering actually solve the AI code quality problem?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Agent Harness Engineering (Osmani): Yes — harness engineering is the primary solution. A decent model with a great harness beats a great model with a bad harness.
- Harness engineering for coding agent users (Böckeler): Partially — harnesses can solve maintainability and architecture fitness, but the behavioral harness remains fundamentally unsolved.
- Genie Tarpit (Beck): Unknown — genies naturally produce degraded code and nobody knows how to fix this. Harnesses are listed as one possible remedy among several, without endorsement.
Assessment: This is the central divergence in the literature. Osmani is most optimistic, operating from benchmark evidence that harness changes produce dramatic improvements on coding tasks. Böckeler occupies the middle ground, distinguishing solvable from unsolved harness domains. Beck is most skeptical, questioning whether harnesses address the root cause at all. The disagreement is partly empirical (what do the benchmarks actually measure?) and partly about scope (Osmani focuses on task completion; Beck focuses on long-term code value including flexibility). They may not be contradicting each other so much as talking about different time horizons: harnesses help with immediate task success, but the tarpit emerges over accumulated changes.
What is the right metaphor for the human-AI relationship in coding?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Patterns for Reducing Friction in AI-Assisted Development (Garg): AI is a teammate — treat it like a junior pair programmer who needs onboarding, context, and rituals.
- Harness engineering for coding agent users (Böckeler): AI is a system to be governed — the cybernetic governor model with feedforward and feedback controls.
- Agent Harness Engineering (Osmani): AI is a runtime to be engineered — the harness is an engineering artifact, not a social relationship.
- Looking back at the Future of Software Engineering unconference (Thoughtworks): AI is a new organizational participant — Conway's Law applies, and agent topologies must be designed.
Assessment: These metaphors are not mutually exclusive but they lead to different design decisions. Garg's teammate metaphor emphasizes collaboration rituals and may underplay the need for hard constraints (you don't sandbox a teammate). Böckeler's governor metaphor is the most theoretically rigorous but may overclaim the applicability of control theory to creative work. Osmani's engineering metaphor is the most actionable but may miss the social and organizational dimensions. Thoughtworks' organizational metaphor captures the broadest scope but is the hardest to operationalize.
Will better models make current harness practices obsolete?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Agent Harness Engineering (Osmani): Harnesses don't shrink, they move — better models create new failure modes at higher capability levels.
- Genie Tarpit (Beck): The Bitter Lesson (scale + compute) is listed as one possible solution — implying better models might eventually solve the problem without harnesses.
- Patterns for Reducing Friction in AI-Assisted Development (Garg): Does not address model improvement — the framework lacks a theory of its own obsolescence.
Assessment: Osmani makes the strongest case for permanence with concrete evidence of scaffolding migration. Beck keeps the door open for the Bitter Lesson hypothesis. The truth likely depends on the type of harness: mechanical safeguards (sandboxes, permission controls) may always be needed, while knowledge-transfer patterns (AGENTS.md, priming docs) may become less necessary as models improve at in-context learning.
Is the model a swappable, commoditized component (so selection is a cost decision), or is model choice load-bearing (so selection is a capability decision)?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. (musistudio): Swap camp: the model is fungible config behind Claude Code's durable harness; route each sub-task to the cheapest capable model across many providers and keep the harness.
- Hugging Face's Clem Delangue: Stop Comparing Engines to Cars (Turing Post (Ksenia Se interviewing Clem Delangue)): Swap camp: open weights are not 'behind' — they only look weaker because harnesses were optimized for proprietary APIs; the gap is a harness artifact.
- The Pulse: a new trend, smart model routing (The Pragmatic Engineer (Gergely Orosz)): Swap camp: 'which model to use' is shifting from a deliberate engineering decision to a commoditized, automatable one; open models cover ~60% of coding work by token spend.
- Coding Models Are Doing Too Much (nrehiew.github.io): Load-bearing camp: model choice materially changes output quality — the spread is enormous on the exact behavior that matters for brown-field editing.
- [MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796 (stellaraccident (via https://github.com/anthropics/)): Load-bearing camp: the specific model and its reasoning allocation are structurally required; degrading the SAME model catastrophically broke a proven workflow.
- Claude Code: Best practices for agentic coding (Anthropic (Claude Code best practices guide)): In the middle / silent: treats 'Claude' as one undifferentiated model and never addresses model selection at all.
Assessment: Both camps are right about different task strata, and the tie is broken by the routing camp's own artifact. Commoditization holds on the bulk/background tier (musistudio and the Pragmatic Engineer are correct that a cheap or open model suffices for a large share of tokens), but model choice is load-bearing exactly on the hard tier — the 'hardest 40%' the routing camp routes AWAY (the Pragmatic Engineer's own gap notes 60%-of-token-spend is not 60%-of-value). nrehiew's 6.5x over-editing spread and stellaraccident's collapse are measured on precisely that hard tier. The clincher the swap camp does not concede: musistudio's OWN per-model transformers (tooluse, enhancetool, reasoning, deepseek, gemini) prove the harness is NOT model-agnostic — every model needs bespoke request/response rewriting just to work behind Claude Code, so the 'any model' artifact self-refutes. Delangue even concedes the frontier gap himself. Verdict: select cheap-and-swappable for bulk, and treat the model as a load-bearing capability decision for the hardest slice — the two positions are not competitors but a partition of the task distribution.
Context size: should you shrink the problem to fit a small usable window (decompose / reset), or grow and trust a large window?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- [FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero (AI Engineer (channel); speaker: Matt Pocock (AI Hero)): Shrink: keep every task inside the ~100k smart zone; clear rather than compact; a 1M window is 'more dumb zone', good for retrieval, not coding.
- Agent Harness Engineering (Addy Osmani): Shrink: fight context rot with compaction, offloading, and skills; do not let the window fill.
- Harness design for long-running application development (Anthropic Engineering (long-running harness design)): Shrink (on weaker models): context resets with a handoff artifact beat compaction, because a fresh agent has no anxiety about approaching limits.
- GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. (musistudio): Grow, but only as a per-task escalation: route requests past ~60k tokens to a dedicated long-context model rather than forcing one window to hold everything.
- Charlie Hills 🦩's Post (Charlie Hills 🦩): Manage in place: /compact and one-task-per-session when context degrades.
Assessment: The apparent 'grow / trust the big window' position for CODING largely dissolves once retrieval is separated from coding — which is exactly Pocock's move ('good for retrieval, less good for coding') and musistudio's (longContext is a routed escalation, not the coding default). No text argues you should code inside a full 1M window. The only genuine pressure toward trusting a bigger window is the vendor-forward Fable 5 / Opus 4.6 claim that coherence loss is being engineered away — but that is a moving target (convergence 5), not a stable dial, and even the harness paper only relaxed context resets AFTER measuring that the new model no longer needed them. A secondary, live sub-dispute survives: reset vs compact. Pocock, the harness paper and best-practices favor clearing/resetting to a fresh agent; Hills and Osmani lean on compaction. The reset camp has the better argument on today's models — compaction preserves the same anxious agent — but the disagreement is real and unresolved. Verdict: shrink-and-decompose is the default for coding; grow only as an explicit retrieval escalation; prefer reset over compact unless the model version has demonstrably killed context anxiety.
Effort/reasoning: does more thinking make output better, or does more reasoning make it worse (over-engineering / over-editing)?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- [MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796 (stellaraccident (via https://github.com/anthropics/)): More thinking is better and structurally required: reducing thinking depth caused a catastrophic, measurable quality regression.
- Prompting Claude Fable 5 (Claude Platform Docs): More reasoning over-produces: higher effort yields unrequested tidying, refactoring, and over-planning that must be actively suppressed.
- Coding Models Are Doing Too Much (nrehiew.github.io): Reasoning is a double-edged sword: reasoning models over-edit MORE by default, yet respond BEST to explicit constraints and become the most faithful editors.
- Claude Code: Best practices for agentic coding (Anthropic (Claude Code best practices guide)): Middle: scale the thinking budget to difficulty via the think < think hard < ultrathink ladder.
Assessment: This looks like a head-on collision but is really the corpus resolving a category error, so I keep it as a divergence-under-adjudication rather than a live two-camp fight. The two things bundled into one 'effort' dial are separable: reasoning DEPTH (deliberation and research before acting — what stellaraccident measures as the Read:Edit ratio) versus action SCOPE (how much the model rewrites — what nrehiew measures as over-editing). They are separable but DEFAULT-COUPLED: more reasoning, unconstrained, tends to produce more scope. nrehiew is the empirical bridge — constrained reasoning models are the MOST faithful, proving depth and tight scope combine positively when you address them separately. Fable 5 already acts on this, pairing 'reduce effort' with a distinct anti-over-engineering instruction. The actionable verdict: do NOT cut reasoning depth to fix over-editing (that is stellaraccident's exact grievance and it backfires into shallow, edit-first behavior); keep the depth and add an explicit scope constraint. The failure is treating one knob as if it controls both correctness-depth and edit-scope.
Who selects the model/effort/context — a human deciding per task, or an automatic router — and who is trusted to hold the dial?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- Charlie Hills 🦩's Post (Charlie Hills 🦩): Human selects: the developer manually assigns Opus to think and Sonnet to build.
- Claude Code: Best practices for agentic coding (Anthropic (Claude Code best practices guide)): Human selects: the user picks the thinking level (think/ultrathink) and configures the tools per task.
- The Pulse: a new trend, smart model routing (The Pragmatic Engineer (Gergely Orosz)): Auto-router selects — but beware who owns it: an intelligent router (or Cursor 'Auto') picks the cheapest capable model automatically.
- GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. (musistudio): Semi-automatic, user-owned rules: config-driven scenario routing plus custom-router JS and subagent pinning.
- [MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796 (stellaraccident (via https://github.com/anthropics/)): The dial must be transparent and user-controllable: the real harm was the PROVIDER silently rationing the effort dial.
Assessment: The human-vs-auto axis is less about capability than about (a) whether task difficulty can be detected a priori and (b) who bears the principal-agent risk. No router in the corpus actually measures difficulty — musistudio routes by token-count and static scenario, and the Pragmatic Engineer's routers infer 'good enough' without a demonstrated oracle — so 'auto' today means 'static-heuristic', not 'optimal'. Automation is safe when the user owns the policy (musistudio) and dangerous when the router profits from the choice (Cursor Auto) or when the provider adjusts the dial invisibly (stellaraccident). Verdict: keep the human holding the difficulty judgment and the effort dial until routers can both measure adequacy and prove neutral incentives; automate only the mechanical dispatch, over rules you own and can audit.
Is code a durable artifact to be maintained, or an ephemeral byproduct regenerated from a more durable source (spec/objective)?
from: What is the future of software development in the agentic/AI age?
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Code is (or is becoming) ephemeral — a disposable byproduct the agent regenerates from the spec; the spec is 'the point.'
- Fragments: February 4 (Martin Fowler (Feb 4)): When coding is free, the specification-plus-tests becomes the durable, primary engineering artifact.
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Specifications could replace code as the source of truth, but throwaway regeneration is a bet he is unwilling to make; keep code durable and revertible.
- Why did Martin Fowler invite 60 engineers to a ski resort? (Ivett Ördög): Code endures because the winning agents behave like engineers moulding a maintained codebase, not compilers regenerating from scratch.
- What Survived Contact (Sam Ruby): The durability question is a category error — what endures is neither the code nor the prose spec but the objective and its oracle.
Assessment: The most-cited open question of the corpus, and genuinely unresolved (Herlein: 'no consensus here. None.'). The 'code is the better spec' counter is strong — code is unambiguous, executable, deterministic, whereas a prose spec is reinterpreted each run, which sits in tension with verifiability being the quality bar. Ruby's move is the most defensible: it dissolves the code-vs-spec fight by locating durability in the evaluation rather than any representation. Verraes and Ördög expose the load-bearing empirical unknown — nobody has data on regenerate-vs-patch cost or on long-term evolvability of agent-maintained code.
Where does the non-delegable human asset now live — the harness/platform, the oracle, the fundamentals, or the developer's understanding?
from: What is the future of software development in the agentic/AI age?
- Notes from FOSE Europe (Giles Edwards-Alexander): In the harness — the continuously-evolving scaffolding of architecture guidance and rigour around the agents — though it must stay team-distributed, not centralized.
- What Survived Contact (Sam Ruby): In the oracle — the objective's evaluation is the single thing the person directing the model cannot delegate back to it.
- Jimmy Nilsson's Post — reflections after the Thoughtworks 'Future of Software Development' retreat (Jimmy Nilsson): In the fundamentals plus a renewed 'Extreme Humanism' — the durable disciplines and the conspicuously human element.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): In right-sized boundaries and the operational loop — humans must stay in operations because their learning is the irreplaceable asset.
- Fragments: February 9 (Martin Fowler (Feb 9)): In the developer's model-building and shared understanding — the craft of devising abstractions to reason about the domain.
Assessment: This is the deepest structural disagreement — every author agrees a human residue remains but nominates a different residue, and the choice determines what to invest in and what to teach. The harness-centric (Edwards-Alexander), oracle-centric (Ruby), fundamentals-centric (Nilsson/Bangser), and understanding-centric (Fowler) camps are not merely emphases: they imply different career ladders, different hiring, and different failure modes. Ruby's oracle and Bangser's operational-learning are the most operationally concrete; Nilsson's is the least argued. The absence in the corpus of anyone who holds 'nothing is non-delegable' is itself telling (see unexamined assumptions).
Should the harness/platform and its safety be centralized or left distributed across teams?
from: What is the future of software development in the agentic/AI age?
- Notes from FOSE Europe (Giles Edwards-Alexander): Distributed — dedicated harness-engineering teams are a mistake; per-team friction in building harnesses is creative and generative.
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): Centralized — safety for non-engineers should come from a tightly-constrained, self-healing platform that ships access and data guardrails.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Centralized enabling layer — platform, SRE, and ops teams should provide API-first, MCP-accessible tooling that others safely consume.
- Fragments: February 18 (Martin Fowler (Feb 18)): Centralized golden path — platform teams should provide fast-but-safe 'bullet trains' with security built in by default.
Assessment: A real operating-model split. Edwards-Alexander's distributed stance rests almost entirely on the DevOps-team analogy (his own extraction flags it as asserted-on-intuition, not argued), whereas the platform camp has the stronger concrete case for the citizen-developer safety problem — you cannot distribute production-data guardrails to non-engineers. The tension is partly reconcilable: Ocytko himself concedes a platform tight enough for non-engineers may be too constraining for expert engineers' identity and innovation, which is exactly the freedom Edwards-Alexander is protecting. The unresolved question is whether one platform can be both.
How far should software be automated — toward the fully-autonomous dark/software factory, or held back to bounded autonomy with humans in the loop?
from: What is the future of software development in the agentic/AI age?
- Why did Martin Fowler invite 60 engineers to a ski resort? (Ivett Ördög): Full automation is genuinely viable in context and she is 'ironically' being pulled toward the dark-factory camp.
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): The aspirational endpoint is a largely self-evolving software factory; humans build and operate the backbone rather than the application.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Bounded autonomy — keep humans in the operational loop; automated remediation must stay an intentional decision.
- What Survived Contact (Sam Ruby): Self-healing has stalled halfway on purpose: diagnosis is automated, remediation withheld from the machine.
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Dark factories are safe only for orgs that already have high test coverage, skilled engineers, and a quality culture; most should cover fundamentals first and stay revertible.
Assessment: The spectrum runs from Ördög/Ocytko (full automation is arriving and desirable) to Bangser/Ruby/Verraes (deliberately withhold the last step). The decelerationists have the better of the safety argument today — Ruby's 'nobody will cede the blast radius' and Bangser's 'removing humans removes learning' identify concrete, unmet prerequisites — but Ördög's context-dependence (backends, COBOL) shows the boundary is domain-specific, not absolute. The real disagreement is less about capability than about who absorbs the blast radius when an autonomous fix goes wrong.
Strategically, is the right move to accelerate adoption to build a permanent lead, or to decelerate and hedge against AI's risks?
from: What is the future of software development in the agentic/AI age?
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Accelerate: adoption compounds into a flywheel, and the gap can harden into a permanent structural moat the slowest never close.
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Decelerate and hedge: build systems that can revert from agent generation back to human engineering.
- Fragments: July 6 (Martin Fowler (Jul 6)): Treat good design as a hedge against AI-dependence risk rather than as a race to maximal dependence.
Assessment: Nearly opposite bets: Herlein optimizes for a world where AI keeps getting cheaper and better and first-movers win permanently; Verraes and Fowler optimize for a world where AI gets costlier, curtailed, or unreliable. Herlein's 'permanent moat' rests on flywheel logic plus a single secondhand anecdote and ignores technology-diffusion catch-up dynamics; Verraes and Fowler's hedge is cheap insurance but under-examines whether reversion is actually achievable once specs, agents, and toolchains are deeply embedded and human familiarity has eroded. The disagreement is ultimately a bet on the trajectory of token economics, which nobody in the corpus can price.
If code was never the bottleneck, what is the binding constraint now?
from: What is the future of software development in the agentic/AI age?
- Finding Comfort in the Uncertainty (Annie Vella): Human decision capacity and downstream absorption — 'decision fatigue is becoming the real bottleneck.'
- Notes from FOSE Europe (Giles Edwards-Alexander): Learning — 'learning is the constraint now, not engineering delivery.'
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Knowledge — the tacit, unwritten 'why' is the scarce resource agents starve for.
Assessment: A productive three-way split downstream of the shared 'code was never the bottleneck' finding. They are not incompatible so much as differently located — decision capacity (Vella) is organisational, learning (Edwards-Alexander) is about the team's rate of understanding the problem, and knowledge (Herlein) is about capturing rationale. But they imply different investments: expand downstream absorption, restructure around learning, or build knowledge-capture pipelines. The corpus has not reconciled which is the true binding constraint, and each author generalizes from a different vantage (a retreat-floor convergence, an org-design frame, a knowledge-engineering frame).
Open gaps (197)
- illogicalThe piece argues both that free-running loops are dangerously unstructured (motivating the pivot to explicit graphs) and that short, low-stakes loops (the nightly lint-fix cron) legitimately earn full autonomy without any explicit graph structure — it never reconciles when a loop needs graph-discipline versus when it's fine to run as a pure loop; length and stakes are offered as the answer for automation-worthiness, but that criterion is never explicitly connected back to the separate loop-vs-graph argument.Software Factories, Light and Dark — read next: Read for a unified framework connecting loop-length/stakes-based autonomy criteria with graph/state-machine architecture choices, rather than treating them as two independent recommendations.
- incompleteThe rule of thumb that 'an agent holds up for three to ten steps, then starts losing the thread past twenty' is stated (attributed to Dex Horthy) without any grounding for why that specific numeric range holds, what model or context window it was measured against, or whether it's expected to shift as context windows and context-management techniques improve — it's treated as a durable constant rather than a fast-moving, model-dependent empirical measurement.Software Factories, Light and Dark — read next: Look for benchmark data on agent step-count reliability across model generations and context-management techniques, to see whether this threshold is already stale.
- incompleteThe Terminal Bench 2.0 data point (Top 30 to Top 5 via harness change) is presented without detail on what specific harness changes drove the improvement, making it impossible to evaluate which components had the most leverage.Agent Harness Engineering — read next: Read Viv Trivedy's original 'Anatomy of an Agent Harness' post for the detailed breakdown.
- argumentativeAnti-rationalization tables assume static excuses. The article treats rationalization as a finite, enumerable set. But LLMs can generate novel justifications not covered by any pre-written table. No discussion of what happens when the agent rationalizes in a way not anticipated by the table.
- practicalNo discussion of the cost of false enforcement. Skills add friction. What happens when the skill system forces an agent to write a spec for a one-line typo fix? The article mentions that 'a small bug fix might use three' skills but doesn't address the overhead/accuracy tradeoff.
- evidentiaryPortability is claimed but not demonstrated. The article asserts the same SKILL.md works across Claude Code, Cursor, Gemini CLI, Codex, etc. but provides no evidence that different harnesses interpret the same markdown workflow identically.
- incompleteThompson's claim that agents can replace 'human cogs' in organizational coordination assumes agents can handle ambiguous, political, and relational tasks — not just execution tasks like coding. No evidence is offered for this.Agents Over Bubbles — read next: Research on AI in organizational coordination, decision-making, and management tasks.
- incompleteThe entire evidence base is a single unnamed client engagement. No quality metrics, error rates, time-to-merge data, or controlled comparison against non-agent workflows are provided. The '4x PRs opened' metric could reflect PR fragmentation rather than genuine productivity gains.Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Look for published case studies from Harness Engineering adopters (OpenAI Codex internal metrics, Stripe Minions data) that include quality and cost metrics alongside volume
- uninformedNo discussion of cost economics — token consumption for multi-agent adversarial review (planner + reviewer + coder + review agent + retrospective) could be substantial. Without cost data, the ROI claim is incomplete.Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Token economics analyses for multi-agent coding workflows; Anthropic and OpenAI pricing models for high-volume agent usage
- incompleteThe 'self-improvement loop' is described as agents saving learnings back to context files, but there is no discussion of knowledge curation — who reviews what the agents learn? Unbounded accumulation of agent-generated context could itself become a source of context rot.Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Knowledge management literature on automated knowledge bases; the 'wiki decay' problem applied to agent memory
- uninformedThe article does not address what kinds of tasks or codebases this approach works poorly for. There is no discussion of limitations by domain (e.g., security-critical code, novel algorithmic work, legacy systems with poor documentation).Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Research on task complexity taxonomies for AI-assisted coding; empirical studies of where coding agents fail
- incompleteThe productivity claims for ChatGPT Work — OpenAI's own sales/finance teams compressing week-long processes into hours, and Zapier's 'seven figures in missed pipeline' testimonial — are cited with no methodology, task-completion rate, error/failure rate, or independent audit. They come from the vendor and a partner with an incentive to promote the launch.ChatGPT Just Became A Work Agent — read next: Look for independent third-party case studies or benchmarks of ChatGPT Work and Claude Cowork task-completion and failure rates on real enterprise workflows, not vendor testimonials.
- incompleteThe article never explains what Claude Cowork itself actually does (connectors, execution model, access controls) — it's used only as a reference point for competitors (ChatGPT Work, Sand) rather than described directly, so the comparison the whole piece is built around is one-sided.ChatGPT Just Became A Work Agent — read next: Read Anthropic's own Claude Cowork announcement/documentation to compare feature-for-feature against ChatGPT Work's connectors, cloud execution, and access controls described here.
- uninformedThe comparative capability/cost claims in this week's model launches (Sol beating Fable on the Coding Agent Index, Luna matching GLM-5.2 at 43% cheaper, Muse Spark 1.1 being SOTA on 'MCP Atlas' and 'JobBench') all trace to vendor blog posts or single X posts (Artificial Analysis, Simon Smith, Vals AI's Rayyan) rather than independently reproduced evaluation — and the article's own SWE-bench Pro item shows a leading benchmark was 30% broken, undermining trust in any single benchmark source, including the ones used elsewhere in this same issue.ChatGPT Just Became A Work Agent — read next: Before trusting any cross-lab benchmark claim in this piece, check whether Artificial Analysis, Vals AI, or another independent evaluator has published a methodology and raw results, not just a summary tweet.
- illogicalOpenAI's new national-security red-lines document is presented as a notable development, but the author's own aside — that it lands 'awfully close' to Anthropic's principles and that it's 'not obvious what problem this document solves' — undercuts the item's inclusion as news without the piece drawing out what that implies (e.g., that it may be a defensive/lobbying move rather than a substantive commitment).ChatGPT Just Became A Work Agent — read next: Track whether OpenAI's stated red lines actually constrain any specific government contract or deal going forward, as the real test of whether the document is substantive.
- incompleteParker frames the joy gap as greenfield vs. legacy but never examines whether the 'joy' experienced by greenfield developers is sustainable or genuine. Rapid AI-assisted prototyping may produce initial excitement that fades as technical debt accumulates or as developers realize they've lost depth of understanding.Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle — read next: Research on skill atrophy in automation-heavy domains (aviation, healthcare); Bainbridge's 'Ironies of Automation' for the classic formulation
- incompleteThe AI platform team concept is asserted but not developed. How does it differ from existing developer experience (DX) or platform engineering teams? What skills does it require? How does it avoid becoming a bottleneck itself? The analogy to Docker containers is gestured at but not followed through.Podcast: The AI Joy Gap: Why Some Developers Thrive While Others Struggle — read next: Team Topologies (Skelton & Pais) on platform team design patterns; internal developer platform literature
- incompleteNo evidence or examples are provided for any of the four habits. The claims are presented as practitioner wisdom without empirical support, before-after comparisons, or concrete scenarios showing failure modes.
- incompleteThe distinction between what belongs in CLAUDE.md vs. skills vs. hooks is stated but not precisely bounded. A convention that is also a checklist could plausibly go in either place.
- uninformedThe post does not address trade-offs or costs of the recommended approach -- e.g., the overhead of maintaining skills and hooks, the risk of over-engineering small projects, or when ad-hoc prompting is actually sufficient.
- incompleteThe post ends with a course promotion, raising the question of whether the advice is calibrated to be genuinely complete or deliberately leaves gaps to motivate enrolment.
- incompleteConflict of interest is undisclosed and undiscussed: the benchmark is published by Lucena.One, and its own product, 'Lucena Coder,' is the declared winner on both cost and token count. The piece never addresses how this affects the benchmark's neutrality, what independent verification exists, or why a reader should trust a vendor's self-run comparison of its own tool against five competitors.The Almedra Token-Efficiency Benchmark, Updated For GLM 5.2 — read next: Look for independent (non-vendor-run) replications of this benchmark, or third-party coding-agent efficiency comparisons with disclosed methodology and no product at stake for the publisher.
- incompleteThe decomposition is not orthogonal and specifies no module boundaries. Four of the named components — memory (3), context management (4), prompt construction (5), and state management (7) — are views of a single 'what the model sees / what persists' concern (Claude Code's git-commits-as-checkpoints sits under state, MEMORY.md under memory, compaction under context, prompt assembly under construction, but they are one persistence-and-window problem wearing four hats). Guardrails/permission (9) is not disjoint from tools (2) — the walkthrough runs the permission check INSIDE tool execution (step 4). Output parsing (6) is near-vestigial under native tool calling (a sub-step of the loop, not a peer module). And the orchestration loop (1) is a LEVEL above the contents it manages, not a coequal component ('the complexity lives in everything the loop manages'). The prose enumerates eleven items under a 'twelve components' heading. So the list reads as a practitioner checklist organized by mechanism and vendor vocabulary, not a coupling-minimizing partition into high-cohesion modules — it cannot tell you where to actually cut the system.The Anatomy of an Agent Harness — read next: Read Parnas ('On the Criteria To Be Used in Decomposing Systems into Modules'), Yourdon & Constantine on coupling/cohesion, and Ousterhout on deep modules; re-derive the harness as narrow-interface deep modules and test which of the eleven are genuinely separable versus one persistence/context responsibility split four ways — the structured-design question the piece's naming step presupposes but never answers.
- incompleteAnatomy without failure-mode interactions. The seven-step walkthrough gives happy-path dynamics only; the piece never addresses how components interfere when things go wrong — compaction (context management) discarding state the verifier still needed, a guardrail tripwire firing mid-tool-call and leaving state half-written, or a memory 'hint' that contradicts actual state after a context reset. The hardest engineering lives in these cross-component failure interactions, which the static list and the clean walkthrough elide.The Anatomy of an Agent Harness — read next: Read extract-anthropic-harness-design-long-running-application-development and extract-anthropics-three-agent-harness on context-reset handoff artifacts and evaluator calibration; look for how components must expose contracts to survive each other's failures rather than only cooperating on the happy path.
- incompleteNo interface or contract between components is specified. The piece names components but never states what each EXPOSES to the others — what memory hands to context management, what guarantees the loop makes to the tool layer, what verification consumes and returns. Without interface contracts, the 'independently improvable' premise (p13/p14) that the sibling's fitness-selection strategy depends on is unverified: 'add one mechanism' only stays local if the components are actually decoupled, which the piece asserts by layout rather than by design.The Anatomy of an Agent Harness — read next: Read on module interfaces/APIs (information hiding, contracts) and re-examine the sibling's automated 'add one mechanism, keep if better' loop to check whether a change to one component ripples across the coupled memory/context/state cluster.
- incompleteTwo overlapping taxonomies whose relationship is left unstated. The twelve components and the seven decisions substantially overlap: decisions 3/4/5/6 (context-window strategy, verification design, permission architecture, tool scoping) simply re-open components 4/10/9/2 as 'choices,' while only decisions 1/2/7 (single-vs-multi-agent, ReAct-vs-plan-execute, harness thickness) are architectural choices not already a component. The piece presents both frameworks without saying whether the seven decisions are just the tunable parameters of a subset of the twelve components.The Anatomy of an Agent Harness — read next: Consolidate into one model — components as nouns (what the harness contains) versus configuration axes as verbs (how each is set) — and test whether 'seven decisions' collapses into 'the tunable dials on four of the components,' leaving only single-vs-multi-agent, ReAct-vs-plan, and thickness as genuinely first-order architecture.
- illogicalThe 'eliminate guesswork' framing presumes the right response to LLM unreliability is a more structured tooling surface, but does not address whether the LLM still hallucinates within that surface. A scriptable CLI lets the agent issue precise commands; it does not make the agent's reasoning about which commands to issue any better.With Android CLI, Google is Making the Android Toolchain Agent-Friendly — read next: Material on hallucination at the orchestration layer vs the action layer; Anthropic's writing on tool use reliability.
- incompleteThe 'dreaming' mechanism is named and promised but not specified. We get no description of what is consolidated, what is discarded, how cross-user contamination is prevented, whether patterns are per-tenant or shared, whether 'dreams' are reviewable, or how a bad dream is unlearned. The cognitive metaphor is doing all of the persuasive work.Developer Newsletter: higher usage limits, dreaming for Claude Managed Agents, and Claude Security — read next: Anthropic's eventual technical post on the dreaming architecture; also: Voyager (Wang et al.) on skill libraries from agent experience; Reflexion (Shinn et al.) on self-reflection; recent literature on 'experience replay' for LLM agents; and any work on session-trace privacy for shared-tenant learning.
- incompleteClaude Security scans for vulnerabilities and patches them, but the newsletter is silent on how false positives are surfaced, how confidence ratings are calibrated, what training data the scanner uses, and what happens when the same model family produced the vulnerable code in the first place. The conflict-of-interest case is not addressed.Developer Newsletter: higher usage limits, dreaming for Claude Managed Agents, and Claude Security — read next: Compare against Snyk, Semgrep, GitHub Advanced Security, Endor Labs, and the recent wave of agentic SAST tools; read Anthropic's safety/eval team posts on adversarial code; also: literature on LLMs as code reviewers (CodeRabbit research, DeepMind's 'CompCoder' line).
- incomplete'Managed Agents' is the brand, but the newsletter never names the alternative it is positioning against: the open-source agent stack (LangGraph, AutoGen, OpenAI's Agents SDK, Microsoft's AutoGen, the MCP ecosystem itself). The trade-off between portability and a vendor-managed runtime is unexamined.Developer Newsletter: higher usage limits, dreaming for Claude Managed Agents, and Claude Security — read next: Compare with OpenAI's Agents SDK announcements, Google's Vertex AI Agent Builder, LangGraph Platform; recent essays on the agent runtime layer (Simon Willison, Swyx) and the 'agent OS' framing.
- incompleteThe pricing split — Agent SDK and `claude -p` no longer counting against Claude plan limits, but receiving a separate credit — is announced without numbers. This makes it impossible to evaluate whether the new metering is a substantive change or a reframing exercise.Developer Newsletter: higher usage limits, dreaming for Claude Managed Agents, and Claude Security — read next: Anthropic pricing page and the release notes linked from this newsletter; community write-ups after June 15 when the change takes effect.
- incompleteNo engagement with cost ceilings or economic boundaries. $124-$200 per multi-hour autonomous run is presented as routine; there is no discussion of when this stops scaling (e.g. teams running this 100x/day, regulated environments with per-call cost controls, or comparison to a human contractor at equivalent output).Harness design for long-running application development — read next: Read pieces that treat agent-cost economics directly — Simon Willison's pricing analyses, the smallcode argument for smaller models, any IT-procurement perspective. Also: Anthropic's own enterprise pricing docs as the implicit deployment context.
- incompleteNo treatment of audit, observability, governance, or failure containment for long-running autonomous coding. The piece's implicit deployment is 'a single engineer running experiments at Anthropic Labs.' A Norwegian public-sector or regulated context would need: persistent audit trails of each agent's actions and tool calls, rollback semantics for partial builds, secret management when agents access live services, IP provenance of generated code, and human-checkpoint policies. File-based agent communication is actually well-suited to audit — but the author never makes that case.Harness design for long-running application development — read next: Read the EU AI Act's high-risk-system requirements, NIST AI RMF agent guidance if it exists yet, and any sober writing on agent observability stacks. Also: cross-reference Anthropic's enterprise-tier compliance docs.
- incompleteThe 'simplify when models improve' methodology assumes monotonic capability advance. It does not address the (empirically real) case where a new model has different — not strictly better — failure modes. E.g. Sonnet 4.5's context anxiety vs. Opus 4.6's regression on some niche tasks. The methodology is silent on what to do when component removal *reveals* a new weakness rather than confirming an old strength.Harness design for long-running application development — read next: Look for empirical model-version-comparison work — Aider/SWE-bench longitudinal results, internal Anthropic evals if available, and practitioner accounts of regressions (e.g. Simon Willison's lab notebooks).
- incompleteThe criteria-as-stylistic-steering observation ('museum quality' produces visual convergence) is surfaced and then dropped. It is treated as a quirky finding rather than a serious concern about AI-generated homogenization. At scale, if many teams use Anthropic-suggested criteria, the result is a deep convergence in the look of AI-generated software.Harness design for long-running application development — read next: Read on cultural homogenization risk in generative AI (Naomi Klein, Ted Chiang, and design-criticism writing). Also: the 'AI slop' discourse and any empirical work on generated-design diversity.
- incompleteThe 'long-running' threshold is operationalized only through examples (3.8 to 6 hours) — never defined. A reader cannot tell whether the prescriptions apply to a 30-minute task, a multi-day task, or only to the specific case study durations. Böckeler's harness theory and the smallcode piece operate at different time scales without acknowledgment.Harness design for long-running application development — read next: Cross-reference extract-bockeler-harness-engineering.json (theoretical-control framing — variety reduction, feedforward, feedback sensors) which is time-scale-agnostic; the smallcode piece's smaller-task framing; and reach for any time-scale-explicit treatment of agent autonomy windows.
- uninformedThe piece is silent on the existence of a broader harness-engineering theoretical literature (Böckeler's adaptive-control framing, the smallcode engineering-instinct view) — even though Anthropic Labs is presumably aware. As a result, named phenomena are coined fresh ('context anxiety') without acknowledging or engaging with adjacent theory. This is not necessarily a mistake — it may reflect the piece's narrow Labs-experiment scope — but it does mean the reader has to do the cross-mapping work themselves.Harness design for long-running application development — read next: Maintain the syntopical map (already in this repo as syntopical-harness-engineering-for-ai-coding-agents.json) and treat this article as one empirical data point, not a theoretical contribution.
- incompleteThe article doesn't address what happens when the evaluator agent is wrong. If the evaluator has calibration errors, the generator will iterate toward those errors. The regress (who evaluates the evaluator?) is assumed away.Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development — read next: Literature on specification gaming in RL; AI alignment work on reward hacking
- uninformedNo comparison to alternative approaches. The context-reset claim is made without benchmarks against compaction or other memory strategies. The practical superiority is asserted, not demonstrated.Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development — read next: Anthropic's research on long-context models; MemGPT and other memory architecture papers
- incompleteThe behavioural harness is acknowledged as 'the elephant in the room' but no concrete framework or methodology is proposed for solving it beyond mentioning approved fixtures as a partial pattern.Harness engineering for coding agent users — read next: Read the approved fixtures pattern (lexler.github.io/augmented-coding-patterns) and explore specification-based testing approaches (property-based testing, contract testing) as potential behavioural harness components.
- incompleteThe article does not address how to evaluate harness quality or coverage — it raises the question ('If sensors never fire, is that high quality or inadequate detection?') but offers no answer.Harness engineering for coding agent users — read next: Explore meta-testing approaches: mutation testing for harnesses, harness coverage metrics, or adversarial testing of the harness itself.
- incompleteThe cybernetic framing (feedforward/feedback, Ashby's Law) is adopted as the organizing metaphor but not critically examined. Control theory assumes a well-defined desired state and measurable error signal — software development often has neither.Harness engineering for coding agent users — read next: Read Stafford Beer's work on viable systems and cybernetic management to assess how well control-theory concepts transfer to inherently creative/ambiguous engineering tasks.
- incompleteNo discussion of the cost-benefit analysis of harness engineering itself — when is the investment in building and maintaining a harness worthwhile vs. simply relying on human review?Harness engineering for coding agent users — read next: Look for empirical studies or experience reports quantifying harness ROI in agent-assisted development.
- incompleteThe interaction between guides and sensors — coherence, contradiction, priority resolution — is raised as an open question but not explored.Harness engineering for coding agent users — read next: Explore policy conflict resolution in cybernetic and multi-agent systems literature.
- incompleteThe author explicitly flags that OpenAI's write-up omits behavioral/functional verification, but then 'leaves that gap aside' for the rest of the piece without returning to it — so the single most consequential missing piece of the harness (does the code actually work, not just stay maintainable) goes unanalyzed in an otherwise fairly thorough piece.Harness Engineering — read next: Read the author's own later, fuller article on harness engineering, which names the behavioural harness explicitly as 'the hardest and least solved' problem.
- uninformedThe piece explicitly asks readers to 'assume we can trust OpenAI's representation of the success of this,' naming OpenAI's vested interest in the claim — but then doesn't actually discount or stress-test any of the specific numbers (5 months, 1M+ lines, zero manually typed code) in light of that named incentive.Harness Engineering — read next: Look for independent replications or critiques of OpenAI's harness-engineering claims from teams without a vendor stake in the outcome.
- incompleteThe speculation about tech-stack convergence ('AI-friendliness' as a selection criterion) doesn't address who bears the switching cost if an organization's current stack turns out to harness poorly — existing codebases, team skills, and integrations don't disappear just because a stack is less 'AI-friendly.'Harness Engineering — read next: Organizational case studies on stack-migration cost under an AI-friendliness criterion, as distinct from traditional migration drivers (performance, hiring, vendor support).
- incompleteThe conversation is entirely from Anthropic's perspective. No competing viewpoints from OpenAI, Google, or independent practitioners are represented. The interview format means Lenny largely agrees with and amplifies Cat Wu's positions rather than stress-testing them.How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code) — read next: Read critical analyses of Anthropic's approach from outside observers; compare with product practices at other frontier labs.
- incompleteThe 'just do things' philosophy and extreme speed of shipping are presented as unqualified goods. The costs (product consistency, user confusion, bugs shipped) are acknowledged but treated as acceptable trade-offs without exploring when they become unacceptable — particularly for enterprise customers who need stability.How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code) — read next: Look at enterprise SaaS literature on release management and the cost of change fatigue for large organizations.
- uninformedThe discussion of Co-work replacing tedious PM tasks (decks, meeting prep, email triage) lacks any engagement with the quality ceiling problem: are these AI-generated outputs actually good enough for high-stakes contexts, or do they create a mediocrity trap?How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code) — read next: Seek empirical studies on AI-generated content quality in professional settings; read critiques of 'good enough' AI output.
- incompleteThe Open Claude decision is framed purely as a resource allocation choice. The community trust cost and the broader ecosystem implications of an AI company restricting how its model can be accessed through third-party tools are not explored.How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code) — read next: Read platform economics literature on ecosystem lock-in; review community responses and long-term effects of similar decisions by other platform companies.
- incompleteNo governance or review model is described for a team's growing collection of saved dynamic-workflow scripts. As engineers independently write and save JavaScript harnesses (to ~/.claude/workflows or bundled into skills), the article doesn't address ownership, versioning, duplicate/competing workflows for the same task, or how a team avoids the exact 'good setups stay tribal' proliferation problem this corpus has already flagged for skills and CLAUDE.md rule libraries.A harness for every task: dynamic workflows in Claude Code — read next: Read extract-claude-code-in-large-codebases on why plugins exist specifically to solve the 'good setups stay tribal' organizational problem for skills/hooks/MCP bundles, and ask whether dynamic workflows need the same organizational answer (a dedicated owner, a shared workflow registry) rather than just a file-save mechanism.
- illogicalThe quarantine pattern for triage workflows (barring agents that read untrusted content from high-privilege actions) is stated as a one-line mitigation without specifying the enforcement mechanism: how is the boundary between 'reads untrusted content' and 'acts' actually enforced so that instructions smuggled inside the untrusted content cannot still reach the acting agent through the extracted summary it's handed?A harness for every task: dynamic workflows in Claude Code — read next: Look for prompt-injection and tool-permission-boundary literature specifically addressing information flow between an agent that reads untrusted content and a separate agent that acts on its output, not just role separation by convention.
- incompleteThe tool's implicit promise is model-agnostic 'swap freely', yet the very existence of per-provider and per-model transformers (tooluse, enhancetool, maxtoken, reasoning, deepseek, gemini) proves the harness is NOT model-agnostic — different models need bespoke request/response rewriting and tool-call error tolerance just to work behind Claude Code. The README never reconciles 'any model' with 'each model needs its own adapter', so the residual model-harness coupling — and how much reliability you lose swapping to a model the harness wasn't tuned for — is unquantified.GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. — read next: Read against the harness-engineering thread on model-harness co-training and overfitting: extract-agent-harness-engineering (models get post-trained coupled to their harness) and its open gap on co-training risks; and extract-experiences-with-local-models-for-coding on how much viability is model vs. harness.
- incompleteThe thread extensively discusses Claude Code's web search pipeline but never addresses how claude.ai's web search differs, despite ai-software noting they use the same search index but 'completely different content pipelines.' The implications for the much larger claude.ai user base are unexplored.Claude Code Source Leak Megathread — read next: ai-software's own blog posts and any Anthropic documentation on the claude.ai search pipeline
- uninformedThe conspiracy theory about intentional leaking ignores the simplest explanation: organizational silos. The team building anti-distillation defenses is likely not the team managing the npm build pipeline. Large organizations routinely have sophisticated capabilities in one area and elementary failures in another.Claude Code Source Leak Megathread — read next: Literature on organizational failures in complex systems (e.g., Perrow's 'Normal Accidents', Vaughan's 'The Challenger Launch Decision')
- illogicalThe 'user delight > code quality' argument commits a temporal fallacy. Current user satisfaction says nothing about the long-term sustainability of the codebase. a0flj0 correctly identifies this but is dismissed by the majority. The argument conflates a snapshot metric with a trajectory.Claude Code Source Leak Megathread — read next: Ward Cunningham on technical debt; Lehman's Laws of Software Evolution
- incompleteNobody in the thread addresses the ethical implications of KAIROS/Dream Mode from a data privacy perspective. An agent that autonomously processes user data while the user is away raises consent and data processing questions, especially under GDPR.Claude Code Source Leak Megathread — read next: GDPR Article 22 on automated decision-making; any Anthropic privacy policy or DPA covering background processing
- misinformedSeveral commenters conflate the leaked source code (the CLI orchestration layer) with Claude's model weights or training data. JulioMcLaughlin2 correctly notes this is 'the wrapper sent to Anthropic's servers' but this distinction is lost on many participants who ask if this enables a 'free Claude.'Claude Code Source Leak Megathread — read next: Basic architecture of LLM applications: the distinction between inference server, API, and client-side orchestration
- incompleteThe Undercover Mode discussion lacks any serious ethical analysis. A feature designed to let AI contribute to public repos without disclosure has implications for open-source trust, code review practices, and the integrity of contribution records. The thread treats it as either 'cool' or briefly 'an ethical landmine' without following up.Claude Code Source Leak Megathread — read next: Open source governance literature; existing policies on AI-generated contributions (e.g., Linux kernel policy)
- uninformedThe thread assumes that Anthropic's session limit A/B testing is unusual or nefarious. In reality, nearly all SaaS products use feature flags and A/B testing for resource allocation. The finding is significant for transparency reasons but the conspiratorial framing ('tricking you') is unwarranted without evidence of deceptive intent.Claude Code Source Leak Megathread — read next: Standard practices in SaaS product management; Anthropic's Terms of Service on usage limits
- incompleteEvery play redefines the human's role (from author to reviewer, from implementer to orchestrator, from on-call responder to incident-queue triager) but the piece never addresses the human cost of that shift — skill atrophy from no longer writing code directly, morale effects of reviewing AI output all day, or how an organization trains new engineers who never practiced the skills the plays assume a senior reviewer already has.The AI-Native SDLC playbook — read next: Look for practitioner accounts (not vendor playbooks) of how teams that have run this kind of pipeline for a year or more describe the experience of the reviewer-not-author role, and whether junior engineers develop judgment without first doing the work themselves.
- uninformedThe piece is presented as consolidating 'real best practices our Applied AI team executes on a daily basis for our customers,' but every quantitative claim (leading/lagging indicators, 'elapsed time falls from weeks to hours') is prescriptive guidance on what to measure, not a reported result; no outcome data from an actual deployment appears anywhere in the piece.The AI-Native SDLC playbook — read next: Look for independent case studies, post-mortems, or DORA-style empirical measurement of organizations that adopted this specific stage structure, as distinct from vendor-authored playbooks.
- incompleteHugging Face's long-term business model remains vague. Delangue enthusiastically promotes local AI and free usage but the freemium economics of a platform whose mission is to make AI free are not explained in any depth.Hugging Face's Clem Delangue: Stop Comparing Engines to Cars — read next: Hugging Face financial reporting or investor communications; comparisons to other open-source platform business models (Red Hat, GitLab)
- uninformedThe conversation does not address the environmental/energy cost of massively expanding the AI builder population. If 100 million people are training, fine-tuning, and running models, the aggregate compute and energy footprint is non-trivial.Hugging Face's Clem Delangue: Stop Comparing Engines to Cars — read next: Research on AI compute energy footprint; local inference energy costs vs. centralized API serving efficiency
- incompleteNo binding-constraint diagnostic. The whole thesis presupposes the harness — not the model's capability ceiling — is what limits your task, but the piece offers no way to tell in advance whether a given task is harness-bound or capability-bound; you only learn which after gains flatten. The headline example (file-plumbing, 0% -> parity) is a selected case where the harness was the entire story and does not generalize to reasoning-bound tasks. This is the Meadows leverage-point question left unanswered.Don't train the model, evolve the harness — read next: Read Boeckeler's adaptive-control harness framing and Anthropic's 'remove components one at a time, keep only the load-bearing' methodology, looking for a procedure that predicts, before investment, which constraint binds — e.g. a cheap probe that separates 'model got the answer but the wrapper lost it' from 'model can't do this at all.'
- incomplete'Don't train' vs 'evolve the harness' is a soft strawman. Fine-tuning is never actually analyzed — no cost, no cases where training genuinely IS the right lever (domain shift, latency/cost at scale, proprietary capability the frontier lacks). For a rented frontier model the real contrast is harness-vs-nothing, so the title over-generalizes into 'never train.'Don't train the model, evolve the harness — read next: Read a fine-tuning cost/benefit source to bound when weight-changing is warranted, so the 'harness-first' heuristic has an explicit boundary rather than an absolute.
- incompleteThe automated 'add one mechanism, keep if better' loop has no pruning or garbage-collection step, so accreted mechanisms can ratchet harness complexity upward — precisely the cost the quoted deep-dive warns against (scaffolding should shrink; tight model-coupling creates lock-in). The maintenance and portability cost of an ever-growing auto-generated harness is named in the abstract but never quantified or bounded.Don't train the model, evolve the harness — read next: Read on harness co-training overfitting and the 'delete components one at a time' methodology; look for how an automated harness search can be given a complexity penalty or removal operator so it thins rather than only accretes.
- incompleteSecond-hand, single case, no first-party numbers. The entire empirical spine is one relayed Hugging Face experiment (7x cost, 14-point transfer, 3.5-80.1% spread) with no reproducible benchmark, dataset, task definition, or independent replication — thin ground for a rigorous adopter to act on.Don't train the model, evolve the harness — read next: Read the source Hugging Face post directly and seek independent harness-ablation studies before treating the 7x / 3.5-80.1% figures as generalizable.
- incompleteThe harness's contribution is under-explored and internally in tension: she found swapping OpenCode vs. Pi made little difference, yet Jigar Jani's near-all-local coding depends on continuously enhancing his harness with skills. How much of viability is raw model vs. harness engineering (skills, code-search/understanding tools, self-correction sensors) is left open.Experiences with local models for coding — read next: SmallCode-style harness-engineering studies for small models; her own harness-engineering framework; controlled comparisons isolating harness features (progressive disclosure, tool routing, skills) at fixed model.
- incompleteThe transfer of the 'cognitive artifacts' framework from human cognition to LLM systems is asserted but not defended. Human cognitive artifacts augment a general intelligence; LLM externalization compensates for specific architectural limitations (finite context, no persistent state). The analogy may be more misleading than illuminating.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Look for critiques of anthropomorphic framings of LLM capabilities; compare with distributed systems or compiler theory as alternative analogies.
- incompleteThe taxonomy assumes memory, skills, and protocols are 'distinct but coupled' — but the boundaries may be artificial. A skill with embedded memory and protocol-like interfaces blurs all three categories. The abstract does not address how to handle such overlap.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Check whether the full paper provides clear criteria for categorizing borderline cases.
- uninformedThe abstract does not address whether externalization introduces new failure modes (brittleness, composability failures, versioning conflicts) that may offset reliability gains. The framing is almost entirely positive.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Look for systems engineering literature on integration risk; check if the full paper's 'open challenges' section addresses this.
- illogicalThe historical progression 'weights -> context -> harness' is presented as a clean trajectory, but in practice these co-evolve. Larger context windows reduce the need for some externalization; better weights reduce the need for elaborate harnesses. The narrative oversimplifies.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Consider whether a co-evolutionary or dialectical framing would be more accurate than a linear progression.
- incompleteThe post takes the MIT/UPenn paper as authoritative but doesn't disclose the dataset, sample, or timeframe. Async agents in 2024-25 (the likely study window) are not the same product category as 2026 long-running harnesses — the 1.3x number may understate what later-generation tooling can do at the release-frequency end, OR may be optimistic if the study captured the early enthusiasm phase.Is AI coding on average 17.3x faster or 1.3x faster? Both. — LinkedIn post by Fabrice Bernhard — read next: The Demirer/Musolff/Yang paper itself; recent METR / RCT-style AI productivity studies; Pocock workshop on what changes with harness-level tooling.
- uninformedThe post predates / doesn't engage with the harness-engineering thread that this corpus has been tracking (Anthropic harness paper, Pocock workshop, Cloudflare Mythos). Harness-level tooling specifically aims at the integration between code generation and release — exactly the gap Bernhard names. Whether harness engineering is a third path (between 'roll out Copilot' and 'consultancy-led bottleneck targeting') is an obvious adjacency.Is AI coding on average 17.3x faster or 1.3x faster? Both. — LinkedIn post by Fabrice Bernhard — read next: Pocock workshop extraction; Anthropic harness design paper; Cloudflare Mythos extraction; the Anthropic enterprise PDF extraction.
- incompleteFowler offers no mechanism for detecting when 'disposable' software is silently graduating into consequential software. The disposable/consequential boundary is treated as legible to the author, but in practice it is one of the most common failure modes in software organisations — internal scripts becoming critical infrastructure.Bliki: Vibe Coding — read next: Cutler on institutional overload and shadow systems; classic discussions of 'tactical' vs 'strategic' programming (Ousterhout, Philosophy of Software Design); literature on shadow IT and end-user computing.
- incompleteNo engagement with the cultural/professional question of whether vibe coding deserves the name 'coding' at all, or whether legitimising it as a coding practice (rather than, say, 'spec-driven prototyping') invites exactly the diffusion problem Fowler is trying to push back against.Bliki: Vibe Coding — read next: Naur on programming as theory building; the broader 'what is programming' debate that has resurfaced post-LLM.
- incompleteThe post quotes all five Thoughtworks headline findings up front but only substantively elaborates two of them (the executive/engineer expectation gap, and — thinly — verification-as-bottleneck via the sensors/feedback theme). 'Harness engineering,' 'the apprenticeship crisis,' and 'legacy modernization' are named but never discussed anywhere in the body text that follows.Fragments: July 21 — read next: Read the full Thoughtworks PDF report directly for the elaboration this fragment post doesn't provide, and cross-reference this corpus's existing harness-engineering syntopical map and extract-fowler-fragments-july-6 for adjacent material from the same retreat series.
- uninformedThe cited 75.33% law-professor preference finding for LLM answers over peer instructors is reported without the students'-side outcome (whether students who received LLM answers actually learned better or worse), the specific sample of contract-law questions used, or which models were tested — details that materially affect how far the finding generalizes beyond 'LLMs write plausible short answers professors like reading.'Fragments: July 21 — read next: Read the original Stanford Law study directly for full methodology and any student-learning-outcome measures, and check for replication in other legal or technical education domains.
- incompleteThe central 'repo becomes a mini-organization / Conway's Law in reverse' claim rests on exactly two examples, both author-affiliated: his own single-operator software factory and HydraFlow, 'our research system.' There is no independent replication, no failure case, and no discussion of whether or how the pattern holds at multi-repo, multi-team, or cross-organization scale.From AI Code to Trusted Software: Harness Engineering in Practice — read next: Third-party case studies or post-mortems of harness-governed repositories at genuine multi-team/enterprise scale, not single-operator 'factories,' to test whether the organizational-emergence claim generalizes.
- incompleteThe article never addresses the cost, staffing, or ongoing maintenance burden of building and operating a harness (writing and tuning gates, reviewing verdicts, maintaining reproducibility manifests, calibrating judge agents) — so there is no basis offered for weighing harness-engineering investment against simply continuing manual review, particularly for smaller teams without a dedicated 'operator' role. A sibling extraction in this corpus (on Bockeler's harness-engineering piece) flags the identical open cost-benefit gap.From AI Code to Trusted Software: Harness Engineering in Practice — read next: Cost/effort/ROI case studies quantifying harness build-and-maintain effort against review-time or incident-rate improvements, ideally across team sizes.
- incompleteThe 80-20 flip is asserted from consulting experience but not quantified. No data is offered on what 'calibration' costs in practice relative to build — the ratio could vary enormously by domain, and the 80-20 framing may be more rhetorical than empirical.
- uninformedThe legal and compliance discussion is acknowledged as outside Aishwarya's expertise. Given that governance failures can kill finished projects (as her own anecdote shows), the treatment is surprisingly thin — no frameworks, regulations, or concrete practices are discussed.
- illogicalAishwarya argues that model personality differences will not converge because vendors treat them as competitive differentiators, but also argues that model capabilities are converging rapidly. The distinction between 'capability' and 'personality' is never defined rigorously — prompt sensitivity, output style, and error patterns could plausibly converge as capabilities do.
- incompleteThe claim that early-career 'agent-native' workers have a hiring advantage is supported only by Aishwarya's personal hiring experience at a small consultancy. Whether this generalizes to larger enterprises with different incentive structures is unexamined.
- incompleteThe optimization pyramid (effort -> performance -> cost -> latency) is offered as a sequential framework but no guidance is given on when to stop optimizing performance and move to cost/latency, or how to handle cases where the two conflict fundamentally.
- incompleteThe article reports API surface and quotes one external blog reviewer (Ebenezer Don) but offers no production deployment evidence, benchmark, or failure-mode data — unlike, for instance, the corpus's reports on Claude Managed Agents at Rakuten or L'Oreal. As a preview release, that's expected, but it means every claim about the abstraction 'scaling without swapping primitives' is currently a design intention, not a tested property.Google's Genkit Ships Agents API with Detached Turns and Human-in-the-Loop for TypeScript and Go — read next: Watch for practitioner postmortems or case studies once teams have run the Genkit Agents API in production for a few months; compare against how Claude Managed Agents adoption reports (extract-building-ai-agents-for-the-enterprise) evolved from announcement to measured outcomes.
- incompleteThe article claims Genkit differentiates through full-stack breadth (typed client SDKs, built-in streaming protocol, deployment to Firebase/Cloud Run/Node/Go) without examining whether that breadth reintroduces exactly the kind of lock-in the model-agnostic plugin layer is meant to avoid. Once an application depends on Genkit's client SDKs and streaming protocol, swapping the *framework* — not just the model — becomes costly; the piece treats 'model-agnostic' as sufficient evidence against lock-in without addressing the framework layer.Google's Genkit Ships Agents API with Detached Turns and Human-in-the-Loop for TypeScript and Go — read next: extract-oreilly-radar-may-2026 and extract-outsourced-ai-still-own-the-risk on vendor lock-in in the emerging agent stack; extract-ai-models-disappear-overnight on model-agnostic harness design principles.
- incompleteThe article never interrogates whether 'middleware' is the right metaphor. HTTP middleware sits in a deterministic request/response pipeline; the agent tool loop is non-deterministic, multi-step, and stateful. The Genkit hooks may be closer to Aspect-Oriented Programming (cross-cutting advice around named join points like generation/model/tool) than to a Connect/Express chain. The conflation matters: AOP-style weaving creates classic 'where does the behavior live' debugging problems, which the Developer UI alone may not solve.Google Introduces Middleware Architecture for Genkit Applications — read next: Read the original Google blog post for the actual API surface; read Genkit source for what 'middleware' resolves to at runtime; compare with LangChain callbacks/handlers and OpenAI Agents SDK guardrails as alternate models.
- incompleteNo mention of failure modes specific to LLM systems — non-deterministic outputs, cascade hallucinations under retry, fallback models with different safety calibrations, approval gates that humans rubber-stamp under volume. The catalog implies these are solved patterns; production experience suggests otherwise.Google Introduces Middleware Architecture for Genkit Applications — read next: Look for postmortems and practitioner reports on retry/fallback behavior in agentic systems — the gap between 'we shipped retries' and 'retries work safely' is where the interesting engineering lives.
- incompleteThe piece treats observability as solved by Developer UI inspection but does not address production observability — how middleware traces flow into OpenTelemetry, structured logs, or SRE alerting. Dev-time inspection and production telemetry are different problems.Google Introduces Middleware Architecture for Genkit Applications — read next: Compare with OpenTelemetry's GenAI semantic conventions, and with Honeycomb/Datadog's emerging LLM-observability stories.
- incompleteThe implicit programming model is never made explicit. Three options coexist in the article: (a) HTTP-style middleware chain, (b) AOP-style advice around join points, (c) callback registry à la frontend frameworks. Each has different composition semantics and different debugging stories. The choice is the architecture.Google Introduces Middleware Architecture for Genkit Applications — read next: Genkit RFC/design docs if they exist; the Anthropic skills system as a contrasting design; LangChain's callback model for a third reference point.
- incompleteDeveloper-platform story is conspicuously absent. No mention of Genkit, Vertex AI Agent Builder, MCP support, A2A protocols, or how Antigravity relates to Cursor / Claude Code / Windsurf. For a month framed around 'agentic era,' the silence on the agent-developer stack is striking.The latest AI news we announced in May 2026 — read next: Compare to Anthropic's developer newsletter (May 2026) and the Turing Post / O'Reilly pieces on agent harness design; read Google Cloud Next / Genkit release notes separately.
- incompleteThe 'organisatorisk gjeld' coinage at the close is the most pregnant unfinished idea in the episode. Moe gestures at the next direction of 'lett og rett' — engineering golden paths for product development itself, with good practices baked into roadmap tooling — but does not work it out. This is exactly the territory where the AI question reconnects: an agentic product-development assistant that encoded the right defaults could be the next instance of 'lett og rett', and would be a Moe-shaped answer to the alienation worry from his essay.5) Vidar Moe: Det eneste Vidar vil er å ha det lett — read next: Pair with the user's existing extractions on harness engineering for AI coding agents and on 'Agents Don't Know What Good Looks Like'. The Backstage / Internal Developer Platforms tradition (Spotify) is the obvious anglophone analogue. Team Topologies (Skelton & Pais) and DORA's recent platform engineering findings are the natural canon. Truls's closing observation that Toyota → DORA → Team Topologies is one lineage is exactly the bridge.
- incompleteTorrissen's frame is largely Norwegian consultancy and public-sector. The 30-year-lifespan argument is anchored in NAV/Skatt/politi; he gestures at differential quality bars for low-stakes consumer apps but does not engage with product-company contexts (startup, scaleup, SaaS) where the relevant time horizon is 3-5 years and the relevant readers are 5-10 engineers, not 70 forvaltere.13) Tobias K. Torrissen om kodekvalitet, konferanser og AI — read next: Read this against the Pocock workshop extraction (product-company AI workflow) and Vidar Moe (Heis), to see how product-company engineers calibrate quality differently.
- incompleteThe 'engineering practices matter more under AI' claim rests on one cited Telenor talk. Strong intuition, weak evidence. A serious version needs DORA-style measurement of practice maturity × AI uplift.13) Tobias K. Torrissen om kodekvalitet, konferanser og AI — read next: DORA 2025 (already in user's library); the Entur AI adoption piece; Addy Osmani's agent patterns; any rigorous productivity studies.
- incompleteThe 'obvious over clever' principle is presented as inheritance from NAV's tekniske retning but the tradeoff against domain-modelling power, type-system expressiveness, and idiomatic language use is not explored. A 'maximally obvious' codebase in a functional language with strong types may look obscure to a Java-trained 70-forvalter pool.13) Tobias K. Torrissen om kodekvalitet, konferanser og AI — read next: Greg Young / Vlad Khononov on domain modelling; Ousterhout's 'A Philosophy of Software Design'; Rich Hickey's 'Simple Made Easy' (vs. 'easy ≠ obvious').
- incompleteTorrissen acknowledges he's about to participate in a recursive case (reviewing code that was itself generated agentically) and only jokes. The methodology gap — how does code review change when the developer's intent is partially encoded in prompts, ADRs, and context files rather than commit history — is left for next time.13) Tobias K. Torrissen om kodekvalitet, konferanser og AI — read next: Anthropic 'harness design' talk and the Pocock workshop already in this corpus.
- incompleteThe advice to juniors assumes the fundamentals taught today are the right ones; doesn't engage with the possibility that fundamentals themselves need re-curation for a world where LLMs are the second author. What does TDD even mean when test generation is also automated?13) Tobias K. Torrissen om kodekvalitet, konferanser og AI — read next: Kent Beck's recent 'Tidy First?' work on AI and design; 'starving genies' series; DORA on AI testing practices.
- uninformedTorrissen disclaims familiarity with the formal 'distribution law' he invokes (Parnas/Helland-style). He gets the spirit right but doesn't engage with the literature on when distribution is forced (latency, regulatory, fault isolation).13) Tobias K. Torrissen om kodekvalitet, konferanser og AI — read next: Pat Helland's papers; Parnas on module boundaries; Vlad Khononov directly.
- incompleteCode quality discussion is silent on data and persistence design — arguably the longest-lived and hardest-to-change layer in 30-year systems. The whole conversation is about behavioural code.13) Tobias K. Torrissen om kodekvalitet, konferanser og AI — read next: Stripe-style schema evolution practice; Martin Kleppmann's data engineering work; event-sourcing reflections from CQRS practitioners.
- uninformedStrümke is open about her own production-coding skepticism ('jeg merker når jeg sitter og koder med agentene, så er sånn tulleprosjektet'), and the hosts (Audun from NAV) push back gently with the more developed practitioner view that high-stakes work warrants Vim while front-end can be agent-led. Strümke's reading of agentic coding may underweight what's currently possible with proper harness, evals, and sandboxing — though she does flag the macOS sandbox feature.16) Inga Strümke om hvor AI er på vei, den outsourcede problemløsningen og datamanifolden — read next: User's existing thread on harness engineering (Anthropic videos, Boris Cherny, Bockeler/Fowler static sensors); Beane on Precision Proactivity; the user's earlier Heis Anders Sveen / Vilde Opsal extractions; Greger Wedel; concrete production-engineering reports from Builder.io, Cursor, and Claude Code teams.
- illogicalJonas argues both that we are early on the AI S-curve (so 10% gains are not the story) and that complexity will push back on productivity gains as they accumulate. These are compatible but in tension: if the curve climbs steeply because of intent-level abstraction, the complexity ceiling should appear later; if complexity bites soon, the curve is shallower than claimed. The argument is not adjudicated.17) Jonas Slørdahl Skjærpe om svinghjuleffekter, liminalfaser og kunsten å ta heis — read next: The Brooks / Mythical Man Month tradition on accidental vs essential complexity; Ousterhout on system design; recent measurements on long-running agent harnesses (Anthropic harness design work) which directly test the complexity-ceiling claim.
- incompleteThe talk does not address how a team coordinates or reviews this hand-engineered, token-by-token prompt and control-flow discipline across multiple engineers over time — it is framed entirely from a single practitioner's vantage point, with no discussion of code review, documentation, or onboarding for the 'owned' control flow and prompts.12-Factor Agents: Patterns of reliable LLM applications — Dex Horthy, HumanLayer — read next: extract-humanlayer-advanced-context-engineering-ace-fca.json and extract-horthy-no-vibes-allowed-complex-codebases.json (same author's later, team-scale essays) take up exactly this gap — team mental alignment, review at the plan/research layer, and scaling the practice beyond a single motivated practitioner.
- incompleteThe entire account is a first-person report from one unusually skilled, senior, high-visibility informant — there is no organizational baseline, no failure-mode data, and no dissenting internal voice about what fraction of Anthropic engineers actually work the way Thariq describes.How Anthropic Builds And How Engineering Will Change Soon | Thariq Shihipar — read next: Internal Anthropic engineering surveys or DORA-style internal metrics (if any are ever published) on the actual distribution of AI-assisted practice adoption, not just exemplary anecdotes.
- incompleteThe claim that harnesses must grow in complexity as models improve is not reconciled with the corpus's competing observation (e.g. senior practitioners reportedly prompting agents less and less directly) about whether growing harness complexity is itself migrating into the product/model layer, so that the complexity becomes Anthropic's problem to solve rather than every user's.How Anthropic Builds And How Engineering Will Change Soon | Thariq Shihipar — read next: extract-osmani-loop-engineering and extract-bockeler-harness-engineering on where harness complexity is expected to live over time.
- uninformedNone of the conversation's strong quantitative-sounding claims (the autonomous-change percentage being unmeasured by design, the incident-rate increase, '100 times more testing code,' engineers 'not in the IDE for six months') are backed by cited internal eval or metrics data — they are informal, first-person estimates, despite Anthropic's own emphasis elsewhere in the corpus on evals as the standard of truth for claims about model/practice performance.How Anthropic Builds And How Engineering Will Change Soon | Thariq Shihipar — read next: Any published Anthropic internal engineering metrics or eval results on AI-assisted development adoption and outcomes, to check these estimates against measured data.
- incompleteProvenance is asserted, not sourced, and the title oversells it. 'Straight from the team that built it' implies insider access, but the body reveals the actual source is Anthropic's PUBLIC official prompting guide, relayed by an anonymous X account with no link to the guide, no author attribution, and no way to see what was faithfully relayed versus added or distorted. The persuasive authority exceeds the sourcing.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Read the primary guide directly (extract-prompting-claude-fable-5) instead of this relay; treat 'straight from the team' as marketing, not provenance. Locate and confirm the thread-only specifics — the ultrathink/ultracode keywords, the thinking.display value semantics, the sub-5% refusal rate, prompt-cache-cost coverage, the 'audit beat softer phrasings' result, Mythos-drops-cyber — against Anthropic's actual published pages before relying on any of them.
- incompleteDouble staleness / secondary-source drift. The thread compresses an UNDATED official guide (flagged in the sibling extraction as drifting silently as the model and platform update) and is itself a dated July-1-2026 tweet — a dated secondary source of an undated primary. Every version-specific claim (effort defaults, classifier domains, thinking.display values, xhigh-model list, sub-5% refusal rate) is twice-removed from the changelog.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Re-verify every version-specific claim against the platform changelog and the 'Introducing Claude Fable 5 and Mythos 5' page at time of use; never migrate a production workflow on a tweet's restatement of an undated doc.
- incompleteNo evals or verification — the same bar as the docs, and no better. The thread inherits the official guide's central weakness (no reproducible benchmark, dataset, baseline, or numbers for any recommended prompt block) and layers on further unverified quantification ('audit-language produced more reliable self-checking than softer equivalents'; refusals affect 'under five percent of typical developer queries') with no method behind either. A thread adds zero measurement.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Do not treat the thread as evidence for any technique. Build an A/B eval harness (as the sibling gap prescribes) that measures each system-prompt block's marginal effect on your own tasks before adopting it; pair with an evals-disciplined source (extract-anthropic-harness-design-long-running-application-development).
- incompleteSelection/hype bias of the thread format: it reproduces the guide's recommendations but trims its hedges. It presents effort as 'not a quality dial' while dropping the guide's intelligence axis and its warning that higher effort can over-deliberate; it never addresses interaction effects among the stacked system-prompt blocks (brevity, audit, proactivity, memory, final-response) that the reader is told to add together; and the engagement-optimized 'different category of tool' framing amplifies upside while muting trade-offs.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Read the primary guide for the caveats the thread trims; assemble and test the composed system prompt as a whole (the sibling's interaction-effects gap) rather than trusting the thread's flattened, upside-first presentation.
- incompleteThe four prescribed developer habits (especially 'own the memory layer' and 'keep a second model warm') are advocated without acknowledging their engineering and maintenance cost. The corpus has already flagged this exact hedge as usually treated as effectively free (extract-ai-models-disappear-overnight#g4); if maintaining harness/model portability is expensive, only well-resourced developers can afford the optionality the article calls for — potentially reproducing, at the harness layer, the same power-concentration dynamic the article criticizes at the model layer.Is Open-Source AI Really the Dangerous Path? — read next: Total-cost-of-ownership analyses of maintaining a model-agnostic harness across multiple providers; case studies of teams that attempted this abstraction and hit real friction, cost, or capability gaps.
- uninformedThe post predates / sidesteps the harness-engineering thread in this corpus. Frederiksen is solving the procurement layer (which model, hosted where, billed how). Pocock / Anthropic / Cloudflare Mythos / smallcode are solving the orchestration layer above it (how to actually get reliable work out of any model, sovereign or not). The two layers are orthogonal — but a complete enterprise AI strategy needs both, and Frederiksen's post implies that getting procurement right is sufficient. It isn't.95% cheaper and sovereign AI: Why we dropped Copilot at Coop Bank — LinkedIn post by Jannik William Frederiksen — read next: Pocock workshop extraction; Anthropic harness paper; Bernhard post on value-stream targeting; Cloudflare Mythos for the orchestration economics.
- incompleteEvery control in the 7-pillar architecture is justified by first-principles reasoning about non-determinism and by citing named threat patterns (slopsquatting, invisible payloads, Confused Deputy), but no incident data, overhead measurements, or cost-benefit comparison is offered for any proposed control — e.g., no data on how much the 'Vibe Diff' + hardware MFA step actually reduces blind-approval rates versus a simpler gate, or on the operational cost of running a continuous Red/Blue/Green triad alongside every development workflow.Vibe Coding Agent Security And Evaluation — read next: This corpus's own extract-lulla-loop-engineering-building-blocks-adoption-impact documents, for a structurally similar case (loop engineering's prescribed building blocks), that almost none of a comparably detailed practitioner-prescribed architecture shows up as committed, verified practice in real repositories — worth reading against this whitepaper's unverified 7-pillar prescriptions for the same pattern.
- incompleteThe evaluation framework explicitly scopes out 'the feedback loop from user corrections back into the model, the harness, or the eval suite' as future work — but the applied tip 'Mine user corrections as labeled failure data' in the same document is precisely that feedback loop's first step (clustering corrections into failure modes), left unconnected to how those clusters would actually drive harness or eval changes.Vibe Coding Agent Security And Evaluation — read next: The corpus's context-engineering and agent-config-decay material on how harness/context changes get fed back from observed failures.
- incompleteThe entire talk is built from live demos chosen, prepared, and run by the presenter at his own company on his own agent platform. There is no discussion of failure rate, what a bad outcome from an autonomous git operation looks like, or how often agents get it wrong under less favorable conditions than a curated 15-minute conference slot (larger codebase, adversarial input, ambiguous instructions).The Future of Work by Henrik Kniberg — read next: Corpus pieces that report failure rates and guardrail design for agentic coding rather than demo success — e.g. extract-fowler-orchestrators-tax and extract-what-survived-contact — for what happens when the review/merge step this talk relies on doesn't catch a subtly wrong change.
- incompleteThe argument against AI replacing engineers relies heavily on current SWE-bench scores and a claim about algorithms not changing since the 1950s. This understates the pace of agentic and scaffolding innovations (MCP, RAG, multi-agent systems) that improve effective capability without changing underlying model architecture.Presentation: Leadership in AI-Assisted Engineering — read next: Anthropic, OpenAI, and DeepMind research on agent scaffolding; François Chollet's critique of benchmark-as-capability proxies
- incompleteThe mining study measures public open-source adoption only. The paper itself notes that 'high-volume internal deployments... leave no public trace,' but the headline anecdotes it discusses (Stripe's Minions, 1,300 PRs/week) are exactly such internal deployments. The 0.59% figure is therefore a floor on publicly-visible evidence, not a measure of practice overall, and the paper cannot adjudicate whether loop engineering is genuinely rare or merely rare in public repositories.Loop Engineering: Building Blocks, Adoption, and Impact — read next: An internal-tooling survey or structured practitioner-interview study of enterprise/internal loop adoption (the kind this corpus's Stripe and 'software factory' pieces gesture toward) to estimate private adoption rates that public GitHub mining cannot reach.
- evidentiaryMarcus does not explain what print.ts actually does within Claude Code's architecture. The file name suggests it is a rendering/output-formatting module, not a 'kernel' in the computational sense. Calling it the system's 'center' and equating its IF-THEN logic with 'classical symbolic AI' is a significant interpretive leap that goes undefended.The biggest advance in AI since the LLM — read next: Examine the actual Claude Code source to determine whether print.ts is architecturally central or peripheral; read Simon Willison's and other technical analyses of the leak.
- logicalThe argument conflates 'contains deterministic code' with 'is neurosymbolic in the research-programme sense.' Almost all software systems contain IF-THEN logic; the neurosymbolic research programme means something more specific — structured knowledge representations, formal reasoning, compositionality. Marcus does not show that Claude Code has these properties.The biggest advance in AI since the LLM — read next: Read the neurosymbolic AI literature (e.g., Garcez & Lamb 2023) to clarify what the term requires; compare with Marcus's own prior definitions.
- rhetoricalThe essay is structured as personal vindication rather than neutral analysis. The framing ('massive vindication for me personally') may lead readers to accept the argument on ethos rather than evaluating the evidence independently.The biggest advance in AI since the LLM — read next: Seek independent technical assessments of Claude Code's architecture that do not have a stake in the neurosymbolic debate.
- causalEven granting that Claude Code contains symbolic components, Marcus does not establish that these components (rather than, say, the agentic loop, tool-use design, context management, or the underlying LLM quality) are what make it effective. The causal claim is asserted, not argued.The biggest advance in AI since the LLM — read next: Look for ablation studies or engineering post-mortems that isolate the contribution of symbolic vs. neural components in agentic coding systems.
- incompleteThe video's own disagreement — that a developer can 'graduate' from conductor to orchestrator mode once the harness is reliable enough — never specifies what makes a harness 'reliable enough,' leaving the central judgment call of the video's one original argument entirely undefined.Google Just Dropped a Masterclass on Agentic Engineering (It's SO Good) — read next: Material on concrete harness-reliability metrics or thresholds (e.g. pass rates on the team's own eval suite) that could operationalize when to stop conductor-level supervision.
- incompleteThe article does not address whether Meta's shift from open weights to closed hosting is driven by competitive pressure, safety concerns, or compute economics. The 10x efficiency claim is stated but not analyzed — if frontier performance is achievable with 10x less compute, that should make open-weight releases more feasible, not less.Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: Meta's AI strategy documents; analysis of the economics of open-weight vs. API-hosted model distribution
- incompleteThe Glasswing section does not address the offensive/defensive asymmetry: Anthropic gives defenders a head start, but the underlying capabilities will inevitably proliferate. How long is the defensive window, and what happens when it closes?Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: Thomas Ptacek's 'Vulnerability Research Is Cooked'; cybersecurity literature on offense-defense balance with new capability categories
- incompleteThe article treats the Axios social engineering attack and the AI vulnerability discovery trend as separate stories, but does not connect them: AI could make social engineering attacks on maintainers more scalable and convincing, compounding both threats simultaneously.Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: Research on AI-enhanced social engineering; analysis of combined technical+social attack vectors
- incompleteThe GitHub activity statistics (275M commits/week, 2.1B Actions minutes/week) are presented without analysis of how much is AI-generated. If a significant fraction is AI-driven, these numbers may indicate code volume inflation rather than genuine productivity gains.Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: GitHub's own analysis of Copilot-attributed commits; research on whether AI-generated code volume correlates with software quality
- illogicalThe article cites a cited coding-agents study finding models default to unwanted *action* (making changes 35-65% of the time when the right move was to do nothing) to explain why, in build-something work, the bias runs toward doing something rather than nothing. But deferral pressure is itself a form of avoidance — declining to finish the actual outstanding work by relabeling it as no-longer-current. The piece doesn't reconcile why an 'action-biased' model would specifically favor a deferral (a stopping-adjacent move on the *current* item) rather than simply doing the work, and doesn't examine whether deferral is better understood as a distinct third category (relabeling-as-completion) rather than a variant of either the action-bias or omission-bias literature it cites.My AI Kept Pushing Me to Ship, So I Asked It Why — read next: Look for work that distinguishes 'doing nothing' from 'declaring something done without doing it' as separate failure modes, since the cited omission-bias and action-bias studies may not map cleanly onto deferral pressure at all.
- incompleteThe CapEx/OpEx accounting (Figure 9) is a clean two-bucket schematic, but never addresses who inside an organization actually bears the upfront CapEx — often the platform/infra team or a specific engineer, who is rarely rewarded on the same cycle as the feature team that looks fast by vibe coding. The 'for organizations' advice ('treat it as an engineering investment') doesn't engage this incentive-misalignment risk at all.The New SDLC With Vibe Coding: From ad-hoc prompting to Agentic Engineering — read next: Team-topology or incentive-design material on how to attribute/reward harness investment separately from feature-delivery speed.
- uninformedThe 'most agent failures are configuration failures' claim is drawn from two benchmark anecdotes where harness changes were deliberately isolated and measured in a competition setting; the paper never flags that ordinary teams lack this kind of controlled before/after measurement, so the claim may hold in benchmarks and be unverifiable — not merely under-evidenced, but structurally unfalsifiable — under typical team conditions without comparable instrumentation.The New SDLC With Vibe Coding: From ad-hoc prompting to Agentic Engineering — read next: extract-addy-osmani-quality-in-the-harness.json (same author's companion piece, which itself leaves open who builds/tests/maintains the harness's own checks on an ongoing basis).
- illogicalThe harness-engineering-teams argument rests entirely on the DevOps-team analogy, asserted because it 'feels wrong' in the same way; the parallel is never established, so the conclusion inherits whatever weakness is in the unexamined analogy.Notes from FOSE Europe — read next: Read critiques distinguishing DevOps-the-movement from DevOps-the-team and test whether the same structure applies to harness engineering.
- incompleteThe piece lists tests and evaluation harnesses among what Codex produces but never explains how functional/behavioral correctness is actually verified — whether agent-written tests are independently judged trustworthy, what the 'evaluation harnesses' evaluate, or how the team would know if the agent-to-agent self-review loop (Codex reviewing its own changes, requesting further agent reviews, iterating until all agent reviewers are 'satisfied') were systematically missing a whole class of bug.Harness engineering: leveraging Codex in an agent-first world — read next: Read Birgitta Böckeler's two reaction pieces (extract-bockeler-harness-engineering, extract-boeckeler-harness-engineering), which both name this exact omission as the single most consequential gap in this piece, and her fuller framework article's naming of the 'behavioural harness' as the hardest, least-solved problem.
- uninformedEvery quantitative claim in the piece (1/10th the time, 3.5 PRs/engineer/day, 1M+ lines, throughput increasing with team size) is self-reported by the team that built the system and has an organizational interest in publicizing it, with no external audit, no comparison codebase built by an equivalent human-only team under the same product requirements, and no stated method for what counts as a meaningfully-sized 'line of code' or PR.
- incompleteThe piece describes human review as optional ('Humans may review pull requests, but aren't required to... we've pushed almost all review effort towards being handled agent-to-agent') but never says what determines which PRs actually receive a human look versus none, or what happens when agent-to-agent review systematically misses the same class of issue because both the authoring agent and the reviewing agent share the same model's blind spots.
- incompleteThe 'rethinking' is asserted rather than performed. The article never enumerates the prior harness assumptions being overturned (e.g., DAG-based orchestration, deterministic tool dispatch, code-defined skills, developer-mediated change) nor articulates the new principles replacing them beyond 'skills written in English.' For a piece titled 'Rethinking the Agent Harness,' the actual rethink is one anecdote and one neologism.This Week in AI: Rethinking the Agent Harness — read next: Berryman & Ziegler, 'Prompt Engineering for LLMs' (the cited O'Reilly book); Anthropic's own Claude Code design docs; the Stanford paper at arXiv:2603.28052; Birgitta Böckeler's 'harness engineering' piece for an attempt to actually decompose the harness layer.
- incompleteSingle-case generalization. The unity ('build your own harness') rests almost entirely on one consulting client where it 'worked perfectly.' No failure modes, no boundary conditions, no comparison to cases where a bespoke app or a wrapped product would still be the right choice.This Week in AI: Rethinking the Agent Harness — read next: Post-mortems of agent deployments at scale; the Cognition/Devin retrospectives; harness-engineering writeups from teams shipping to production rather than consultants.
- incompleteThe relationship between the three sections is unargued. Mythos, the compute buildout, and the harness thesis are juxtaposed without the article noticing that they imply different theories of where AI value is moving — model layer (compute), capability frontier (Mythos), or harness layer (Berryman). The implicit reconciliation would be the most interesting move and isn't made.This Week in AI: Rethinking the Agent Harness — read next: Articles framing 'value migration in the AI stack' explicitly; investor letters or analyst notes that try to resolve which layer captures economic returns.
- incompleteThe 'open agent protocol' is named without being specified. No design sketch, no examples of what an environment-supplied skill looks like, no comparison to existing proposals (MCP, A2A, agent-to-agent protocols). The reader is left with a direction but no testable proposal.This Week in AI: Rethinking the Agent Harness — read next: Anthropic's Model Context Protocol spec; agent interoperability proposals from Google, OpenAI, and the LangChain ecosystem; the future-cast section in the next Berryman appearance.
- uninformedSchneier's challenge to Mythos's uniqueness is mentioned and then immediately set aside ('either way, it's a problem that's coming'). The article does not engage with the substantive question of whether the policy response is calibrated to actual differential capability or to perceived capability — a question whose answer matters for whether FDA-style review is wise.This Week in AI: Rethinking the Agent Harness — read next: Schneier's full post on Mythos; CAISI's framing; counter-arguments from researchers who replicated Mythos-like findings on cheaper public models.
- illogicalMild equivocation on 'harness.' Claude Code (a specific product), 'the agent harness' (a layer), and Berryman's bespoke consulting build (a specific instance) are used interchangeably. A reader could leave thinking 'use Claude Code' and 'build your own harness' are the same recommendation, when the article's argument actually requires the latter and only points at the former as an example.This Week in AI: Rethinking the Agent Harness — read next: Explicit harness taxonomy work — what distinguishes a product, a framework, and a bespoke harness — e.g., Böckeler's 'harness engineering' piece.
- incompleteThe article's own title calls the demoed system a 'Workflow Agent,' but the piece never clarifies whether it actually meets the corpus's own sharper agent/workflow distinction — an agent, strictly, is a reasoning loop that decides for itself when a task is finished, whereas a fixed deterministic sequence of model calls is an 'LLM workflow,' not an agent. Berryman's dual-loop definition doesn't say which side of that line his own checklist-driven, structured-output demo actually falls on.Zero to Agent in 30 Minutes: Build a Workflow Agent with John Berryman — read next: extract-stop-overengineering-your-agent-harness — supplies the sharper agent-vs-workflow definitional test this piece's own title invokes but never resolves for its own demo.
- incompleteThe essay proposes an 'accountability contract' (checklist understood, evidence, who's accountable, system status) but never specifies how any of these fields get populated from an actual hour-scale agentic run whose intermediate decisions are, by the essay's own admission, not fully recorded and cannot all be traced back to input tokens — leaving the central operational question (how do you produce the evidence you're claiming to own) unanswered.Own the Outer Loop — read next: Read Osmani's own 'Quality in the Harness' and 'Software Factories, Light and Dark' for the concrete evidence artifacts (tests, static analysis, review gates) he specifies elsewhere, and read agent-governance / decision-provenance literature for concrete audit-trail mechanisms.
- uninformedAs an outside-observer journalist rather than a practitioner, Newton doesn't engage with the mechanism underneath Glaze — what agent/model architecture it runs, how the 'circle an element to edit it' feature is implemented, or whether the generated code's quality or security is auditable. The piece is long on implications and 'vibes,' short on any rigorous look at what's actually happening under the hood.Vibe coding has escaped the terminal — read next: For the engineering-craft angle, look for a practitioner teardown of Glaze's (or Wabi's) underlying agent harness and tooling, analogous to a technical review of Claude Code internals.
- incompleteThe article's evaluative back half (sections 5–7: cost/'tokenmaxxing' disappointment stories, the 'was it just a hack' argument, and the context-engineering conclusion) is paywalled; this extraction only had the one-line table-of-contents previews for that material, not the supporting evidence or full argument.What is “loop engineering?” — read next: Get subscriber access to read the full piece, especially the cost-tradeoff stories in section 5 and the closing argument in section 7 for why context engineering may matter more than loop engineering — directly relevant to the persona's 'rigorous adopter, not hype-follower' stance on AI-agent practice.
- incompleteNo base rate or comparison to non-LLM SAST/DAST. The post claims Mythos produces 'noticeably higher quality' triage output and that the harness produces 'meaningful coverage', but provides no quantitative baseline against either prior frontier models or traditional static analysis. The reader has to take Cloudflare's qualitative judgment on faith.Project Glasswing: what Mythos showed us — read next: Read the Anthropic harness paper (planner/generator/evaluator) and any forthcoming Mythos technical report for quantified eval data; cross-reference with industry SAST benchmarks (e.g. OWASP Benchmark) to triangulate.
- incompleteVendor-incentive analysis is absent. Cloudflare was an invited Glasswing partner and benefits from being perceived as an Anthropic-grade security research org. The post is simultaneously a research report, a co-marketing artifact, and a strategic positioning piece for Cloudflare's edge product suite ('our products are built to apply [these principles] on behalf of customers'). None of this is acknowledged.Project Glasswing: what Mythos showed us — read next: Read Schneier on Security or Marcus on AI safety for an external skeptic's read; look for independent reproductions of Cloudflare's claims by orgs without an Anthropic partnership.
- incompleteNo adversarial robustness data. If attackers know LLM-based scanners are in the loop, they can seed code with patterns that exploit known model biases — false-negative attractors, hedging triggers, or refusal-inducing framings on the defender's side. The post discusses defender adversariality (adversarial review between agents) but not attacker adversariality.Project Glasswing: what Mythos showed us — read next: Anthropic's own work on adversarial robustness; the broader literature on prompt injection and indirect prompt injection in agentic systems.
- incompleteGeneralizability across stacks is asserted by silence. Cloudflare's codebase — heavily Rust, well-documented, with explicit trust boundaries and the discipline that comes from running a global edge network — is unusually well-suited to the harness as described. Whether the same harness pays off on a typical enterprise Java monorepo with sparse documentation and ambiguous trust boundaries is an open empirical question.Project Glasswing: what Mythos showed us — read next: Look for similar reports from non-Cloudflare practitioners (Google Project Zero, Microsoft, GitHub Advanced Security with Copilot Autofix at scale) using comparable harness architectures; pair with Böckeler on variety reduction as the precondition for any harness to work.
- incompleteThe 'context anxiety / compaction discards earlier findings' claim is offered as a one-line motivation for the harness but is the most theoretically interesting failure mode in the post — and the one that connects most directly to the user's harness-engineering reading thread. Bourzikas leaves the mechanism opaque (how often does compaction discard a real finding? does Mythos behave differently from general frontier models on this dimension?).Project Glasswing: what Mythos showed us — read next: Re-read the Anthropic harness paper's 'context anxiety' discussion; pair with Böckeler's variety-reduction framing and the smallcode failure-mode catalog; consider an extraction comparing the three on a single axis: 'what is the model's relationship to its own context, and what does the harness do about it?'
- incompleteThe model-written-patches anecdote is mentioned in one sentence and then abandoned. How many patches went out? How were the regressions detected — by Cloudflare's own pipeline or by customer impact? What was rolled back? Given that this is a public commitment that Cloudflare shipped broken patches authored by an LLM, the lack of detail is itself a finding.Project Glasswing: what Mythos showed us — read next: Watch for follow-up Cloudflare posts; pair with research on LLM-generated patch quality (e.g. recent academic work on Copilot Autofix regression rates).
- illogicalThe two-hour SLA argument elides a continuum. Bourzikas treats 'two-hour SLA' as the strawman and 'architectural hardening' as the alternative, but the realistic question is whether to push patch-speed to four hours, twelve hours, or 24 hours while also investing in architecture. The dichotomy is rhetorically convenient and conveniently routes attention toward Cloudflare's product moat.Project Glasswing: what Mythos showed us — read next: Read existing CVE-to-patch SLA literature (e.g. industry reports on time-to-remediate) to understand the actual distribution; question whether Cloudflare's customers are the ones being warned-off the two-hour target.
- uninformed (potentially)No engagement with formal-methods or non-LLM approaches to reachability analysis (the 'Trace' stage's job). Static analyzers, taint trackers, and symbolic execution engines have been doing reachability for decades; the post implicitly treats LLM tracer agents as a novel solution without engaging with what they replace.Project Glasswing: what Mythos showed us — read next: Compare against CodeQL, Semgrep, and formal taint-tracking literature; ask whether LLM tracer agents complement or substitute for these.
- incompleteNo eval methodology to verify that any recommended prompt actually works for the reader's own task. The single near-quantified claim ('nearly eliminated fabricated status reports') is unquantified, drawn from Anthropic's own testing, with no reproducible benchmark, dataset, baseline, or numbers — so a rigorous adopter cannot confirm which system-prompt blocks earn their place.Prompting Claude Fable 5 — read next: Pair with an evals discipline (e.g. extract-anthropic-harness-design-long-running-application-development, which uses graded evaluators); build an A/B eval harness that measures each system-prompt block's marginal effect before adopting it wholesale.
- incompleteThe document is undated. It is thoroughly version-specific (Fable 5 vs Opus 4.8, effort tiers, adaptive/summarized-only thinking, the `refusal` stop reason, safety-classifier domains) yet carries no published or last-updated date, so its claims will drift silently as the model and platform update.Prompting Claude Fable 5 — read next: Cross-check every version-specific claim against the platform changelog and the 'Introducing Claude Fable 5 and Mythos 5' page at time of use; re-verify before betting a migration on any stated default or limit.
- incompleteThe behavioral-improvement claims (bug-finding recall 'noticeably higher', vision accuracy 'substantially higher', single-pass implementations of multi-day systems, more dependable subagent dispatch) are all qualitative, with no benchmark numbers, task definitions, or independent verification.Prompting Claude Fable 5 — read next: Seek third-party or benchmark evidence for the specific claimed gains before relying on them; treat the improvement list as vendor signal, not measurement.
- incompleteNo guidance on interaction effects among the many recommended system-prompt blocks (brevity, anti-over-engineering, anti-overplanning, checkpoint, autonomy, readability, progress-audit, memory). The doc never says whether they conflict, how much instruction budget they consume together, or which takes precedence — awkward given its own advice to prefer brief high-level instructions over enumeration.Prompting Claude Fable 5 — read next: Consult context-engineering / progressive-disclosure material on instruction budgets; assemble and test the composed system prompt as a whole rather than validating each block in isolation.
- incompleteEnglish- and software-only. Every example prompt is English and targets agentic/coding/enterprise-document work; there is no guidance for non-English prompting or for non-software domains, even though the guide claims broad capability gains.Prompting Claude Fable 5 — read next: Look to practitioner reports on multilingual and domain-specific steering; do not assume the English software-agent prompts transfer unchanged.
- uninformedNo stated boundary for when 'steer with a brief instruction' stops working and explicit enumeration becomes necessary. The doc asserts brevity suffices, yet its own recommended blocks are long, multi-clause instructions — leaving the reader without a rule for where high-level steering degrades.Prompting Claude Fable 5 — read next: Use eval-driven tuning to find the point where high-level steering fails and enumeration is required for a given behavior and effort level.
- incompleteThis is an ephemeral changelog: the durable content is the workflow patterns, but the specifics (skill names, install commands, version numbers, which skills replace which) are a snapshot of a fast-moving single-author repo, and the actual reasoning and prompt text live in the GitHub repo, not the video. The author himself defers detail ('I will make an entire video about Wayfinder'). Watching the video without the repo leaves the patterns without their implementation.New Skills! v1.1 brings /wayfinder, /research, /implement, /to-spec, /to-tickets — read next: Read the actual skills repo and its v1.1 release notes, plus the promised standalone Wayfinder video, for the concrete prompt text; treat named skills as liable to be renamed or removed in the next release.
- incompleteThe headline '87% benchmark with 4B-active model' is the entire credibility hook and is completely unspecified in the body. No benchmark name (SWE-Bench? Aider polyglot? HumanEval? a custom suite?), no subset, no scoring methodology, no comparison baseline (what does a frontier model score on this same eval? what does the same 4B model score without SmallCode?), no link to results. For a rigorous adopter this is the single most disqualifying gap.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Check the GitHub repo itself for an evals/ or results/ directory; check the project's `/eval` command output; check whether any third party has reproduced. Compare against published SWE-Bench / Aider / HumanEval+ leaderboards for similar-sized models. Look for the actual model named in the example (gemma-4-e4b) and find its baseline scores.
- incompleteNo comparison to other small-model-aware agentic coding tools — Aider (with local models), Cline + Ollama, Continue, OpenHands with local backends, Roo. The only named comparator is OpenCode, which is set up as a strawman ('assumes frontier models').GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Read Aider's local-model documentation and benchmark notes (Paul Gauthier publishes Aider polyglot scores for many models). Compare with Cline's local-model guidance and OpenHands' SWE-Bench results with open models.
- incompleteOne-author ecosystem risk: SmallCode depends on BoneScript, MarrowScript, and budget-aware-mcp — all by the same GitHub user. If the author stops maintaining, four projects rot together. This single-maintainer concentration is not flagged anywhere.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Check commit history and contributor counts on all four repos; check npm download stats for smallcode and budget-aware-mcp; check whether MarrowScript / BoneScript have any external adopters.
- misinformedThe escalation target list cites 'Claude Sonnet 4.5 / 4.6, Haiku 4.5' and 'GPT-5.4 Mini / Nano' and 'DeepSeek V4 / V4 Pro / V4 Flash'. As of the document's apparent date, these specific named version numbers may be aspirational, outdated, or fabricated. The presence of confidently-named future/non-existent model versions weakens credibility on other un-checkable claims.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Cross-check the named model versions against vendor product pages; if they are not real, treat the rest of the README's confident numbers (87%, '8-15 → 1-2 tool calls', '1400+ lines from 50 lines') with proportional skepticism.
- illogicalThe marketing claim ('87% with 4B-active model') and the body text ('7B-20B local models') are inconsistent. The title advertises a 4B-active model; the body describes the project as targeting 7B-20B. If 4B-active means MoE active params with a larger total, both can be true — but the README never reconciles them, leaving the reader to guess.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Identify the actual model used to produce the headline number; if it is MoE (e.g. gemma-4-e4b with ~4B active), check whether 7B-20B framing in the body is meant as total-parameter range, active-parameter range, or both — the project's positioning depends on which.
- incompleteNo discussion of how the harness itself is engineered, tested, or evaluated. The Observability section mentions traces and `/eval` but provides no example evaluation results, no harness-coverage metrics, no failure-mode regression tests beyond 'trace-to-test'. The harness is presented as fait accompli, not as something the reader could audit.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Connect to Birgitta Böckeler's harness-engineering article (already in the user's library): her steering-loop concept asks how a team iterates the harness based on observed failures. Apply that lens here — what is SmallCode's own steering loop?
- incompleteThe cybernetic / control-theory framing latent in the design (variety reduction via BoneScript topologies, feedback via early-stop detection, model profiles as adaptive control) is never made explicit. Connecting this project to the broader harness-engineering conversation (Anthropic's effective harness paper, Böckeler's framework) would let it argue from theory rather than just engineering instinct.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Read SmallCode against Böckeler's 'Harness engineering for coding agent users' (in this batch) — map SmallCode's components to her feedforward/feedback and computational/inferential axes. Read against the Anthropic harness-design materials the user is also tracking.
- illogicalThe article asserts a trend toward needing less human review per model generation (line -> function -> architecture, possibly disappearing next year) while simultaneously asserting that the workflow's core safety property depends on a human who deeply understands the architecture catching bad decisions before they compound. If review granularity keeps moving upward to the point of disappearing, the same logic implies the human safety net the rest of the article depends on would disappear with it -- a tension the piece never surfaces or resolves.
- incompleteThe costs of the prescribed safety apparatus -- up to three reviewer models per change, an architect conversation that can run thirty minutes, and an explicit human approval gate -- are never weighed against the speed/defect-rate benefits the article narrates in detail. There is no accounting of total token spend, wall-clock time, or how the cost/benefit shifts for a less important change where the author says he uses fewer reviewers.
- incompleteNo diagnostic or decision procedure for scoring a task's position on the action-complexity/context-complexity axes. The framework is presented as the deciding factor but is never operationalized — no rubric, thresholds, or worked example for a borderline case — so two builders looking at the same task could reasonably disagree about where it falls.Stop Overengineering Your Agent Harness — read next: Read a treatment that operationalizes the framework with measurable proxies (e.g., tools invoked per successful run, tokens retained across turns) or validates it against outcome data.
- incompleteNo cost/economics treatment of over- vs. under-building a harness. The essay argues against overengineering but never quantifies what overengineering actually costs (latency, token spend, engineering hours, maintenance burden) against the cost of under-building and hitting a production failure, leaving 'add infrastructure only when a real failure demands it' as an unweighted heuristic.Stop Overengineering Your Agent Harness — read next: Pair with pieces that quantify harness cost/performance tradeoffs across designs to make the build/wait decision economically grounded.
- incompleteThe Maven Assistant case study — the essay's single detailed low-complexity example — describes an already-live consumer health product with meaningful compliance stakes (self-harm handoffs, withheld high-cost benefits questions). The essay never shows a genuinely minimal internal/low-stakes agent receiving the 'keep it small' advice, leaving open whether even Maven's 'moderate action complexity' harness (routing, bounded tools, guardrails, handoffs) is itself already more than many builders need.Stop Overengineering Your Agent Harness — read next: Read case studies of minimal single-tool, single-turn internal agents to test whether even Maven's harness is over-built for lower-stakes use cases.
- incompleteThe essay names but doesn't explain the skew whereby public harness-engineering discourse is dominated by coding/personal-agent problems even though support, sales, and enterprise agents are described as the majority of what builders actually build — leaving unaddressed whether this reflects genuine attention bias, differing incentives to publish, or something else.Stop Overengineering Your Agent Harness — read next: Read industry-adoption surveys on where AI agents are actually deployed (support/sales/enterprise vs. coding) to check whether the discourse mismatch tracks a real minority-attention bias.
- incompleteThe claim that OpenClaw's contributor 'Peter' submitted roughly 600 pull requests in a day because of the proof-required review culture is offered with no independent verification, no baseline for comparison, and no accounting for PR size or quality — the same self-reported-evidence problem the corpus has flagged in other vendor/practitioner production-metrics talks.Presentation: The Agent Harness: Control Planes, Invariants, and Approval Boundaries for Production AI Agents — read next: Read alongside extract-anthropic-details-how-it-contains-claude#g4, which raises an identical evidentiary-independence gap about self-reported production security metrics, to see whether unverified headline numbers are a systemic weakness across 'here is our production agent's numbers' talks.
- incompleteThe talk's central contract ('a model proposes, the harness commits') implicitly treats model and harness as cleanly separable layers, but does not address whether that separation survives once a model is post-trained against a specific harness's proposal and approval format — i.e., whether the model itself can come to implicitly rely on, or probe for, known enforcement gaps in a harness it was trained inside.Presentation: The Agent Harness: Control Planes, Invariants, and Approval Boundaries for Production AI Agents — read next: Read alongside extract-agent-harness-engineering#p5 and #p11 (model-harness co-training coupling, overfitting to specific tool implementations) to test whether 'model proposes, harness commits' remains a clean separation once the model has been trained inside a specific harness's proposal/approval loop.
- incompleteThe piece argues the subsidy era is ending but never addresses what happens to the vast user base that was acquired through subsidized pricing. Will usage-based billing cause churn, consolidation around cheaper models, or a bifurcation between power users and casual users? The demand-is-infinite claim and the end-of-subsidies claim are in tension — if prices rise substantially, demand may not be as infinite as claimed.The Week AI Grew Up — read next: Benedict Evans or Ben Thompson on AI pricing elasticity; economic analysis of SaaS-to-usage transitions in cloud computing history
- incompleteThe claim that knowledge workers will choose to become more technical (favoring Codex over Cowork) is asserted without evidence. Historical precedent suggests the opposite — most technology adoption succeeds by lowering the technical bar, not raising it.The Week AI Grew Up — read next: Clayton Christensen on 'good enough' technology; history of no-code/low-code adoption
- uninformedThe piece treats the AI industry's 'growing up' entirely from a US-centric perspective. No mention of Chinese AI labs, EU regulation, or non-Western demand patterns, despite framing AI as 'critical global economic infrastructure.'The Week AI Grew Up — read next: Matt Sheehan on China's AI ecosystem; EU AI Act implementation updates
- incompleteThe goblin incident is treated as a curiosity with alignment implications, but the piece doesn't explore the depth of those implications — what does it mean for safety training specifically when RL quirks cascade through model stacks?The Week AI Grew Up — read next: Anthropic's research on reward hacking; papers on RLHF failure modes and distributional shift
- uninformedThe document is an industry-wide, cross-client synthesis produced by a 22-person advisory board; it does not — and structurally cannot — speak to how any of these recommendations play out inside a specific team's existing culture, legacy codebase, or organizational politics. Every blip is stated as a general recommendation, not a contingent one.Technology Radar, Volume 34 — read next: Pair with team-level case studies or first-person practitioner accounts (e.g. this corpus's own harness-engineering and agent-config-decay extractions) to ground the Radar's generalizations in a specific team's experience.
- incompleteNo mechanism for the regime shift. The author asserts 'That's no longer true. We've entered a different regime' but never explains what technically flipped compounding error into compounding correctness — better base models? harness-level self-verification? evals in the loop? RL-from-verifiable-rewards? The rebirth's causal engine is a black box.Agentics / Tech Things: Tokenmaxxing is dead, long live tokenmaxxing — read next: Read on agent self-verification and eval-in-the-loop harness design, RLVR / verifier-based training, and what actually reduces error accumulation in long runs; distinguish model-capability gains from harness/scaffolding gains.
- incompleteThe model-harness co-training overfitting risk (apply_patch/Codex-5.3 example) is named and illustrated with one concrete case, but not quantified or generalized — no discussion of how widespread this overfitting is across harness-trained models, what it costs in vendor lock-in terms, or whether tool-specific fine-tuning measurably degrades a model's general capability outside that harness.The Anatomy of an Agent Harness — read next: Research on post-training specialization tradeoffs and whether tool-specific fine-tuning degrades general capability, as this corpus's own extract-agent-harness-engineering#g4 already flags as missing.
- incompleteThe article presents its full component list (filesystem, bash, sandbox, memory/search, context management, long-horizon patterns) as what agents need in general, without engaging when a task is simple enough that most of this machinery is unnecessary overhead — a tension with this corpus's own finding (extract-stop-overengineering-your-agent-harness) that harness complexity should be matched to a task's action-complexity/context-complexity profile, not applied uniformly.The Anatomy of an Agent Harness — read next: extract-stop-overengineering-your-agent-harness#p13 for the complexity-mapping counter-frame.
- incompleteThe four 'slow development' prescriptions are stated but not operationalized for the augmented case. How exactly do you 'slow development to encourage frequent person-to-person interaction' when the genie is so seductive? What are the equivalent of XP practices for the augmented era? Beck explicitly defers this ('not yet settled') but a reader looking for action is left with a principle, not a practice.Trust Factory — read next: Beck's own subsequent essays (the 'XPAI' thread he's hinting at); Birgitta Böckeler on harness engineering; Garg on reducing friction in AI development (both already in the user's extracted corpus); Bockeler/Anthropic harness writing.
- uninformedThe piece never engages security, compliance, or audit-trail requirements for the autonomous pipeline — who is accountable when the agent's autonomous fix-loop makes a change that passes all automated gates but is substantively wrong, and whether 'green and ready for review' review is itself adequate given how little a human reviewer may actually re-verify once a PR already shows all-green checks.Coding Agent Development Workflows — read next: extract-agentic-ai-and-code-reviews.json's risk-tiered, durable-audit-trail framing and extract-four-eyes-without-pull-requests.json's compliance-control framing both treat this as a central design question this workflow leaves open.
- incompleteFramework-neutrality is asserted in form (the patterns) but undermined in substance. The code uses google.adk; the only named runtime is Google Cloud Agent Runtime; the CTA is the Gemini Enterprise Agent Platform; A2A is Google-backed; the seven-day persistence number is a vendor capability claim. A reader trying to implement these patterns on LangGraph, the Anthropic SDK, OpenAI Assistants, Mastra, or a homegrown stack has to translate every prescription — and several (notably 'zero-compute pause' and 'sub-second cold start') are runtime-dependent guarantees, not just design choices.The Production Gap: 5 Patterns for Building Long-Running AI Agents — read next: Read 'Anthropic's three-agent harness' and 'Anthropic harness design for long-running application development' for how the same problem space looks from the SDK-and-harness perspective rather than the managed-runtime perspective; read 'Block Goose' and 'OpenClaw setup' for OSS-stack equivalents.
- incompleteThe harness's own contribution to viability is only lightly explored — the author names context overhead and tool-schema differences as factors, and reports avoiding Claude Code for context-budget reasons, but never tests how much a harness purpose-built for small models (context budgeting, tolerant tool-call parsing, schema simplification) could shift the overall 'not plug and play' verdict.Viability of local models for coding — read next: Harness-engineering approaches specifically designed for small/local models, e.g. a harness that narrows tool schemas and tolerates malformed calls.
- incompleteWritten in 2023 about line/function-level completion with the developer reviewing every individual suggestion, the piece has no occasion to address what happens once the same underlying companion idea scales to an agent that plans, edits across many files, and iterates through its own test/eval loop with far less per-suggestion human review — exactly the 'harness,' verification, and review-at-scale questions that dominate the corpus's later agentic-engineering material. The reassurance that 'the developer is always in control, reviewing each suggestion' does not obviously survive that scope change.How AI coding companions will change the way developers work — read next: extract-new-sdlc-with-vibe-coding.json and extract-whats-an-orchestrator-why-software-needs-one.json — later material addressing exactly the review-at-scale and harness-engineering questions this piece's scope doesn't yet raise.
- incompleteThe article asserts that the agent layer is where coding competition now happens, but doesn't decompose what makes one harness materially better than another (context management, tool-use design, model-harness coupling, evals, ecosystem). For someone evaluating Claude Code vs. Antigravity vs. Codex on engineering merits, this is the question that matters most.Why Google Isn't Chasing Claude Code — read next: Addy Osmani on Claude Code agent patterns; Alex Wang on Claude Code setup quality; Anthropic engineering blog on Claude Code internals; any direct head-to-head harness eval (e.g. SWE-bench Verified with different harnesses on the same base model).
- incompleteNo serious treatment of how enterprise adoption of coding agents (procurement, security review, on-prem options, audit logging) might break the consumer-distribution argument — enterprise developer tools are a distinct moat from consumer MAU.Why Google Isn't Chasing Claude Code — read next: Pragmatic Engineer on enterprise AI adoption; DORA 2025 AI findings; pieces on agent governance in regulated industries.
- incompleteThe 'distribution moat beats quality' implicit premise is not argued. History has counter-examples (Google+ failed despite distribution; iPhone won despite Microsoft's distribution). The conditions under which distribution wins vs. loses are not specified.Why Google Isn't Chasing Claude Code — read next: Ben Thompson / Stratechery on aggregation theory and distribution limits; case studies of distribution failures (Bing vs. Google, Google+ vs. Facebook).
- incompleteThe article treats 'recursive self-improvement' as a coherent strategic bet without examining whether Anthropic's use of Claude to accelerate pretraining research is qualitatively different from what every lab is doing internally (Google uses Gemini, OpenAI uses GPT). The Karpathy-framed bet may be more rhetorical than substantive.Why Google Isn't Chasing Claude Code — read next: Anthropic's published work on using Claude in research; comparable disclosures from OpenAI/Google DeepMind on internal model use; Gary Marcus or other skeptics on recursive self-improvement claims.
- incompleteNo analysis of the cost-economics shift the article gestures at. If token cost is becoming the dominant axis, what does the economic landscape look like — TPU/GPU constraints, inference architecture (Baseten-style serving), open-weights pressure (DeepSeek)? Treating cost as 'the dominant concern' without unpacking it leaves the central economic claim under-evidenced.Why Google Isn't Chasing Claude Code — read next: Baseten/Together inference economics; Aaron Levie on enterprise token costs; DeepSeek pricing analysis; Simon Willison on per-token economics across labs.
- incompleteDemis's 'different game' is asserted but not connected to any actionable framework for evaluating Google. If world-models / AGI is the real bet, what would success look like in 18 months? Without success criteria, the 'different game' framing is unfalsifiable and conveniently insulates Google from any near-term scoreboard.Why Google Isn't Chasing Claude Code — read next: DeepMind publications on world models (Genie series); critical takes on AGI timelines (Marcus, Mitchell); comparisons of Anthropic's safety/RSP framework vs. DeepMind's published commitments.
- misinformedThe article calls coining 'vibe coding' Karpathy's most prominent public contribution. This understates his substantive influence (nanoGPT, neural network educational content, Tesla autopilot architecture). Suggests the author is writing for an audience that knows the meme but not the work — and may carry that same shallowness into other technical claims.Why Google Isn't Chasing Claude Code — read next: Karpathy's own writing (Software 2.0 essay, nanoGPT, his lecture series). Useful to calibrate when this newsletter's technical depth is reliable.
- uninformedNo examination of where Google's coding-agent investment is actually flowing inside the company (Jules, Gemini Code Assist, Antigravity, Android CLI all coexist). Sprawl could be a sign of internal competition rather than absence of priority — the article treats sprawl as monocausal incoherence.Why Google Isn't Chasing Claude Code — read next: Internal Google AI org coverage (The Information, Business Insider); the Sergey 'strike team' reporting referenced; Gemini Code Assist roadmap.
- incompleteThe Grok-vs-OpenAI-vs-Claude-vs-Vercel comparison is asserted but not analyzed structurally. The article uses workflow/agent/developer-extension as distinguishing terms without defining them. The user's recent extractions (Anthropic dev newsletter, Console.dev, Genkit) provide the comparative scaffolding the article lacks.xAI Releases Grok Skills and Updates Tool Calling Responses API — read next: Direct syntopical reading: extract-anthropic-developer-newsletter-2026-05.json + extract-google-genkit-middleware.json + extract-console-dev-best-tools-and-betas.json + this piece. Central question: 'What is a Skill?' across vendors.