Context Rot & Context Limits
The degradation of model performance as the context window fills, and the countermeasures — resets, handoff artifacts, compaction — used to manage it.
Also known as: context rot, context bloat, context pollution, context anxiety, smart zone / dumb zone, context load / context re-reading, context reset, compaction, /compact, Memento agent (LLM as the guy from Memento), contextual inertia (users')
Part of: Context Engineering
How authors use it
Oldest first (extraction date when no publication date is known).
| Author | Their term | Their meaning |
|---|---|---|
| Eight years of wanting, three months of building with AI Lalit Maganti · 2025-03-01 | context pollution | The problem that design decisions from one part of a codebase implicitly constrain other parts, and determining relevance requires exactly the institutional knowledge you are trying to externalize. |
| The productivity paradox of AI coding assistants Lisa Dziuba · 2025-09-12 | context rot | The degradation of AI output quality as more context accumulates within a session, because the model starts pulling in irrelevant details from earlier prompts. |
| No Vibes Allowed: Solving Hard Problems in Complex Codebases – Dex Horthy, HumanLayer AI Engineer · 2025-12-02 | smart zone / dumb zone | Borrowed from Jeff Huntley's research: the smart zone is the portion of a context window (roughly up to ~40%, task- and model-dependent) within which the model still reasons and tool-calls well; beyond it, output quality degrades sharply (the dumb zone), and raw context-window size increases ('1M tokens!') do not fix this because they just add more dumb zone. |
| Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work Brandon Lepine; Juho Kim; Pamela Mishkin; Matthew Beane · 2026-03-10 | Contextual inertia (users') | User-side counterpart to LLMs getting lost in multi-turn. 'A growing reluctance to reset a conversation because accumulated context carries both informational value and coordination costs.' Preserving context avoids restating objectives but increases the likelihood that responses reflect organizational patterns that increase extraneous load over time. |
| Harness design for long-running application development anthropic.com · 2026-03-24 | Context anxiety | A model behavior in which the agent prematurely wraps up work as it approaches what it believes is its context window limit. Distinct from actual coherence loss; it is the model's anticipatory truncation of effort. Author claims Sonnet 4.5 exhibits this strongly; Opus 4.6 largely eliminated it. |
| Harness design for long-running application development anthropic.com · 2026-03-24 | Context reset | Clearing the context window entirely and starting a fresh agent, combined with a structured handoff artifact that carries the previous agent's state and next steps. Contrasted with compaction. |
| Harness design for long-running application development anthropic.com · 2026-03-24 | Compaction | Summarizing earlier parts of a conversation in place so the same agent can keep going on a shortened history. Preserves continuity but does not eliminate context anxiety because the agent is still 'the same agent.' |
| Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development Leela Kumili · 2026-04-06 | context reset | Deliberately clearing the agent's context at a defined boundary and handing over a structured artifact (state summary, progress record) so the next agent starts fresh from a known state — as opposed to compaction, which attempts to preserve continuity |
| Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development Leela Kumili · 2026-04-06 | compaction | A technique for preserving context by summarizing or compressing prior conversation, allowing the model to appear to have longer memory — contrasted with context resets because it causes models to grow cautious as limits approach |
| AAIF's MCP Dev Summit: Gateways, gRPC, and Observability Signal Protocol Hardening Andrew Hoblitzell · 2026-04-09 | context bloat | The problem of MCP tool definitions consuming too large a share of the model's context window, degrading performance; solved client-side via progressive tool discovery |
| I stopped hitting Claude's usage limits - 10 things I changed kaize · 2026-04-10 | context load / context re-reading | The process by which Claude re-processes the entire conversation history with each new turn, multiplying token cost. |
| Charlie Hills 🦩's Post Charlie Hills 🦩 · 2026-04-16 | /compact | A Claude Code command that summarizes and compresses the conversation context to free up token budget |
| Agent Harness Engineering Addy Osmani · 2026-04-20 | context rot | The degradation of model reasoning and task-completion quality as the context window fills up |
| Accelerating Delivery: How AI Agents Can Own the Initial Code Draft Stephen Walker · 2026-04-20 | Context rot | Degradation of AI performance as the context window fills with large text blocks and growing activity logs, causing the model to lose focus |
| [FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero AI Engineer (channel); speaker: Matt Pocock (AI Hero) · 2026-04-24 | smart zone / dumb zone | The smart zone is the portion of an LLM's context window (Pocock pins it at roughly 100k tokens regardless of advertised window size) in which attention relationships are not yet strained and the model makes good decisions; the dumb zone is everything beyond, where token-to-token attention scales quadratically and quality collapses. Originally from Dex Horthy (Human Layer). |
| [FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero AI Engineer (channel); speaker: Matt Pocock (AI Hero) · 2026-04-24 | Memento agent (LLM as the guy from Memento) | An LLM session always resets to its system prompt; the developer should embrace and exploit this — clear context rather than compact — so every session starts in a known, optimal state. Pocock prefers clearing to compacting. |
| Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 | Context anxiety (implicit) | Not used verbatim. Bourzikas describes the analogous phenomenon: as a single-agent session approaches its context-window limit, compaction kicks in 'potentially discarding earlier findings that would have mattered.' The harness exists in part to avoid this. |
| 11 Tips For AI Coding With Ralph Wiggum Matt Pocock · 2026-07-11 | context rot | The degradation of LLM output as the context window fills — 'the longer you go, the stupider the output' — cited as the agent-specific reason (beyond ordinary feedback tightness) to keep loop tasks small. |
| What is “loop engineering?” The Pragmatic Engineer · 2026-07-14 | context rot | The degradation of an agent's effective performance as a single, long-running context window accumulates history, used here as the reason to restart agents with a fresh context each loop iteration rather than keep one continuous conversation going. |
| Presentation: Autonomous Data Products for the Autonomous Era: Rethinking Data Architecture for GenAI Jörg Schad · 2026-07-24 | context rot | The degradation of an LLM/agent's performance as more — and increasingly unspecific — context or data is exposed to it; there is a 'sweet spot' of just-enough, task-specific information, and exceeding it causes hallucination from an inability to choose what's relevant. |
| LIVE: Uncle Bob on Software Fundamentals in the Age of AI Matt Pocock (host) with Robert C. Martin ('Uncle Bob') · 2026-08-19 | smart zone / dumb zone | Pocock's citation of Dex Horthy's term for the portion of a context window (roughly the first ~40%, per the corpus's Horthy extraction) within which model output quality holds, versus the degraded region beyond it — used here to explain why short, front-loaded prompts beat long prose rulebooks. |
Documents (30)
- Advanced Context Engineering for Coding Agents (ace-fca.md) Dex Horthy (HumanLayer) · 2026-10-08 source ↗ Reader 🖥️
Solving hard problems in brownfield codebases requires designing your entire workflow — not just individual prompts — around keeping the context window in a 40-60% utilization sweet spot via a research/plan/implement cycle of frequent, intentional compaction, with human review concentrated at the research and plan layers because errors there compound into far more downstream bad code than a single bad line; and the open problem now is scaling this disciplined, human-engaged practice collaboratively across whole teams, not just a single highly motivated practitioner. - LIVE: Uncle Bob on Software Fundamentals in the Age of AI Matt Pocock (host) with Robert C. Martin ('Uncle Bob') · 2026-08-19 source ↗ Reader 🖥️
Software fundamentals (clean, well-partitioned, deeply-structured, well-tested code) matter just as much in the agentic era as before — not despite AI's speed but because of it — because agents hit the same complexity wall humans always have, just at a different threshold; the right response is not to impose human disciplines (like strict line-by-line TDD or heavyweight upfront specs) on agents, but to encode human values as deterministic, automated gauntlets (crap scores, mutation testing, dependency rules) that agents must pass through, while reserving strategic judgment — architecture, module boundaries, what's worth building — for humans who must now learn that judgment by experiencing the agents' own tactical gauntlet. - Yonathan Cohen's Post Yonathan Cohen · 2026-07-31 Reader 🖥️
A structured 'handoff' file — capturing every decision made, the verbatim work-in-progress, rejected alternatives, the user's style rules, and a single next instruction — lets work continue coherently across a session cutoff or even a different AI model, because it transfers state that a fresh conversation cannot otherwise recover. - What Is a Token? A Developer's Guide to Every Type Janet Wagner · 2026-07-30 source ↗ Reader 🖥️
The word 'token' names unrelated technical artifacts across four domains -- identity/authorization state, numerical text representation for LLMs, blockchain asset ownership, and single-purpose application security -- so developers must learn each domain's specific token vocabulary and the engineering tradeoff each token type encodes (statelessness vs. revocability, cost vs. capability, security scope) rather than treating 'token' as one concept. - What the Hell Is a Loop, Anyway? Laurie Voss · 2026-07-29 source ↗ Reader 🖥️
The word 'loop' in mid-2026 AI-engineering hype names at least four architecturally distinct systems — execution, task, product, and system loops, each defined by what it iterates on and what ends it — plus an unnamed fifth ring above them, the oversight loop, where a human sets goals, allocates budget, and culls work; so the real engineering question isn't whether to build loops or which camp in the autonomy debate is right, but what information is needed to set the autonomy dial correctly at each of those five levels. - The Orchestrator's Tax Rahul Garg (martinfowler.com; edited/guided by Martin Fowler) · 2026-07-28 source ↗ Reader 🖥️
The real value of a subagent is not the wall-clock time it saves through parallel execution but what it keeps out of the orchestrator's context, so multi-agent workflows should be designed and governed around protecting the orchestrator's limited working memory — via task splits that respect 'cognitive locality' and via minimal, fact-justified standing rules — rather than around maximizing delegation, agent count, or governance. - Presentation: Autonomous Data Products for the Autonomous Era: Rethinking Data Architecture for GenAI Jörg Schad · 2026-07-24 source ↗ Reader 🖥️
To make enterprise data safely and scalably consumable by autonomous AI agents, organizations must re-architect their data as domain-owned, containerized "autonomous data products" — self-contained units with a standardized lifecycle, multi-modal output ports, and centrally-enforced but independently-authored policies — rather than continuing to bolt point solutions onto today's fragmented, storage-centric "data hairball." - What is “loop engineering?” The Pragmatic Engineer · 2026-07-14 Reader 🖥️
“Loop engineering” — designing the orchestration around an AI coding agent (goals, completion checks, state persistence, fresh-context iteration) rather than hand-writing one-off prompts — is a real practice that originated as a DIY workaround (the “Ralph loop”) for small context windows, but by mid-2026 major harnesses had absorbed most of it into a native /goal primitive, so for most developers besides those building AI infrastructure, it is a largely-already-commoditized skill rather than a durable new discipline. - 11 Tips For AI Coding With Ralph Wiggum Matt Pocock · 2026-07-11 source ↗ Reader 🖥️
Autonomous agent loops ("Ralph") become reliably productive only when the human stops writing code and instead wraps the loop in disciplined scaffolding — an explicit end-state/stop-condition, an externalized progress file, commit-blocking feedback loops, small steps, risk-first sequencing, stated quality expectations and a sandbox — scaffolding that compensates for the agent's lack of judgment and cross-session memory and that, unguardrailed, would let the loop accelerate software entropy. - The Anatomy of an Agent Harness Akshay · 2026-07-08 Reader 🖥️
An agent harness is not monolithic prompt-glue but a decomposable system of roughly twelve components (orchestration loop, tools, memory, context management, prompt construction, output parsing, state, error handling, guardrails, verification, subagents) plus seven design-decision axes, and naming the parts is what lets you reason about, debug, and — because the parts are treated as separable and independently improvable — evolve agent behavior; yet as delivered the list reads as a convergent practitioner checklist organized by mechanism and vendor vocabulary rather than an orthogonal, coupling-minimizing decomposition with defined interfaces. - Experiences with local models for coding Birgitta Böckeler · 2026-07-08 source ↗ Reader 🖥️
Running small, locally-hosted open models for agentic coding is not yet a plug-and-play substitute for frontier models — it remains frustrating and far below frontier capability, and is viable today only for a narrow class of small, well-scoped, often pre-planned tasks, with the choice of task (more than the model or harness) being the dominant factor that determines whether it works. - New Skills! v1.1 brings /wayfinder, /research, /implement, /to-spec, /to-tickets Matt Pocock · 2026-07-08 source ↗ Reader 🖥️
Agent-assisted software work is best handled not as ad-hoc prompting but as an explicit, skill-mediated development lifecycle — interactively grill the human into a spec, split the spec into tickets each scoped to a single agent session, implement, then code-review for refactoring smells — fronted by a dedicated planning phase (Wayfinder) that externalizes large, foggy plans onto the shared issue tracker so they survive beyond any one context window, with research, prototyping and TDD as first-class supporting stages. - Viability of local models for coding Martin Fowler (martin@martinfowler.com) — memo by Birgitta Böckeler · 2026-07-07 source ↗ Reader 🖥️
The practical viability of local models for agentic coding is not a property of the model alone but an emergent, hard-to-predict outcome of interacting hardware (RAM, processing power, memory bandwidth), model (parameters, architecture, quantization, reasoning) and harness (context overhead, tool-calling schema) factors — which is why local coding assistants are still not a reliable 'plug and play' option for developers, even though specific configurations already deliver acceptable results for narrow tasks. - Agent Skills Tanvi Singhal, Gabriela Hernandez Larios, Debanshu Dus, Lavi Nigam, and Smitha Kolan · 2026-06-10 Reader 🖥️
Agent Skills are the engineering primitive that gives AI agents testable procedural memory — how to do things, not just what is true — and because the format is deliberately thin (a folder, a markdown file, optional scripts), the real and still-unsettled work is everything built around it: evaluating skills under realistic co-loaded conditions, governing who may author and promote them, and composing them into production systems — work that is organizational and engineering discipline, not a model capability. - A harness for every task: dynamic workflows in Claude Code Thariq Shihipar and Sid Bidasaria (Anthropic, Claude Code team) · 2026-06-02 source ↗ Reader 🖥️
Because a single, continuously-running context window degrades on long, parallel, structured, or adversarial tasks through three specific failure modes — agentic laziness, self-preferential bias, and goal drift — Claude Code should let the model write and orchestrate a custom, task-specific multi-agent harness (a dynamic workflow) on the fly, rather than relying on one generic static harness for every task. - Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 source ↗ Reader 🖥️
Frontier security-focused LLMs (exemplified by Mythos Preview) have made a real qualitative jump in exploit-chain construction and proof generation, but their value at production scale is unlocked not by faster patching or smarter single-agent use, but by wrapping them in a multi-stage harness of narrow, parallel, adversarially-validated agents and by hardening the architecture around vulnerabilities so that the gap between disclosure and patch matters less. - [FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero AI Engineer (channel); speaker: Matt Pocock (AI Hero) · 2026-04-24 source ↗ Reader 🖥️
AI is not a new paradigm for software engineering — the fundamentals that make working with humans effective (small tasks, vertical slices, deep modules, fast feedback loops, alignment through dialogue, TDD) are exactly what make working with AI agents effective; the path from idea to shipped feature is therefore a deliberately planned, human-driven pipeline (align → PRD → vertical-slice Kanban → AFK implementation → QA) in which the codebase itself is treated as the battleground, not the spec. - Agent Harness Engineering Addy Osmani · 2026-04-20 source ↗ Reader 🖥️
The performance gap between what current AI models can do and what users actually experience is primarily a harness-engineering gap — the scaffolding of prompts, tools, hooks, context management, and feedback loops wrapped around the model — and closing it requires treating that scaffolding as a continuously evolving engineering artifact shaped by observed failures. - Accelerating Delivery: How AI Agents Can Own the Initial Code Draft Stephen Walker · 2026-04-20 source ↗ Reader 🖥️
Autonomous AI agent workflows can reliably automate the journey from a Jira ticket to a first pull request if teams wrap inherently probabilistic LLMs in deterministic guardrails (branch scoping, hooks, orchestration) and multi-stage adversarial review loops that enforce architectural standards before human eyes ever see the code. - Charlie Hills 🦩's Post Charlie Hills 🦩 · 2026-04-16 source ↗ Reader 🖥️
Effective use of Claude Code requires deliberate setup, disciplined workflow habits, context management, precise prompting, and exploitation of power features — and learning these on day one would save weeks of friction. - I stopped hitting Claude's usage limits - 10 things I changed kaize · 2026-04-10 Reader 🖥️
You can avoid hitting Claude's usage limits by understanding that Claude counts tokens (not messages) and adopting ten habits that minimize unnecessary token consumption: editing instead of following up, starting fresh chats, batching questions, caching files in Projects, saving preferences to Memory, disabling unused features, choosing cheaper models for simple tasks, spreading work across the day, avoiding peak hours, and enabling overage billing. - AAIF's MCP Dev Summit: Gateways, gRPC, and Observability Signal Protocol Hardening Andrew Hoblitzell · 2026-04-09 source ↗ Reader 🖥️
MCP has crossed from experimental protocol to production enterprise infrastructure in 2026, and the central engineering challenges have shifted from basic connectivity to gateway-mediated governance, stateless transport at hyperscaler scale, security hardening, and managing the complexity of agentic systems in regulated environments. - Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development Leela Kumili · 2026-04-06 source ↗ Reader 🖥️
Splitting long-running AI development tasks among three specialized agents — planner, generator, and evaluator — with structured handoff artifacts solves the two core failure modes of autonomous coding sessions (context loss and self-evaluation bias), producing higher-quality and more consistent outputs. - Harness design for long-running application development anthropic.com · 2026-03-24 Reader 🖥️
Harness design for long-running autonomous coding should be approached as a moving target: build a multi-agent architecture (planner, generator, evaluator) that compensates for the current model's specific weaknesses on long-horizon, subjective-judgment tasks, then aggressively strip components as model capability advances — because every harness component encodes an assumption about what the model can't do alone, and those assumptions go stale. - Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work Brandon Lepine; Juho Kim; Pamela Mishkin; Matthew Beane · 2026-03-10 Reader 🖥️
Across 34 finance professionals performing a complex 10-hour valuation task with GPT-4o, AI-generated content usage is positively associated with quality but is dominated by an independent, additive, and roughly three-times-larger negative association with extraneous cognitive load; extraneous load is not a static property of any single response but a path-dependent, within-speaker-persistent feature of the interaction jointly constructed by user and model — and the design response is 'precision proactivity', i.e. dialogue systems that detect entrenched high-load trajectories, constrain system-initiated scope expansion (especially unsolicited task switching), and structure disclosure so users can regulate intake without absorbing imposed reorganization costs. - The Anatomy of an Agent Harness Vivek Trivedy · 2026-03-10 source ↗ Reader 🖥️
A harness is everything that is not the model — system prompts, tools, filesystem, sandboxes, memory, context-management strategies, and long-horizon execution patterns — and each harness primitive exists to compensate for a specific thing today's models cannot do out of the box; as models absorb more of these capabilities natively through model-harness co-training, harness engineering won't disappear but will shift from patching deficiencies to engineering systems that make any model's intelligence more effective. - Stop Using /init for AGENTS.md Addy Osmani · 2026-02-23 source ↗ Reader 🖥️
AGENTS.md should hold only project-specific facts an agent cannot discover by reading the code itself — because auto-generated, comprehensiveness-optimized context files duplicate what agents already find on their own and measurably slow and bias them — and the file should function as a living log of unfixed codebase friction to be resolved in the code, not as a permanent, ever-growing configuration. - No Vibes Allowed: Solving Hard Problems in Complex Codebases – Dex Horthy, HumanLayer AI Engineer · 2025-12-02 source ↗ Reader 🖥️
Solving hard problems in large, brownfield codebases with coding agents requires treating the context window itself as the scarce, team-visible resource to be engineered — through a research/plan/implement workflow with deliberate, frequent compaction — rather than either unreviewed 'vibes' or an over-literal, semantically diffused 'spec-driven development'; and the harder, still-unsolved problem is adapting team workflow, review practice, and culture to a world where most shipped code is AI-authored, not improving the agent tooling itself. - The productivity paradox of AI coding assistants Lisa Dziuba · 2025-09-12 source ↗ Reader 🖥️
AI coding assistants create a productivity placebo — they feel fast because of instant dopamine-reward feedback — but measured across independent studies they deliver marginal or negative net productivity for experienced developers on real codebases, degrade code quality and security, and the widely repeated '10x productivity' claim does not survive controlled measurement. - Eight years of wanting, three months of building with AI Lalit Maganti · 2025-03-01 source ↗ Reader 🖥️
AI coding agents are a genuine force multiplier for implementation and last-mile polish, and can unlock projects that would otherwise die from the intersection of difficulty and tedium, but they are a dangerous substitute for design, architecture, and taste -- the developer must retain ownership of the soul of the software or risk building a codebase they cannot reason about.
Propositions touching this concept (22)
By publication month, oldest first (extraction month when no publication date is known).
2025-09
- explicitOutput quality degrades within a session as context accumulates ('context rot'), because the model pulls in irrelevant details from earlier prompts, producing bloated or off-target code that looks correct but doesn't solve the actual problem.
2025-12
- explicitcorroboratedThere is a 'smart zone' of roughly the first ~40% of a context window (model- and task-dependent) within which output quality holds, and a 'dumb zone' beyond it where quality degrades sharply; staying in the smart zone — via compaction, sub-agent isolation, or restarting — is the central practical lever for getting usable results on hard tasks.
2026-03
- explicitestablishedLong-running coding agents predictably fail in two specific ways: context-window coherence loss (including context anxiety, where the model prematurely wraps up) and self-evaluation leniency (where the model praises its own mediocre work).
- explicitestablishedContext resets — clearing the window entirely and starting a fresh agent with a structured handoff — address context anxiety in a way that compaction does not, because a fresh agent has no awareness of approaching limits.
- explicitThree distinct context-management techniques — compaction (summarize/offload when context nears full), tool-call offloading (keep only head/tail tokens of large tool outputs), and skills (progressive disclosure, loading only front-matter until needed) — exist because today's harnesses are, in large part, delivery mechanisms for good context engineering against context rot.
2026-04
- explicitcorroboratedSpawning specialized sub-agents for focused tasks (rather than running one long conversation) solves context rot and keeps each agent effective within its context window
- explicitdevelopedStructured handoff artifacts allow coherent continuation after context resets without the caution-inducing effects of compaction
- explicit⚡ disputed & corroboratedContext bloat from tool definitions is a client-side engineering problem, not a protocol deficiency, and is already being solved with 85%+ token savings.
2026-05
- explicitA single coding-agent session against a 100,000-line repository can usefully cover at most about a tenth of a percent of the surface before context compaction discards earlier findings.
2026-06
- explicitLong-running, massively parallel, highly structured, or adversarial tasks executed inside a single context window break down through three specific failure modes: agentic laziness, self-preferential bias, and goal drift (worsened by lossy compaction across many turns).
- explicitA reverse-engineering of Claude Code's codebase found that 98.4% of it is operational infrastructure (permission classifiers, context compaction, subagent delegation, session storage) and only 1.6% is the agent reasoning loop itself — as foundation models converge on baseline reasoning, the deterministic engineering around the model, not the model, becomes the differentiator for reliability.
- explicitContext Rot and 'Lost in the Middle' research (across 18 frontier models) shows every model's performance degrades as input grows — even holding task difficulty constant — so a model's raw context-window capacity is the wrong metric for how much can safely be loaded; active context must be treated as a deliberately allocated budget, the way infra teams treat memory.
2026-07
- explicitThe rate at which you can get feedback is the speed limit ('never outrun your headlights'), so loop tasks should be small: smaller steps give tighter feedback and, for agents specifically, accumulate less context and therefore suffer less context rot (LLMs get worse as the window fills) — the price is slower progress, which the article resolves in favour of quality, especially when AFK.
- explicitestablishedContext management is where agents fail silently: context rot degrades performance 30%+ when key content sits in mid-window positions (Chroma; Stanford 'Lost in the Middle'), even in million-token windows; the fix is not a bigger window but keeping the smallest set of high-signal tokens via compaction, observation masking, just-in-time retrieval, and subagent delegation.
- explicitAdding more, unspecific context or data to an LLM lowers its performance past a threshold ('context rot'); the design goal should be exposing the minimum information sufficient for a task, not the maximum available.
- explicitA token bill is paid once, but context pollution is paid on every subsequent turn, because polluted content stays in the orchestrator's context and is carried forward whether or not it remains useful.
- explicitAvoid surfacing explicit context-budget or remaining-token counts to the model; if the harness must show them, add reassurance ('you have ample context remaining') — this prevents Fable 5 from prematurely suggesting a new session, summarizing, or trimming its own work (context anxiety).
- explicitdevelopedThe task loop (Geoffrey Huntley's 'Ralph loop') restarts a coding agent against the same spec with a completely fresh context window every iteration, and the apparent waste of refeeding the full spec each time is deliberate — it prevents the context rot and compaction events that degrade long-running sessions.
2026-08
- explicitA June 2026 study of 100 popular repositories found configuration smells were near-universal and often co-occurring: lint-related leakage in 62%, context bloat in 42%, and skill leakage in 35%.
2026-10
- explicitcorroboratedFrequent intentional compaction means designing the entire workflow — not individual prompts — around context management and keeping utilization in the 40-60% range throughout, escalating from occasional ad-hoc restarts to a continuous practice.
- explicitGeoff Huntley's 'Ralph Wiggum' technique (an agent run in an unattended while-loop against a fixed prompt file) is a contrasting, more autonomous approach to the same context-scarcity constraint that the author takes seriously rather than dismissing as a gimmick, even though frequent intentional compaction is a different, more human-engaged solution to the same '~170k effective context window' problem.
- explicitThe author explicitly names scaling frequent-intentional-compaction workflows collaboratively across large teams (not just for a single motivated practitioner) as the open problem the company is now building tools (CodeLayer) to solve, and is forward-deploying with 10-25 person engineering orgs specifically to help them make the required culture/process/tech shift.
Tensions
Can harness engineering actually solve the AI code quality problem?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Agent Harness Engineering (Osmani): Yes — harness engineering is the primary solution. A decent model with a great harness beats a great model with a bad harness.
- Harness engineering for coding agent users (Böckeler): Partially — harnesses can solve maintainability and architecture fitness, but the behavioral harness remains fundamentally unsolved.
- Genie Tarpit (Beck): Unknown — genies naturally produce degraded code and nobody knows how to fix this. Harnesses are listed as one possible remedy among several, without endorsement.
Assessment: This is the central divergence in the literature. Osmani is most optimistic, operating from benchmark evidence that harness changes produce dramatic improvements on coding tasks. Böckeler occupies the middle ground, distinguishing solvable from unsolved harness domains. Beck is most skeptical, questioning whether harnesses address the root cause at all. The disagreement is partly empirical (what do the benchmarks actually measure?) and partly about scope (Osmani focuses on task completion; Beck focuses on long-term code value including flexibility). They may not be contradicting each other so much as talking about different time horizons: harnesses help with immediate task success, but the tarpit emerges over accumulated changes.
What is the right metaphor for the human-AI relationship in coding?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Patterns for Reducing Friction in AI-Assisted Development (Garg): AI is a teammate — treat it like a junior pair programmer who needs onboarding, context, and rituals.
- Harness engineering for coding agent users (Böckeler): AI is a system to be governed — the cybernetic governor model with feedforward and feedback controls.
- Agent Harness Engineering (Osmani): AI is a runtime to be engineered — the harness is an engineering artifact, not a social relationship.
- Looking back at the Future of Software Engineering unconference (Thoughtworks): AI is a new organizational participant — Conway's Law applies, and agent topologies must be designed.
Assessment: These metaphors are not mutually exclusive but they lead to different design decisions. Garg's teammate metaphor emphasizes collaboration rituals and may underplay the need for hard constraints (you don't sandbox a teammate). Böckeler's governor metaphor is the most theoretically rigorous but may overclaim the applicability of control theory to creative work. Osmani's engineering metaphor is the most actionable but may miss the social and organizational dimensions. Thoughtworks' organizational metaphor captures the broadest scope but is the hardest to operationalize.
Will better models make current harness practices obsolete?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Agent Harness Engineering (Osmani): Harnesses don't shrink, they move — better models create new failure modes at higher capability levels.
- Genie Tarpit (Beck): The Bitter Lesson (scale + compute) is listed as one possible solution — implying better models might eventually solve the problem without harnesses.
- Patterns for Reducing Friction in AI-Assisted Development (Garg): Does not address model improvement — the framework lacks a theory of its own obsolescence.
Assessment: Osmani makes the strongest case for permanence with concrete evidence of scaffolding migration. Beck keeps the door open for the Bitter Lesson hypothesis. The truth likely depends on the type of harness: mechanical safeguards (sandboxes, permission controls) may always be needed, while knowledge-transfer patterns (AGENTS.md, priming docs) may become less necessary as models improve at in-context learning.
Context size: should you shrink the problem to fit a small usable window (decompose / reset), or grow and trust a large window?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- [FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero (AI Engineer (channel); speaker: Matt Pocock (AI Hero)): Shrink: keep every task inside the ~100k smart zone; clear rather than compact; a 1M window is 'more dumb zone', good for retrieval, not coding.
- Agent Harness Engineering (Addy Osmani): Shrink: fight context rot with compaction, offloading, and skills; do not let the window fill.
- Harness design for long-running application development (Anthropic Engineering (long-running harness design)): Shrink (on weaker models): context resets with a handoff artifact beat compaction, because a fresh agent has no anxiety about approaching limits.
- GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. (musistudio): Grow, but only as a per-task escalation: route requests past ~60k tokens to a dedicated long-context model rather than forcing one window to hold everything.
- Charlie Hills 🦩's Post (Charlie Hills 🦩): Manage in place: /compact and one-task-per-session when context degrades.
Assessment: The apparent 'grow / trust the big window' position for CODING largely dissolves once retrieval is separated from coding — which is exactly Pocock's move ('good for retrieval, less good for coding') and musistudio's (longContext is a routed escalation, not the coding default). No text argues you should code inside a full 1M window. The only genuine pressure toward trusting a bigger window is the vendor-forward Fable 5 / Opus 4.6 claim that coherence loss is being engineered away — but that is a moving target (convergence 5), not a stable dial, and even the harness paper only relaxed context resets AFTER measuring that the new model no longer needed them. A secondary, live sub-dispute survives: reset vs compact. Pocock, the harness paper and best-practices favor clearing/resetting to a fresh agent; Hills and Osmani lean on compaction. The reset camp has the better argument on today's models — compaction preserves the same anxious agent — but the disagreement is real and unresolved. Verdict: shrink-and-decompose is the default for coding; grow only as an explicit retrieval escalation; prefer reset over compact unless the model version has demonstrably killed context anxiety.
Who selects the model/effort/context — a human deciding per task, or an automatic router — and who is trusted to hold the dial?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- Charlie Hills 🦩's Post (Charlie Hills 🦩): Human selects: the developer manually assigns Opus to think and Sonnet to build.
- Claude Code: Best practices for agentic coding (Anthropic (Claude Code best practices guide)): Human selects: the user picks the thinking level (think/ultrathink) and configures the tools per task.
- The Pulse: a new trend, smart model routing (The Pragmatic Engineer (Gergely Orosz)): Auto-router selects — but beware who owns it: an intelligent router (or Cursor 'Auto') picks the cheapest capable model automatically.
- GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. (musistudio): Semi-automatic, user-owned rules: config-driven scenario routing plus custom-router JS and subagent pinning.
- [MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796 (stellaraccident (via https://github.com/anthropics/)): The dial must be transparent and user-controllable: the real harm was the PROVIDER silently rationing the effort dial.
Assessment: The human-vs-auto axis is less about capability than about (a) whether task difficulty can be detected a priori and (b) who bears the principal-agent risk. No router in the corpus actually measures difficulty — musistudio routes by token-count and static scenario, and the Pragmatic Engineer's routers infer 'good enough' without a demonstrated oracle — so 'auto' today means 'static-heuristic', not 'optimal'. Automation is safe when the user owns the policy (musistudio) and dangerous when the router profits from the choice (Cursor Auto) or when the provider adjusts the dial invisibly (stellaraccident). Verdict: keep the human holding the difficulty judgment and the effort dial until routers can both measure adequacy and prove neutral incentives; automate only the mechanical dispatch, over rules you own and can audit.
Open gaps (67)
- incompleteThe Terminal Bench 2.0 data point (Top 30 to Top 5 via harness change) is presented without detail on what specific harness changes drove the improvement, making it impossible to evaluate which components had the most leverage.Agent Harness Engineering — read next: Read Viv Trivedy's original 'Anatomy of an Agent Harness' post for the detailed breakdown.
- incompleteThe entire evidence base is a single unnamed client engagement. No quality metrics, error rates, time-to-merge data, or controlled comparison against non-agent workflows are provided. The '4x PRs opened' metric could reflect PR fragmentation rather than genuine productivity gains.Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Look for published case studies from Harness Engineering adopters (OpenAI Codex internal metrics, Stripe Minions data) that include quality and cost metrics alongside volume
- uninformedNo discussion of cost economics — token consumption for multi-agent adversarial review (planner + reviewer + coder + review agent + retrospective) could be substantial. Without cost data, the ROI claim is incomplete.Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Token economics analyses for multi-agent coding workflows; Anthropic and OpenAI pricing models for high-volume agent usage
- incompleteThe 'self-improvement loop' is described as agents saving learnings back to context files, but there is no discussion of knowledge curation — who reviews what the agents learn? Unbounded accumulation of agent-generated context could itself become a source of context rot.Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Knowledge management literature on automated knowledge bases; the 'wiki decay' problem applied to agent memory
- uninformedThe article does not address what kinds of tasks or codebases this approach works poorly for. There is no discussion of limitations by domain (e.g., security-critical code, novel algorithmic work, legacy systems with poor documentation).Accelerating Delivery: How AI Agents Can Own the Initial Code Draft — read next: Research on task complexity taxonomies for AI-assisted coding; empirical studies of where coding agents fail
- incompleteTeam adoption is treated as an exercise for the reader. Pocock's answer to 'how does this work in a team?' is essentially: 'the upstream becomes team-shared, the downstream is one or two devs managing the pipeline.' He gives no story for: review queue scaling, distribution of PRD-authoring authority, who owns skills/coding-standards as a shared asset, code-review burden as a team-wide labour question, or how juniors learn craft in a workflow where most code is agent-written.[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero — read next: Cutler on overload and accountability culture; Beck on socio-technical change; Fearless Change for the adoption-of-practices angle in the user's hidden-layer interests.
- incompleteThe 'pre-AI books' recommendation is the closing thesis but is left underspecified. Pocock cites Pragmatic Programmer (tracer bullets), Ousterhout's Philosophy of Software Design (deep modules), Brooks's Design of Design (design concept), Fowler's Refactoring (small steps) — but does not give a reading list, nor a mapping of which insight from which book deploys at which point in the workflow. This is the load-bearing connection to the user's craft tradition and is left as a 'go buy them on Amazon.'[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero — read next: The user's library already covers Beck (small steps, TCR, simple design), Hickey (Simple Made Easy), Yourdon & Constantine (Structured Design), Meadows (Thinking in Systems). The mapping work is for the orchestrator to do: e.g., Pocock's 'don't bite off more than you can chew' is Fowler-on-refactoring; deep modules is Ousterhout; tracer bullets is Hunt & Thomas; design concept is Brooks. The honest gap is that Pocock does not even mention Beck — surprising given Beck's TCR is operationally close to red-green-refactor as Pocock practices it.
- incompletePocock's workflow structurally mirrors Anthropic's harness paper (planner / generator / evaluator) and Böckeler's adaptive-control framing, but he does not name them or compare. The grill-me skill is alignment; the PRD-to-Kanban is planning; the AFK Ralph loop is generation; TDD + manual QA + reviewer-Opus is evaluation. Surfacing this overlap is essential to placing his workshop in the broader 2026 AI-coding discourse.[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero — read next: Anthropic harness paper, Böckeler on adaptive control, Addy Osmani on agent patterns (in the user's saves) — all map onto Pocock's lifecycle with different vocabulary.
- incompletePocock conflates two definitions of 'done': (a) feature shipped with QA-imposed taste, and (b) commit produced by the Ralph loop with passing tests. The transitions between (a) and (b) — especially the merge-and-conflict-resolution at the end of multiple parallel sandbox branches — are sketched (the Sandcastle merger agent) but not interrogated for what happens when the merger itself produces semantically broken code. This is exactly where small-PR discipline matters and where he admits he doesn't have the answer.[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero — read next: Beck on incremental design and TCR; trunk-based development literature; the smallcode failure-mode catalog if it covers merge-stage failures.
- incompleteThe implicit premise that the developer can read agent output well enough to QA, code-review, and impose taste is enormous. Pocock states 'understanding code deeply is going to make you a much, much better developer and get more out of AI' and 'bad codebases make bad agents' — but does not address the developer who is themselves junior, distracted, or not the original architect. The workflow may be most valuable to seniors and least usable by the engineers who most need leverage.[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero — read next: Marcus on code quality (in user's recent saves), Beck on apprenticeship/teaching contexts, Cutler on directly-responsible-individuals and skill distribution.
- uninformedPocock specifically defers the question on conforming to security, architectural, and API-contract constraints ('I'm going to answer that in a bit') and never returns to it. For the user's organizational context (Norwegian senior leader watching governance signals), this is the highest-value question and is left unaddressed.[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero — read next: Security-review skill, Schneier on Security, explainable-AI requirements paper in the user's library, organisational adoption studies on AI tooling in regulated industries.
- incompleteNo mechanism is given for *why* a model loses the ability to understand/maintain what it built — is it a context-window limit, a lack of persistent memory across sessions, an inability to re-derive prior design intent, or something else? Without naming the mechanism, 'iron grip on system size' is a size-based proxy for an underlying limit that isn't specified.All models, no matter how smart, will eventually build systems... — read next: Read against Anthropic's own Fable 5 prompting guidance (extract-how-to-actually-prompt-fable-5, extract-prompting-claude-fable-5) for its treatment of persistent memory and long-running-agent scaffolding, and against context-engineering material for named mechanisms (context window exhaustion, context rot) that would explain the 'outbuilt itself' failure concretely.
- incompleteThe decomposition is not orthogonal and specifies no module boundaries. Four of the named components — memory (3), context management (4), prompt construction (5), and state management (7) — are views of a single 'what the model sees / what persists' concern (Claude Code's git-commits-as-checkpoints sits under state, MEMORY.md under memory, compaction under context, prompt assembly under construction, but they are one persistence-and-window problem wearing four hats). Guardrails/permission (9) is not disjoint from tools (2) — the walkthrough runs the permission check INSIDE tool execution (step 4). Output parsing (6) is near-vestigial under native tool calling (a sub-step of the loop, not a peer module). And the orchestration loop (1) is a LEVEL above the contents it manages, not a coequal component ('the complexity lives in everything the loop manages'). The prose enumerates eleven items under a 'twelve components' heading. So the list reads as a practitioner checklist organized by mechanism and vendor vocabulary, not a coupling-minimizing partition into high-cohesion modules — it cannot tell you where to actually cut the system.The Anatomy of an Agent Harness — read next: Read Parnas ('On the Criteria To Be Used in Decomposing Systems into Modules'), Yourdon & Constantine on coupling/cohesion, and Ousterhout on deep modules; re-derive the harness as narrow-interface deep modules and test which of the eleven are genuinely separable versus one persistence/context responsibility split four ways — the structured-design question the piece's naming step presupposes but never answers.
- incompleteAnatomy without failure-mode interactions. The seven-step walkthrough gives happy-path dynamics only; the piece never addresses how components interfere when things go wrong — compaction (context management) discarding state the verifier still needed, a guardrail tripwire firing mid-tool-call and leaving state half-written, or a memory 'hint' that contradicts actual state after a context reset. The hardest engineering lives in these cross-component failure interactions, which the static list and the clean walkthrough elide.The Anatomy of an Agent Harness — read next: Read extract-anthropic-harness-design-long-running-application-development and extract-anthropics-three-agent-harness on context-reset handoff artifacts and evaluator calibration; look for how components must expose contracts to survive each other's failures rather than only cooperating on the happy path.
- incompleteNo interface or contract between components is specified. The piece names components but never states what each EXPOSES to the others — what memory hands to context management, what guarantees the loop makes to the tool layer, what verification consumes and returns. Without interface contracts, the 'independently improvable' premise (p13/p14) that the sibling's fitness-selection strategy depends on is unverified: 'add one mechanism' only stays local if the components are actually decoupled, which the piece asserts by layout rather than by design.The Anatomy of an Agent Harness — read next: Read on module interfaces/APIs (information hiding, contracts) and re-examine the sibling's automated 'add one mechanism, keep if better' loop to check whether a change to one component ripples across the coupled memory/context/state cluster.
- incompleteTwo overlapping taxonomies whose relationship is left unstated. The twelve components and the seven decisions substantially overlap: decisions 3/4/5/6 (context-window strategy, verification design, permission architecture, tool scoping) simply re-open components 4/10/9/2 as 'choices,' while only decisions 1/2/7 (single-vs-multi-agent, ReAct-vs-plan-execute, harness thickness) are architectural choices not already a component. The piece presents both frameworks without saying whether the seven decisions are just the tunable parameters of a subset of the twelve components.The Anatomy of an Agent Harness — read next: Consolidate into one model — components as nouns (what the harness contains) versus configuration axes as verbs (how each is set) — and test whether 'seven decisions' collapses into 'the tunable dials on four of the components,' leaving only single-vs-multi-agent, ReAct-vs-plan, and thickness as genuinely first-order architecture.
- incompleteNo engagement with cost ceilings or economic boundaries. $124-$200 per multi-hour autonomous run is presented as routine; there is no discussion of when this stops scaling (e.g. teams running this 100x/day, regulated environments with per-call cost controls, or comparison to a human contractor at equivalent output).Harness design for long-running application development — read next: Read pieces that treat agent-cost economics directly — Simon Willison's pricing analyses, the smallcode argument for smaller models, any IT-procurement perspective. Also: Anthropic's own enterprise pricing docs as the implicit deployment context.
- incompleteNo treatment of audit, observability, governance, or failure containment for long-running autonomous coding. The piece's implicit deployment is 'a single engineer running experiments at Anthropic Labs.' A Norwegian public-sector or regulated context would need: persistent audit trails of each agent's actions and tool calls, rollback semantics for partial builds, secret management when agents access live services, IP provenance of generated code, and human-checkpoint policies. File-based agent communication is actually well-suited to audit — but the author never makes that case.Harness design for long-running application development — read next: Read the EU AI Act's high-risk-system requirements, NIST AI RMF agent guidance if it exists yet, and any sober writing on agent observability stacks. Also: cross-reference Anthropic's enterprise-tier compliance docs.
- incompleteThe 'simplify when models improve' methodology assumes monotonic capability advance. It does not address the (empirically real) case where a new model has different — not strictly better — failure modes. E.g. Sonnet 4.5's context anxiety vs. Opus 4.6's regression on some niche tasks. The methodology is silent on what to do when component removal *reveals* a new weakness rather than confirming an old strength.Harness design for long-running application development — read next: Look for empirical model-version-comparison work — Aider/SWE-bench longitudinal results, internal Anthropic evals if available, and practitioner accounts of regressions (e.g. Simon Willison's lab notebooks).
- incompleteThe criteria-as-stylistic-steering observation ('museum quality' produces visual convergence) is surfaced and then dropped. It is treated as a quirky finding rather than a serious concern about AI-generated homogenization. At scale, if many teams use Anthropic-suggested criteria, the result is a deep convergence in the look of AI-generated software.Harness design for long-running application development — read next: Read on cultural homogenization risk in generative AI (Naomi Klein, Ted Chiang, and design-criticism writing). Also: the 'AI slop' discourse and any empirical work on generated-design diversity.
- incompleteThe 'long-running' threshold is operationalized only through examples (3.8 to 6 hours) — never defined. A reader cannot tell whether the prescriptions apply to a 30-minute task, a multi-day task, or only to the specific case study durations. Böckeler's harness theory and the smallcode piece operate at different time scales without acknowledgment.Harness design for long-running application development — read next: Cross-reference extract-bockeler-harness-engineering.json (theoretical-control framing — variety reduction, feedforward, feedback sensors) which is time-scale-agnostic; the smallcode piece's smaller-task framing; and reach for any time-scale-explicit treatment of agent autonomy windows.
- uninformedThe piece is silent on the existence of a broader harness-engineering theoretical literature (Böckeler's adaptive-control framing, the smallcode engineering-instinct view) — even though Anthropic Labs is presumably aware. As a result, named phenomena are coined fresh ('context anxiety') without acknowledging or engaging with adjacent theory. This is not necessarily a mistake — it may reflect the piece's narrow Labs-experiment scope — but it does mean the reader has to do the cross-mapping work themselves.Harness design for long-running application development — read next: Maintain the syntopical map (already in this repo as syntopical-harness-engineering-for-ai-coding-agents.json) and treat this article as one empirical data point, not a theoretical contribution.
- incompleteThe article doesn't address what happens when the evaluator agent is wrong. If the evaluator has calibration errors, the generator will iterate toward those errors. The regress (who evaluates the evaluator?) is assumed away.Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development — read next: Literature on specification gaming in RL; AI alignment work on reward hacking
- uninformedNo comparison to alternative approaches. The context-reset claim is made without benchmarks against compaction or other memory strategies. The practical superiority is asserted, not demonstrated.Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development — read next: Anthropic's research on long-context models; MemGPT and other memory architecture papers
- incompleteThe claim that lineage 'comes for free' once every data asset is a data product elides that lineage across data products built on heterogeneous underlying engines (Spark, Databricks SQL, an Iceberg lakehouse) still requires each engine's own job/run metadata to be captured and correctly correlated across products — the talk asserts this correlation is trivial rather than demonstrating it, and no failure case or edge case (e.g. a data product whose transform spans two engines) is discussed.Presentation: Autonomous Data Products for the Autonomous Era: Rethinking Data Architecture for GenAI — read next: Dedicated data-lineage literature (e.g. OpenLineage) for what cross-engine lineage correlation actually requires.
- incompleteAll evidence for the architecture is either analogy (Kubernetes/Docker/LLVM), an internally-consistent lifecycle description, or one small live demo of the speaker's own vendor product (Nextdata) — no production adoption numbers, latency/overhead measurements of the four-stage lifecycle versus a raw pipeline, or independent case studies are presented, and the speaker's commercial stake as the vendor's VP Engineering is never disclosed as a limitation on the evidence (though he does gesture that 'this is one implementation' of a supposedly vendor-neutral pattern).Presentation: Autonomous Data Products for the Autonomous Era: Rethinking Data Architecture for GenAI — read next: extract-mcp-api-sprawl for hard adoption/security statistics in the adjacent MCP-governance space, as a model of what evidence-backed claims in this domain look like.
- incompleteNo evidence or reasoning is provided for any of the 32 claims. Every tip is stated as flat assertion. There is no explanation of WHY each practice works, what failure mode it prevents, or how the author discovered it. This makes it impossible to evaluate which tips generalize vs. which are idiosyncratic to the author's workflow.Charlie Hills 🦩's Post — read next: Look for experience reports or controlled comparisons of Claude Code workflows (e.g., with vs. without CLAUDE.md, with vs. without branching per task).
- incompleteThe social media format (LinkedIn listicle) constrains depth. Tips like 'Set a scope limit to only the files you name' and 'Replan at halfway to reset the goal' are operationally vague — a reader new to Claude Code would not know how to implement them.Charlie Hills 🦩's Post — read next: The author's own linked guides (beginner-to-advanced, design-in-code) likely expand on these compressed tips.
- unsupported claimThe 50-70% budget savings from using Haiku is stated without evidence or calculation.I stopped hitting Claude's usage limits - 10 things I changed — read next: Look for Anthropic's published pricing ratios between Haiku, Sonnet, and Opus to verify.
- oversimplificationThe quadratic formula S*N(N+1)/2 assumes equal-length exchanges and ignores that Claude's responses vary greatly in length. It also conflates input tokens (which are re-read) with output tokens (which are not re-read).I stopped hitting Claude's usage limits - 10 things I changed — read next: Anthropic's documentation on how input vs output tokens are counted for rate limits.
- missing nuanceThe claim that Projects caching means files 'don't eat into your usage' is stated without caveats. Anthropic's actual caching behavior and whether cached tokens truly have zero rate-limit impact is not substantiated.I stopped hitting Claude's usage limits - 10 things I changed — read next: Anthropic's documentation on prompt caching and how cached tokens count toward limits.
- temporal sensitivitySeveral tips reference specific Anthropic platform features and policies (peak hours starting March 26, 2026; overage billing; model tiers) that may change. The advice is tightly coupled to the current product state.I stopped hitting Claude's usage limits - 10 things I changed — read next: Anthropic's changelog and pricing pages for current policies.
- missing considerationNo discussion of Claude Code, API usage, or non-web-UI contexts. All advice is implicitly scoped to the Claude web/desktop interface.I stopped hitting Claude's usage limits - 10 things I changed — read next: Separate guides for API and Claude Code token optimization.
- incompleteThe article does not explore what, specifically, would move developers from the '19% slower, more technical debt' regime it documents toward the real gains it concedes exist for junior/newer-hire populations — e.g. richer context engineering, codebase-specific guardrails, or test-based quality gates before merge — leaving its implicit practical conclusion ('don't expect big productivity gains') less actionable than it could be.The productivity paradox of AI coding assistants — read next: extract-faros-acceleration-whiplash#p9 (raise code quality at the point of AI authoring: richer context, codebase standards, guardrails, test-based quality gates).
- unstated assumptionThe author assumes that the inability to externalize institutional knowledge and design context is a fundamental limitation of AI, not merely a tooling limitation. This conflates current AI capabilities with inherent constraints. Future models with persistent memory, codebase-scale context, and temporal reasoning could potentially bridge this gap.Eight years of wanting, three months of building with AI — read next: Read work on long-context models, AI memory architectures, and research on whether design taste can be formalized or learned (e.g., Christopher Alexander's pattern language as a possible bridge).
- omissionThe article does not discuss the economics of AI-assisted development beyond the $200/month Claude Max subscription. The 250 hours of personal time invested is mentioned but not analyzed in terms of opportunity cost or compared to hiring/contracting alternatives.Eight years of wanting, three months of building with AI — read next: Compare with analyses of AI coding tool ROI; consider the total cost including cognitive overhead and the discarded vibe-coding month.
- unexamined tensionThe author claims 'AI didn't just make the same project faster -- it changed what the project was' (adding editor extensions, docs, WASM playground). But he also claims the core value comes from the parser architecture, which AI was harmful for. This raises the question: did AI expand the project's scope in the right direction, or did the cheap last-mile features dilute focus on the hard core?Eight years of wanting, three months of building with AI — read next: Consider the 80/20 principle in open source: does breadth of features or depth of core reliability drive adoption?
- implicit premiseThe expertise-x-verifiability framework assumes that 'taste' and design judgment are inherently human and non-formalizable. This is stated as obvious but is actually a deep philosophical claim about the nature of aesthetic and design knowledge. If taste could be partially formalized (as design systems and API design guidelines attempt), the framework's boundaries would shift.Eight years of wanting, three months of building with AI — read next: Joshua Bloch's 'How to Design a Good API and Why It Matters'; API design guideline literature; whether LLMs can learn design heuristics from large corpora of well-designed APIs.
- uninformedThe retail case study and the distributed-ownership argument assume each skill maps cleanly to one owning domain team, but does not address what happens when two teams' skills legitimately compete for the same trigger (overlapping description keywords) in a large, many-team organization — a scaling failure mode distinct from the four it names (trigger, execution, token budget, regression), closer to a governance/arbitration problem than a technical one.Agent Skills — read next: Read against software-architecture literature on team-boundary design (e.g. Conway's Law, bounded contexts) applied to skill ownership rather than service ownership.
- incompleteThe paper asserts skills are portable across vendors and runtimes (Claude Code, Codex CLI, Gemini CLI, Antigravity) via the shared agentskills.io format, but — beyond noting that install paths, activation rules, and tool-whitelisting details differ per tool — does not report any direct empirical comparison of the same SKILL.md executed across multiple harnesses to verify truly identical behavior, leaving the portability claim's practical reliability untested within the paper itself.Agent Skills — read next: Compare the same SKILL.md's measured trigger accuracy and execution fidelity across at least two different coding-agent harnesses.
- omissionThe article mentions gRPC in the title but never discusses it in the body. The Transport Working Group's SEP-1442 is about stateless HTTP, not gRPC. The title implies transport diversification that the content does not substantiate.AAIF's MCP Dev Summit: Gateways, gRPC, and Observability Signal Protocol Hardening — read next: Check whether gRPC transport was discussed in sessions not covered by the article; review the Transport Working Group charter.
- implicit_premiseThe article assumes that the Kubernetes analogy (interceptors as admission webhooks, gateways as ingress controllers) is the right mental model for MCP governance. This frames MCP as infrastructure middleware, which may not be the only valid framing -- it could also be framed as a capability/permission system, a marketplace, or a service mesh.AAIF's MCP Dev Summit: Gateways, gRPC, and Observability Signal Protocol Hardening — read next: Compare with capability-based security models (e.g., object-capability model) and service mesh patterns (Istio/Envoy) for alternative framings.
- omissionThe article does not address how MCP Apps (interactive UI in iframes) interacts with the gateway pattern -- does UI traffic flow through the gateway? Are there separate security considerations for bidirectional postMessage communication?AAIF's MCP Dev Summit: Gateways, gRPC, and Observability Signal Protocol Hardening — read next: Review the MCP Apps specification for security model details.
- incompleteThe '150-200 instructions' ceiling is asserted with no citation and no definition of what counts as one 'instruction' (a bullet? a sentence? a constraint?), so it can't be checked or applied precisely.Your AGENTS.md might be a big problem — read next: Anthropic/OpenAI docs and papers on instruction-following degradation with prompt length; the 'context rot' / lost-in-the-middle literature quantifying how many constraints models reliably honor.
- incompleteThe article's evaluative back half (sections 5–7: cost/'tokenmaxxing' disappointment stories, the 'was it just a hack' argument, and the context-engineering conclusion) is paywalled; this extraction only had the one-line table-of-contents previews for that material, not the supporting evidence or full argument.What is “loop engineering?” — read next: Get subscriber access to read the full piece, especially the cost-tradeoff stories in section 5 and the closing argument in section 7 for why context engineering may matter more than loop engineering — directly relevant to the persona's 'rigorous adopter, not hype-follower' stance on AI-agent practice.
- replication and ecological generalizationN=34 finance professionals on one 10-hour valuation task with GPT-4o. Whether within-speaker persistence and task-switching dominance generalize to software engineering, healthcare, legal, or shorter sub-hour tasks is open. The paper's portability claim (rebuild task decomposition and knowledge graph) is undemonstrated outside finance.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Pu et al. 2025 'Assistance or disruption?' on proactive programming assistants (cited ref. 26) — closest existing analog in software domain. Also Kazemitabaar et al. 2024 (ref. 61) on interactive task decomposition in data analysis.
- normative-direction assumption'Precision proactivity' assumes calibrated scope-bounded proactivity is normatively superior to indiscriminate proactivity. But CLT has a 'desirable difficulty' tradition (intentional friction supporting learning), and serendipitous unsolicited surfacing — exploration that helps users find what they wouldn't have queried — is a real category. The paper conflates 'precision' with 'good' without engaging the exploratory case.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: van Merriënboer & Sweller 2005 on germane load (cited ref. 125) — the paper's exclusion of germane load from its operationalization is itself a theoretical commitment worth examining.
- construct validity vs alternative load measuresThe paper relies entirely on transcript-derived computational proxies. NASA-TLX, dual-task secondary performance, physiological measures (fNIRS, pupillometry) are listed as future-work triangulation. The 3× EL:ICL ratio is a strong claim resting on whether the two composites have comparable measurement reliability.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Babaei et al. 2025 on NASA-TLX limitations (cited ref. 54); Hirshfield et al. 2024 on fNIRS for cognitive load in multiple resources (cited ref. 69).
- cost / latency / model-economics blind spotSubtask focus stacks, explicit scope elicitation, and navigable architectures all imply additional compute, latency, and interaction friction. The paper does not engage with vendor cost models, latency-vs-quality tradeoffs, or the operational realities of deploying precision-proactive systems.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Xiao & Yang 2025 'Streaming, fast and slow: cognitive load-aware streaming for efficient LLM serving' (cited ref. 154) — the only operational-economics paper cited.
- attention infrastructure absent (hidden-layer thread)The paper treats cognitive load as intra-dialogue. It does not engage with the broader attention environment users bring to the work (notifications, multitasking, fragmented focus — Bailey, Stolen Focus, Hyperfocus). Extraneous load in the conversation arrives on top of ambient extraneous load in the environment, and the paper's instruments cannot see the latter.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Mark, Gudith & Klocke 2008 'cost of interrupted work' (cited ref. 36) is used only for intra-dialogue framing — Chris Bailey's Hyperfocus, Stolen Focus, and the broader attention-infrastructure literature would be the right complement.
- skill acquisition under sustained AI use (Beane signature)The paper raises in §7.4.1 the long-term schema-acquisition concern: 'if the self-sustaining load patterns we document prevent novice users from constructing coherent task schemas during AI-assisted work, the long-term consequence may extend beyond diminished output quality to impaired skill development.' Proposes longitudinal study as future work but does not test. Given Beane is co-author and The Skill Code's central concern is preserving conditions for skill acquisition, this is the most productive incomplete line in the paper. The one-shot 10-hour design is structurally unable to address it.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Matthew Beane, The Skill Code; van Merriënboer & Sweller 2005 on cognitive load and complex learning (cited ref. 125).
- governance / policy framing latentMishkin's policy lens does not surface — proactivity is treated as a design problem, not a policy or organizational-adoption problem. The 'precision proactivity' implications could be read as soft regulatory guidance for high-stakes professional contexts but the paper does not develop this. The latent policy angle (should regulators require scope-elicitation in high-stakes professional AI?) is not posed.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Appel et al. 2026 Anthropic Economic Index report (cited ref. 52) for the policy framing Mishkin and co-authors have produced elsewhere.
- RLHF interpretation as mechanism vs analogyThe Discussion proposes that prompt→response spillover reflects RLHF optimizing for relevance and helpfulness. This is plausible but mechanistic only by analogy — the paper does not actually instrument the model or correlate with known RLHF training details. Newer post-training paradigms (Constitutional AI, RLAIF, weighted preference learning, reasoning models) may produce different mirroring behaviors.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Examine whether reasoning-trained models (o-series, Claude 3.7+ extended thinking, GPT-5 reasoning modes) exhibit different prompt-mirroring spillover under the same measurement framework. Stiennon et al. 2020 and Ouyang et al. 2022 (refs. 110-111) are the cited RLHF foundations.
- extension vs relabel of classical CLTThe paper claims to extend CLT by reframing extraneous load as dynamic and path-dependent. But classical CLT has dynamic formulations (effective intrinsic load varies with expertise via schema automation — Kalyuga et al. 2003 expertise reversal). The contribution is sharper if read as: importing CLT's static-design-feature framing into the dynamic conversational setting required computational instruments classical CLT didn't have, which then revealed the static framing was insufficient. Whether this is 'extension' or 'translation' is not foregrounded.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Sweller 1994 (ref. 6); Kalyuga et al. 2003 expertise reversal (ref. 124); van Merriënboer & Sweller 2005 (ref. 125).
- harness-engineering syntopical bridgeThe paper does not engage with the agent-harness literature (compaction, sub-agents, context anxiety) but its within-speaker persistence finding is precisely the empirical grounding that literature needs. Each compaction event in a harness can be read as an attempt to break the self-sustaining load trajectory documented here.Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work — read next: Anthropic harness paper on long-running application development; Turing Post 5 patterns for long-running agents; Cloudflare compaction-loss anecdotes.
- incompleteNo base rate or comparison to non-LLM SAST/DAST. The post claims Mythos produces 'noticeably higher quality' triage output and that the harness produces 'meaningful coverage', but provides no quantitative baseline against either prior frontier models or traditional static analysis. The reader has to take Cloudflare's qualitative judgment on faith.Project Glasswing: what Mythos showed us — read next: Read the Anthropic harness paper (planner/generator/evaluator) and any forthcoming Mythos technical report for quantified eval data; cross-reference with industry SAST benchmarks (e.g. OWASP Benchmark) to triangulate.
- incompleteVendor-incentive analysis is absent. Cloudflare was an invited Glasswing partner and benefits from being perceived as an Anthropic-grade security research org. The post is simultaneously a research report, a co-marketing artifact, and a strategic positioning piece for Cloudflare's edge product suite ('our products are built to apply [these principles] on behalf of customers'). None of this is acknowledged.Project Glasswing: what Mythos showed us — read next: Read Schneier on Security or Marcus on AI safety for an external skeptic's read; look for independent reproductions of Cloudflare's claims by orgs without an Anthropic partnership.
- incompleteNo adversarial robustness data. If attackers know LLM-based scanners are in the loop, they can seed code with patterns that exploit known model biases — false-negative attractors, hedging triggers, or refusal-inducing framings on the defender's side. The post discusses defender adversariality (adversarial review between agents) but not attacker adversariality.Project Glasswing: what Mythos showed us — read next: Anthropic's own work on adversarial robustness; the broader literature on prompt injection and indirect prompt injection in agentic systems.
- incompleteGeneralizability across stacks is asserted by silence. Cloudflare's codebase — heavily Rust, well-documented, with explicit trust boundaries and the discipline that comes from running a global edge network — is unusually well-suited to the harness as described. Whether the same harness pays off on a typical enterprise Java monorepo with sparse documentation and ambiguous trust boundaries is an open empirical question.Project Glasswing: what Mythos showed us — read next: Look for similar reports from non-Cloudflare practitioners (Google Project Zero, Microsoft, GitHub Advanced Security with Copilot Autofix at scale) using comparable harness architectures; pair with Böckeler on variety reduction as the precondition for any harness to work.
- incompleteThe 'context anxiety / compaction discards earlier findings' claim is offered as a one-line motivation for the harness but is the most theoretically interesting failure mode in the post — and the one that connects most directly to the user's harness-engineering reading thread. Bourzikas leaves the mechanism opaque (how often does compaction discard a real finding? does Mythos behave differently from general frontier models on this dimension?).Project Glasswing: what Mythos showed us — read next: Re-read the Anthropic harness paper's 'context anxiety' discussion; pair with Böckeler's variety-reduction framing and the smallcode failure-mode catalog; consider an extraction comparing the three on a single axis: 'what is the model's relationship to its own context, and what does the harness do about it?'
- incompleteThe model-written-patches anecdote is mentioned in one sentence and then abandoned. How many patches went out? How were the regressions detected — by Cloudflare's own pipeline or by customer impact? What was rolled back? Given that this is a public commitment that Cloudflare shipped broken patches authored by an LLM, the lack of detail is itself a finding.Project Glasswing: what Mythos showed us — read next: Watch for follow-up Cloudflare posts; pair with research on LLM-generated patch quality (e.g. recent academic work on Copilot Autofix regression rates).
- illogicalThe two-hour SLA argument elides a continuum. Bourzikas treats 'two-hour SLA' as the strawman and 'architectural hardening' as the alternative, but the realistic question is whether to push patch-speed to four hours, twelve hours, or 24 hours while also investing in architecture. The dichotomy is rhetorically convenient and conveniently routes attention toward Cloudflare's product moat.Project Glasswing: what Mythos showed us — read next: Read existing CVE-to-patch SLA literature (e.g. industry reports on time-to-remediate) to understand the actual distribution; question whether Cloudflare's customers are the ones being warned-off the two-hour target.
- uninformed (potentially)No engagement with formal-methods or non-LLM approaches to reachability analysis (the 'Trace' stage's job). Static analyzers, taint trackers, and symbolic execution engines have been doing reachability for decades; the post implicitly treats LLM tracer agents as a novel solution without engaging with what they replace.Project Glasswing: what Mythos showed us — read next: Compare against CodeQL, Semgrep, and formal taint-tracking literature; ask whether LLM tracer agents complement or substitute for these.
- incompleteThe article places authentication 'tokens' and LLM 'tokens' side by side under one umbrella term without ever flagging that they are entirely unrelated concepts sharing only a name -- a real source of confusion for developers moving into AI-augmented applications who may conflate 'token limit' (LLM context) with 'token expiry' (auth) or assume LLM tokens carry any security property at all.What Is a Token? A Developer's Guide to Every Type — read next: Any introductory LLM tokenization explainer paired with an OAuth/JWT primer, read side by side to make the non-relationship explicit.
- incompleteJWT alternatives designed to avoid well-known JWT signature/algorithm pitfalls (e.g., the 'alg: none' vulnerability, RS256/HS256 confusion) such as PASETO are not mentioned, even though the article recommends JWT as the default bearer-token implementation.What Is a Token? A Developer's Guide to Every Type — read next: PASETO specification and comparative JWT-vulnerability writeups.
- incompleteThe post is a promotional pitch for a product distributed via a third-party download link (tally.so), with no independent verification, no source code shown, and no discussion of what data the Skill collects or where the handoff file (containing potentially sensitive draft work and decisions) is sent or stored.Yonathan Cohen's Post — read next: Treat as anecdotal marketing rather than a vetted engineering pattern; cross-check the underlying mechanism against Anthropic's own documented approach to context resets and handoff artifacts before adopting.
- uninformedThe post conflates a Claude.ai message-limit ('You're out of messages for a few hours') with Claude Code's context-usage percentage (90% trigger) as though they were the same mechanism, without acknowledging they are different products with different constraints.Yonathan Cohen's Post — read next: No specific reading direction beyond noting the terminology looseness typical of promotional posts.