Context Rot & Context Limits

The degradation of model performance as the context window fills, and the countermeasures — resets, handoff artifacts, compaction — used to manage it.

Also known as: context rot, context bloat, context pollution, context anxiety, smart zone / dumb zone, context load / context re-reading, context reset, compaction, /compact, Memento agent (LLM as the guy from Memento), contextual inertia (users')

Part of: Context Engineering

How authors use it

Oldest first (extraction date when no publication date is known).

AuthorTheir termTheir meaning
Eight years of wanting, three months of building with AI
Lalit Maganti · 2025-03-01
context pollutionThe problem that design decisions from one part of a codebase implicitly constrain other parts, and determining relevance requires exactly the institutional knowledge you are trying to externalize.
The productivity paradox of AI coding assistants
Lisa Dziuba · 2025-09-12
context rotThe degradation of AI output quality as more context accumulates within a session, because the model starts pulling in irrelevant details from earlier prompts.
No Vibes Allowed: Solving Hard Problems in Complex Codebases – Dex Horthy, HumanLayer
AI Engineer · 2025-12-02
smart zone / dumb zoneBorrowed from Jeff Huntley's research: the smart zone is the portion of a context window (roughly up to ~40%, task- and model-dependent) within which the model still reasons and tool-calls well; beyond it, output quality degrades sharply (the dumb zone), and raw context-window size increases ('1M tokens!') do not fix this because they just add more dumb zone.
Precision Proactivity: Measuring Cognitive Load in Real-World AI-Assisted Work
Brandon Lepine; Juho Kim; Pamela Mishkin; Matthew Beane · 2026-03-10
Contextual inertia (users')User-side counterpart to LLMs getting lost in multi-turn. 'A growing reluctance to reset a conversation because accumulated context carries both informational value and coordination costs.' Preserving context avoids restating objectives but increases the likelihood that responses reflect organizational patterns that increase extraneous load over time.
Harness design for long-running application development
anthropic.com · 2026-03-24
Context anxietyA model behavior in which the agent prematurely wraps up work as it approaches what it believes is its context window limit. Distinct from actual coherence loss; it is the model's anticipatory truncation of effort. Author claims Sonnet 4.5 exhibits this strongly; Opus 4.6 largely eliminated it.
Harness design for long-running application development
anthropic.com · 2026-03-24
Context resetClearing the context window entirely and starting a fresh agent, combined with a structured handoff artifact that carries the previous agent's state and next steps. Contrasted with compaction.
Harness design for long-running application development
anthropic.com · 2026-03-24
CompactionSummarizing earlier parts of a conversation in place so the same agent can keep going on a shortened history. Preserves continuity but does not eliminate context anxiety because the agent is still 'the same agent.'
Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development
Leela Kumili · 2026-04-06
context resetDeliberately clearing the agent's context at a defined boundary and handing over a structured artifact (state summary, progress record) so the next agent starts fresh from a known state — as opposed to compaction, which attempts to preserve continuity
Anthropic's Designs Three-Agent Harness Supports Long-Running Full-Stack AI Development
Leela Kumili · 2026-04-06
compactionA technique for preserving context by summarizing or compressing prior conversation, allowing the model to appear to have longer memory — contrasted with context resets because it causes models to grow cautious as limits approach
AAIF's MCP Dev Summit: Gateways, gRPC, and Observability Signal Protocol Hardening
Andrew Hoblitzell · 2026-04-09
context bloatThe problem of MCP tool definitions consuming too large a share of the model's context window, degrading performance; solved client-side via progressive tool discovery
I stopped hitting Claude's usage limits - 10 things I changed
kaize · 2026-04-10
context load / context re-readingThe process by which Claude re-processes the entire conversation history with each new turn, multiplying token cost.
Charlie Hills 🦩's Post
Charlie Hills 🦩 · 2026-04-16
/compactA Claude Code command that summarizes and compresses the conversation context to free up token budget
Agent Harness Engineering
Addy Osmani · 2026-04-20
context rotThe degradation of model reasoning and task-completion quality as the context window fills up
Accelerating Delivery: How AI Agents Can Own the Initial Code Draft
Stephen Walker · 2026-04-20
Context rotDegradation of AI performance as the context window fills with large text blocks and growing activity logs, causing the model to lose focus
[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero
AI Engineer (channel); speaker: Matt Pocock (AI Hero) · 2026-04-24
smart zone / dumb zoneThe smart zone is the portion of an LLM's context window (Pocock pins it at roughly 100k tokens regardless of advertised window size) in which attention relationships are not yet strained and the model makes good decisions; the dumb zone is everything beyond, where token-to-token attention scales quadratically and quality collapses. Originally from Dex Horthy (Human Layer).
[FULL WORKSHOP] AI Coding For Real Engineers - Matt Pocock, AI Hero
AI Engineer (channel); speaker: Matt Pocock (AI Hero) · 2026-04-24
Memento agent (LLM as the guy from Memento)An LLM session always resets to its system prompt; the developer should embrace and exploit this — clear context rather than compact — so every session starts in a known, optimal state. Pocock prefers clearing to compacting.
Project Glasswing: what Mythos showed us
Grant Bourzikas · 2026-05-18
Context anxiety (implicit)Not used verbatim. Bourzikas describes the analogous phenomenon: as a single-agent session approaches its context-window limit, compaction kicks in 'potentially discarding earlier findings that would have mattered.' The harness exists in part to avoid this.
11 Tips For AI Coding With Ralph Wiggum
Matt Pocock · 2026-07-11
context rotThe degradation of LLM output as the context window fills — 'the longer you go, the stupider the output' — cited as the agent-specific reason (beyond ordinary feedback tightness) to keep loop tasks small.
What is “loop engineering?”
The Pragmatic Engineer · 2026-07-14
context rotThe degradation of an agent's effective performance as a single, long-running context window accumulates history, used here as the reason to restart agents with a fresh context each loop iteration rather than keep one continuous conversation going.
Presentation: Autonomous Data Products for the Autonomous Era: Rethinking Data Architecture for GenAI
Jörg Schad · 2026-07-24
context rotThe degradation of an LLM/agent's performance as more — and increasingly unspecific — context or data is exposed to it; there is a 'sweet spot' of just-enough, task-specific information, and exceeding it causes hallucination from an inability to choose what's relevant.
LIVE: Uncle Bob on Software Fundamentals in the Age of AI
Matt Pocock (host) with Robert C. Martin ('Uncle Bob') · 2026-08-19
smart zone / dumb zonePocock's citation of Dex Horthy's term for the portion of a context window (roughly the first ~40%, per the corpus's Horthy extraction) within which model output quality holds, versus the degraded region beyond it — used here to explain why short, front-loaded prompts beat long prose rulebooks.

Documents (30)

Propositions touching this concept (22)

By publication month, oldest first (extraction month when no publication date is known).

2025-09

2025-12

2026-03

2026-04

2026-05

2026-06

2026-07

2026-08

2026-10

Tensions

Can harness engineering actually solve the AI code quality problem?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
Assessment: This is the central divergence in the literature. Osmani is most optimistic, operating from benchmark evidence that harness changes produce dramatic improvements on coding tasks. Böckeler occupies the middle ground, distinguishing solvable from unsolved harness domains. Beck is most skeptical, questioning whether harnesses address the root cause at all. The disagreement is partly empirical (what do the benchmarks actually measure?) and partly about scope (Osmani focuses on task completion; Beck focuses on long-term code value including flexibility). They may not be contradicting each other so much as talking about different time horizons: harnesses help with immediate task success, but the tarpit emerges over accumulated changes.
What is the right metaphor for the human-AI relationship in coding?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
Assessment: These metaphors are not mutually exclusive but they lead to different design decisions. Garg's teammate metaphor emphasizes collaboration rituals and may underplay the need for hard constraints (you don't sandbox a teammate). Böckeler's governor metaphor is the most theoretically rigorous but may overclaim the applicability of control theory to creative work. Osmani's engineering metaphor is the most actionable but may miss the social and organizational dimensions. Thoughtworks' organizational metaphor captures the broadest scope but is the hardest to operationalize.
Will better models make current harness practices obsolete?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
Assessment: Osmani makes the strongest case for permanence with concrete evidence of scaffolding migration. Beck keeps the door open for the Bitter Lesson hypothesis. The truth likely depends on the type of harness: mechanical safeguards (sandboxes, permission controls) may always be needed, while knowledge-transfer patterns (AGENTS.md, priming docs) may become less necessary as models improve at in-context learning.
Context size: should you shrink the problem to fit a small usable window (decompose / reset), or grow and trust a large window?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: The apparent 'grow / trust the big window' position for CODING largely dissolves once retrieval is separated from coding — which is exactly Pocock's move ('good for retrieval, less good for coding') and musistudio's (longContext is a routed escalation, not the coding default). No text argues you should code inside a full 1M window. The only genuine pressure toward trusting a bigger window is the vendor-forward Fable 5 / Opus 4.6 claim that coherence loss is being engineered away — but that is a moving target (convergence 5), not a stable dial, and even the harness paper only relaxed context resets AFTER measuring that the new model no longer needed them. A secondary, live sub-dispute survives: reset vs compact. Pocock, the harness paper and best-practices favor clearing/resetting to a fresh agent; Hills and Osmani lean on compaction. The reset camp has the better argument on today's models — compaction preserves the same anxious agent — but the disagreement is real and unresolved. Verdict: shrink-and-decompose is the default for coding; grow only as an explicit retrieval escalation; prefer reset over compact unless the model version has demonstrably killed context anxiety.
Who selects the model/effort/context — a human deciding per task, or an automatic router — and who is trusted to hold the dial?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
Assessment: The human-vs-auto axis is less about capability than about (a) whether task difficulty can be detected a priori and (b) who bears the principal-agent risk. No router in the corpus actually measures difficulty — musistudio routes by token-count and static scenario, and the Pragmatic Engineer's routers infer 'good enough' without a demonstrated oracle — so 'auto' today means 'static-heuristic', not 'optimal'. Automation is safe when the user owns the policy (musistudio) and dangerous when the router profits from the choice (Cursor Auto) or when the provider adjusts the dial invisibly (stellaraccident). Verdict: keep the human holding the difficulty judgment and the effort dial until routers can both measure adequacy and prove neutral incentives; automate only the mechanical dispatch, over rules you own and can audit.

Open gaps (67)