Context Engineering
The practice of deliberately structuring, selecting and budgeting the information supplied to an AI agent so it can reason and act reliably.
Also known as: context engineering, context management, Knowledge Priming, Context Anchoring, structured context compression, context budget, context (the AI gospel sense), context (in enterprise AI), context transfer, context pointers
How authors use it
Oldest first (extraction date when no publication date is known).
| Author | Their term | Their meaning |
|---|---|---|
| Patterns for Reducing Friction in AI-Assisted Development Rahul Garg · 2026-02-24 | Knowledge Priming | Sharing curated project context (tech stack, conventions, directory structure, examples) with the AI before requesting code — described as 'manual RAG' |
| Patterns for Reducing Friction in AI-Assisted Development Rahul Garg · 2026-02-24 | Context Anchoring | Maintaining a living document of decisions, constraints, and state as external memory that persists across AI session boundaries |
| Agent Skills: Google-Backed AI Coding Agent Workflow Addy Osmani · 2026-04-10 | context engineering | The practice of managing and structuring the information context available to an AI agent during code generation |
| TBM 418: Campfires, Trails, and Quests John Cutler from The Beautiful Mess · 2026-04-22 | context pointers | Markdown files (or similar artifacts) added to a codebase that point AI and humans at the right context for specific tasks. A specific stigmergic artifact in Cutler's team's workflow. |
| Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab Leela Kumili · 2026-05 | structured context compression | Combination of selective retrieval and compression of intermediate state so multi-step agent reasoning fits within token budgets. |
| GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. https://github.com/Doorman11991/ · 2026-05-21 | context budget | Active management of context-window usage: tool results capped at 4k chars, mid-turn eviction of old results, semantic compression of history rather than truncation |
| AI Won't Save the Kingdoms We Built John Cutler · 2026-05-25 | Context transfer | Moving information, summaries, retrievals, and pattern-matching across an organization — what AI is genuinely good at. |
| Why AI agents need a Context Lake Zohar Einy · 2026-05-27 | Context engineering | Managing, curating, and delivering the right context to AI systems at scale — presented as the discipline that motivates building a Context Lake. |
| The real skill behind good AI prompts is older than computers Ernie Svenson · 2026-06-02 | context (the AI gospel sense) | The background you feed a model — accepted as real and useful, but demoted to a downstream PRODUCT of attention rather than a primary skill |
| This Week in AI: Production Viability Michelle Smith (O'Reilly Network) · 2026-06-06 | context (in enterprise AI) | The undocumented, in-org knowledge about why decisions were made, which data can't be used, which models can't be deployed in regulated settings — held by long-tenured people, not models or fresh FDEs |
| The New SDLC With Vibe Coding: From ad-hoc prompting to Agentic Engineering Addy Osmani, Shubham Saboo, Sokratis Kartakis · 2026-06-15 | context engineering | The practice of supplying an agent with six structured types of context (instructions, knowledge, memory, examples, tools, guardrails), split into always-loaded 'static' context and on-demand 'dynamic' context (notably Agent Skills), as a discipline distinct from and more important than prompt wording. |
| What is “loop engineering?” The Pragmatic Engineer · 2026-07-14 | context engineering | Per the article's closing preview: the discipline of managing what goes into an agent's context window — positioned as the skill the author ultimately argues matters more broadly than loop engineering for most developers. |
| AI Root Cause Analysis Shifts from Model Reasoning to Context Engineering Mark Silvester · 2026-07-25 | context engineering | The discipline of curating the smallest set of high-signal, compact context supplied to a model before it reasons -- treated as the emerging hard problem in AI RCA and, per the article's closing citations (Anthropic, LangChain, Mezmo), in AI-agent engineering generally. |
| Agentic AI and Code Reviews Zach Davis, Michelle Gill, Elisabeth Hendrickson, Angie Jones, Sha Ma, Randy Shoup, James Wickett · 2026-09-14 | Context Engineering (as applied to review) | Deliberately making a codebase 'agent-ready' by turning it into a repository of operational knowledge, architectural intent, and historical decisions (AGENTS.md, knowledge graphs, indexed incident/postmortem history) — not an optional add-on but infrastructure every other review pattern depends on. |
Documents (50)
- 12-Factor Agents: Patterns of reliable LLM applications — Dex Horthy, HumanLayer AI Engineer · 2026-10-08 Reader 🖥️
Reliable production LLM agents are built not by adopting an agentic framework that hides the hard parts, but by applying ordinary software-engineering discipline — owning your prompts, your control flow (the loop/switch-statement/context-window triad), and your execution/business state — to what is fundamentally a stateless-function (LLM) called inside a small, deterministic, developer-controlled loop. - Advanced Context Engineering for Coding Agents (ace-fca.md) Dex Horthy (HumanLayer) · 2026-10-08 source ↗ Reader 🖥️
Solving hard problems in brownfield codebases requires designing your entire workflow — not just individual prompts — around keeping the context window in a 40-60% utilization sweet spot via a research/plan/implement cycle of frequent, intentional compaction, with human review concentrated at the research and plan layers because errors there compound into far more downstream bad code than a single bad line; and the open problem now is scaling this disciplined, human-engaged practice collaboratively across whole teams, not just a single highly motivated practitioner. - Graphify: Unifying Codebase Context to Streamline Agentic Software Engineering Olimpiu Pop · 2026-09-23 Reader 🖥️
Graphify demonstrates that converting a codebase's structure and documentation into a queryable, multimodal knowledge graph is a technically credible way to give AI coding agents accurate cross-file context within a bounded token budget, but five months into rapid early development its real-world value in day-to-day workflows still trails its conceptual appeal — for many ordinary tasks on mid-sized repos, developers report that plain grep and file navigation remain competitive or faster. - Agentic AI and Code Reviews Zach Davis, Michelle Gill, Elisabeth Hendrickson, Angie Jones, Sha Ma, Randy Shoup, James Wickett · 2026-09-14 source ↗ Reader 🖥️
As AI agents generate code faster than human attention can scale to review it, code review must be reorganized from a single human merge-time gate into a layered, risk-tiered verification system — deterministic checks, continuous author/review-agent loops, structurally independent adversarial review, and specialist multi-agent review — with human judgment deliberately reserved for intent, strategic risk, and accountability rather than mechanical inspection, and every automated decision recorded as a durable, auditable artifact. - Presentation: From Retrieval to Reasoning: Building Production-Ready Agentic AI Systems with Knowledge Graphs Cassie Shum · 2026-09-12 source ↗ Reader 🖥️
A knowledge graph earns its place in agentic software engineering less as a retrieval-accuracy mechanism (an edge that has largely eroded as models got better at parsing raw context) than as an organizational substrate for four practices: assembling task-specific context bundles, tracing decision provenance from idea to production, treating code rather than spec as the ground truth of system behavior, and making agent activity visible enough to audit and manage. - TBM 439: Day At The Gig... John Cutler from The Beautiful Mess · 2026-09-11 Reader 🖥️
AI can accelerate the mechanical formalization of sensemaking artifacts a person has already understood, but it cannot solve the harder problem underneath — telling which of an organization's proliferating artifacts still reflect current reality — so genuine organizational context remains something you have to actively create through your own exploration and other people's tacit knowledge, not something AI can spoon-feed you. - Inside a Software Factory Paul Iusztin · 2026-09-04 Reader 🖥️
A 'software factory' — a human-operated automated pipeline of eight SDLC stages over a shared context layer — is the right unit of analysis for disciplined AI-assisted development because it locates humans precisely at brainstorming, planning, and final review while agents execute everything between, and the engineering skill lies not in maximizing automation but in calibrating how much of the factory to build, buy, or leave manual as team scale and trust in the plan grow. - Portal by Spotify cut my Claude Code token usage by 90% Dimitri Mazmanov · 2026-09-03 source ↗ Reader 🖥️
Because most of what a coding agent does is I/O rather than reasoning, routing that I/O-bound work (bulk file reads, pattern-following boilerplate generation) to a cheap worker model — and enforcing that routing deterministically via harness-level hooks rather than relying on advisory instructions the model can ignore — cuts Claude Code's token spend by around 90% on the delegated work while reserving the frontier model for editing, debugging, and anything safety-critical. - When AI Writes the Code, Specifications Need an Exit Strategy Markus Eisele · 2026-08-17 source ↗ Reader 🖥️
When building software with AI coding agents, a specification should be a temporary 'change brief' that describes only the delta between current and intended behavior and expires at release, because durable system knowledge belongs in the native artifacts engineering already trusts to stay synchronized with the code — schemas, types, tests, policies, and telemetry — not in permanent prose that inevitably drifts and consumes an agent's finite context budget. - Downstream #1: Where Do Our Tokens Go? Johannes Gehrke · 2026-08-01 source ↗ Reader 🖥️
The cost of agentic coding is set less by which model you use than by how the harness manages context, exploration, and stopping — so engineering leaders should invest in harness discipline, per-workflow model evaluation, and cost visibility rather than wait for cheaper tokens to fix agent economics. - Paweł Huryn's Post Paweł Huryn · 2026-08-01 Reader 🖥️
For most AI agents, the four functional types of memory — working, semantic, episodic, and procedural — map cleanly onto a context window plus a handful of git-versioned files (markdown for facts/rules, a CSV for history, more markdown for reusable skills), making vector databases and graph databases unnecessary defaults, appropriate only as 'escape hatches' when a corpus genuinely becomes too large to read. - The Orchestrator's Tax Rahul Garg (martinfowler.com; edited/guided by Martin Fowler) · 2026-07-28 source ↗ Reader 🖥️
The real value of a subagent is not the wall-clock time it saves through parallel execution but what it keeps out of the orchestrator's context, so multi-agent workflows should be designed and governed around protecting the orchestrator's limited working memory — via task splits that respect 'cognitive locality' and via minimal, fact-justified standing rules — rather than around maximizing delegation, agent count, or governance. - Zero to Agent in 30 Minutes: Build a Hermes Social Media Agent with Craig Hewitt Michelle Smith · 2026-07-27 source ↗ Reader 🖥️
A useful autonomous social-media agent is built by staging trust deliberately, not granting it upfront — engineering structured context (a documented voice profile and workspace) first, proving one narrow workflow under human review before packaging it as a reusable skill, and only then adding fresh-data connections, triggers, and access safeguards that let it run unsupervised. - AI Root Cause Analysis Shifts from Model Reasoning to Context Engineering Mark Silvester · 2026-07-25 Reader 🖥️
The hard part of AI-assisted root cause analysis has shifted from model reasoning -- which recent evidence suggests is largely solved by frontier and even many open-weight models given the same prepared context -- to context engineering: the harness work of correlating signals and assembling a compact, unmisleading context before the model is ever called. - Stop Overengineering Your Agent Harness Hugo Bowne-Anderson · 2026-07-22 source ↗ Reader 🖥️
Most builders should reject the coding-agent-derived harness checklist (memory, compaction, sub-agents, hooks) as a default and instead size their harness to where a given task actually falls on two independent axes — action complexity and context complexity — because harness features are provisional, encoding assumptions about model limitations that expire as models improve (the 'Kirby effect'), so the discipline is to build the minimum viable harness for the job and prune it as capability arrives. - Everyone Is Talking About Context for AI. Here's What Most Companies Still Miss. Celonis (sponsor content published on hbr.org, byline credited to "Harvard Business Review") · 2026-07-21 source ↗ Reader 🖥️
Enterprise AI initiatives are failing to deliver returns not because models lack capability but because they lack operational context — real-time, proprietary knowledge of how a specific business actually runs — and only once organizations supply that context (which the sponsor's platform is positioned to provide) can AI agents be trusted to act reliably at enterprise scale. - How Netflix Built GenPage: a Single GenAI Model to Build Personalized Homepages Sergio De Simone · 2026-07-19 Reader 🖥️
Netflix replaced its multi-stage candidate-generation/ranking/layout recommendation pipeline with a single generative model that autoregressively produces the entire homepage from a user-and-request prompt, and in production this consolidation simultaneously improved engagement, cut serving latency by 20%, and revealed that enriching the model's input context mattered far more than scaling the model's parameter count. - What is “loop engineering?” The Pragmatic Engineer · 2026-07-14 Reader 🖥️
“Loop engineering” — designing the orchestration around an AI coding agent (goals, completion checks, state persistence, fresh-context iteration) rather than hand-writing one-off prompts — is a real practice that originated as a DIY workaround (the “Ralph loop”) for small context windows, but by mid-2026 major harnesses had absorbed most of it into a native /goal primitive, so for most developers besides those building AI infrastructure, it is a largely-already-commoditized skill rather than a durable new discipline. - The Almedra Token-Efficiency Benchmark, Updated For GLM 5.2 Lucena.One · 2026-07-13 Reader 🖥️
Running the same prompt and repo through six different coding-agent harnesses against the identical GLM 5.2 model, Lucena Coder again produced a working result using roughly a third to a fifteenth of the tokens and cost of its rivals, showing that harness design — not the underlying model — is the dominant lever on coding-agent token efficiency, and that upgrading the model (GLM 5.1 to 5.2) narrows but does not close that gap. - The Anatomy of an Agent Harness Akshay · 2026-07-08 Reader 🖥️
An agent harness is not monolithic prompt-glue but a decomposable system of roughly twelve components (orchestration loop, tools, memory, context management, prompt construction, output parsing, state, error handling, guardrails, verification, subagents) plus seven design-decision axes, and naming the parts is what lets you reason about, debug, and — because the parts are treated as separable and independently improvable — evolve agent behavior; yet as delivered the list reads as a convergent practitioner checklist organized by mechanism and vendor vocabulary rather than an orthogonal, coupling-minimizing decomposition with defined interfaces. - Presentation: The Multi-Agent Approach: Building Reliable and Controllable Software Development Automation Itamar Friedman · 2026-07-08 source ↗ Reader 🖥️
To break through the AI 'productivity ceiling' in software development you must stop pouring investment into faster code generation and redirect it toward verification and context — building an adaptive, quality-grounded multi-agent system with an arbiter to resolve agent disagreements, human-observable inter-agent communication, first-class governance, and continuous learning of what quality means for your organization. - AI Is Changing Software Engineering. The Fundamentals Still Matter. Abby Bangser · 2026-07-07 source ↗ Reader 🖥️
AI is transforming who produces, consumes, and maintains software, but the organisations moving fastest succeed by doubling down on engineering fundamentals — right-sized boundaries, modular abstractions, clear interfaces, and operational discipline — as the foundation that lets humans and AI build together safely and sustainably. - Notes from FOSE Europe Giles Edwards-Alexander · 2026-07-07 source ↗ Reader 🖥️
Five months into the agentic era the value of agentic engineering is now settled ('the evidence is in'), so the live frontier of the debate has moved from the tools themselves to the socio-organisational questions they raise — how to design your organisation (Optimiser vs Learner), where engineering rigour and human judgement now live, and how to coordinate agentic work across teams and enterprises — none of which is yet resolved. - Prompting Claude Fable 5 Claude Platform Docs · 2026-07-07 Reader 🖥️
Prompting Claude Fable 5 well means steering a markedly more capable, longer-horizon, strongly-instruction-following model with brief goal-and-intent-first directives and asynchronous, memory- and subagent-aware scaffolding — and pruning the enumerated rules, guardrails, and hand-holding that prior, weaker models required. - Tony Seale's Post Tony Seale · 2026-07-05 source ↗ Reader 🖥️
Durable agent memory should fuse the two kinds of human memory — a markdown wiki for the episodic (what happened) and a formal ontology for the semantic (what things mean) — in one layered file format, Vault-LD (markdown plus optional YAML-LD frontmatter), so that any note can progressively acquire structure and meaning and a private vault can scale, unchanged in substrate, from a personal second brain up to an open, decentralised agentic web. - Your AGENTS.md might be a big problem Matt Pocock (AI Hero) · 2026-07-03 Reader 🖥️
A reactively bloated AGENTS.md degrades an AI coding agent because it spends the model's finite instruction-following budget on every request, so you should keep the root file to 3-5 essentials and push everything else into nested files the agent loads only when relevant. - How to Actually Prompt Fable 5, Straight From the Team That Built It CyrilXBT · 2026-07-01 Reader 🖥️
This thread is essentially Anthropic's official Fable 5 prompting guide, compressed and repackaged for practitioners as a six-step migration checklist — it restates the guide's core techniques (latency/timeouts, effort tiers, progress-auditing, proactivity constraints, memory, subagents, final-response format, refusal fallback) nearly verbatim while dressing a public-doc summary in 'straight from the team that built it' authority framing and layering in a few uncited specifics (the ultrathink/ultracode keywords, a sub-5% refusal rate, an 'audit beat softer phrasings' test) that the official extraction does not contain. - Google Just Dropped a Masterclass on Agentic Engineering (It's SO Good) Cole Medin · 2026-06-24 Reader 🖥️
A developer's or team's AI-coding results are determined far more by the harness they deliberately engineer around a model — specs, context, guardrails, verification, and the discipline of continuously improving that system — than by which model they use, so investing upfront in 'agentic engineering' over ad-hoc 'vibe coding' is the highest-leverage move available right now, even though it costs more to start. - The New SDLC With Vibe Coding: From ad-hoc prompting to Agentic Engineering Addy Osmani, Shubham Saboo, Sokratis Kartakis · 2026-06-15 Reader 🖥️
As AI increasingly handles code generation itself, what separates production-grade 'agentic engineering' from risky 'vibe coding' is not which AI tool a team uses but how deliberately it designs and maintains the harness, verification (tests + evals), and context around the model — so the discipline a team already has is what AI amplifies, for better or worse. - This Week in AI: Production Viability Michelle Smith (O'Reilly Network) · 2026-06-06 Reader 🖥️
AI's current bottleneck is not capability but measurement: practitioners and organizations are producing prodigious output (tokens, code, recommendations, profiles) while lacking the contextual judgment, metacognitive discipline, and incentive structures needed to tell which output is actually worth shipping. - Lessons from building Claude Code: How we use skills Claude · 2026-06-03 Reader 🖥️
Skills work best when treated as folders (not markdown snippets) that use progressive disclosure and hard-won gotchas rather than restating known behavior, are described for machine-triggered discovery rather than human summary, and are distributed and curated organically as they scale — with verification skills specifically deserving outsized investment because they have had the most measurable impact on Claude's output quality internally. - The real skill behind good AI prompts is older than computers Ernie Svenson · 2026-06-02 Reader 🖥️
Good AI output depends not on prompting technique but on attention — the pre-digital, self-cultivated skill of noticing what matters in the task and in the model's output — which cannot be taught, only chosen. - Why AI agents need a Context Lake Zohar Einy · 2026-05-27 source ↗ Reader 🖥️
Scaling AI agents beyond a single power user to an entire organization fails not because of model quality but because agents lack a queryable layer of organizational knowledge (ownership, dependencies, criticality, terminology) that tool access alone cannot supply — and building that layer, a "Context Lake," is what makes agent behavior consistent, safe to approve, and affordable at scale. - AI Won't Save the Kingdoms We Built John Cutler · 2026-05-25 source ↗ Reader 🖥️
AI will only dissolve the organizational fiefdoms of the ZIRP era if leaders are honest that those fiefdoms were structural responses to coordination, autonomy, and accountability problems — otherwise AI will simply reproduce the same coordination burden in a new, async, agent-mediated shape. - GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. https://github.com/Doorman11991/ · 2026-05-21 source ↗ Reader 🖥️
A well-engineered harness — context budgeting, forgiving tool-call parsing, patch-first editing, two-stage tool routing, decomposed planning, and per-model profiles — can extract production-grade agentic coding work from small (7B-20B), locally-hosted LLMs that would otherwise be considered too weak for the task, making local, private, frontier-free coding agents viable. - Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab Leela Kumili · 2026-05 source ↗ Reader 🖥️
Partitioning a multi-agent engineering-support system into investigation vs. enhancement workflows, with a curated tool layer, a LangGraph supervisor, and mandatory human-in-the-loop review for code changes, yields enough reliability to reclaim engineering hours at production scale. - TBM 418: Campfires, Trails, and Quests John Cutler from The Beautiful Mess · 2026-04-22 Reader 🖥️
AI used well does not replace team collaboration — it enriches the asynchronous traces (trails), the purposeful joint work (quests), and the convening sessions (campfires) that already make great product teams effective; used badly, as a single-player private context machine, it produces 'accelerated isolation that feels like collaboration.' - Jacob Langvad Nilsson's Post Jacob Langvad Nilsson · 2026-04-20 source ↗ Reader 🖥️
Effective use of AI coding agents depends not on better prompting but on providing structured context — plans, specs, skills, hooks, and a clear understanding of the agentic loop — which is the real unlock for productive human-AI collaboration in software development. - Agent Skills: Google-Backed AI Coding Agent Workflow Addy Osmani · 2026-04-10 source ↗ Reader 🖥️
AI coding agents produce poor-quality output when unconstrained, so encoding senior-engineer workflows as structured skills — covering the full define-plan-build-verify-review-ship lifecycle — forces agents to follow the disciplined practices that distinguish professional engineering from mere code generation. - Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering Chenyu Zhou, Huacan Chai, Wenteng Chen, Zihan Guo, Rong Shan, Yuanyi Song, Tianyi Xu, Congming Zheng, Jiachen Zhu, Zeyu Zheng, Zhuosheng Zhang, Xingyu Lou, Zhihui Fu, Jianghao Lin, Weinan Zhang · 2026-04-09 Reader 🖥️
Practical progress in LLM agents increasingly depends not on improving model weights but on externalizing cognitive burdens into external infrastructure — memory, skills, protocols, and harness engineering — which together form a systems-level framework of cognitive artifacts. - Research-Driven Agents: What Happens When Your Agent Reads Before It Codes Alex Kim · 2026-04-09 source ↗ Reader 🖥️
Coding agents generate better optimizations when they read papers and study competing projects before touching code, because a codebase tells you what the code does but not why it's slow or what alternatives exist outside the repo — and the quality of an agent's hypotheses is bounded by the quality of its context. - Don't train the model, evolve the harness Akshay · 2026-04-06 Reader 🖥️
For a model you don't control — a frozen, rented commodity whose weights you can't change — the reliable leverage on agent performance lives in the harness (the code that feeds the model context, runs its tool calls, and decides when a run ends), not in the weights: a benchmark score conflates model and harness, so most apparent 'model failures' are harness failures (often mundane output-plumbing, not reasoning), and the disciplined way to capture that leverage is an automated fitness-selection loop that adds one mechanism at a time and keeps it only when it clearly beats the current best — a process that compounds until the harness runs out of tricks and the residual misses are genuine capability gaps. - Patterns for Reducing Friction in AI-Assisted Development Rahul Garg · 2026-02-24 source ↗ Reader 🖥️
AI coding assistants produce misaligned output not because they lack capability but because developers skip the same onboarding, design discussion, and standards-sharing rituals that make human pair programming effective, and adopting five collaboration patterns that mirror those rituals can transform AI from a source of friction into a force multiplier. - Stop Using /init for AGENTS.md Addy Osmani · 2026-02-23 source ↗ Reader 🖥️
AGENTS.md should hold only project-specific facts an agent cannot discover by reading the code itself — because auto-generated, comprehensiveness-optimized context files duplicate what agents already find on their own and measurably slow and bias them — and the file should function as a living log of unfixed codebase friction to be resolved in the code, not as a permanent, ever-growing configuration. - Harness Engineering Birgitta Böckeler · 2026-02-17 source ↗ Reader 🖥️
Harnesses — the mix of deterministic tooling and LLM-based practices that keep coding agents reliable and maintainable at scale, as demonstrated by OpenAI's 5-month, 1M+-line, no-manually-typed-code project — are likely to become the next generation of service templates, which implies that trustworthy AI-generated code requires giving up some generation-time flexibility (converging on fewer tech stacks and enforced architectural boundaries) in exchange for maintainability, and that retrofitting a harness onto an existing, high-entropy legacy codebase may often not be worth the effort. - Coding Agent Development Workflows Nick Tune · 2026-01-07 source ↗ Reader 🖥️
Making an autonomous coding agent reliable enough to go from ticket to mergeable pull request requires converting as much of the surrounding process as possible into explicit, versioned, tool-agnostic artifacts — deterministic scripts, a single shared source of truth for conventions that every agent and review tool reads, and structured task templates that reject underspecified work — because agent reliability is bounded by the explicitness of what surrounds it, not by the model's capability alone; and the harder unsolved problem this creates for teams and organizations is deciding how explicit conventions must be, who owns them, and at what level (team vs. org) they should be standardized. - No Vibes Allowed: Solving Hard Problems in Complex Codebases – Dex Horthy, HumanLayer AI Engineer · 2025-12-02 source ↗ Reader 🖥️
Solving hard problems in large, brownfield codebases with coding agents requires treating the context window itself as the scarce, team-visible resource to be engineered — through a research/plan/implement workflow with deliberate, frequent compaction — rather than either unreviewed 'vibes' or an over-literal, semantically diffused 'spec-driven development'; and the harder, still-unsolved problem is adapting team workflow, review practice, and culture to a world where most shipped code is AI-authored, not improving the agent tooling itself. - Coding agents have crossed a chasm singleton.io · 2025-06-14 source ↗ Reader 🖥️
Autonomous coding agents have crossed a real capability threshold -- from 'smarter autocomplete' and pair-programming assistance to genuine delegate-to collaborators the author can hand whole tasks to -- which shifts the developer's bottleneck from writing code to framing problems well enough for an agent to reason about them, while the developer's own technical foundation and review discipline remain what separates good AI-assisted outcomes from confidently-wrong ones. - Claude Code: Best practices for agentic coding anthropic.com · 2025-04-18 source ↗ Reader 🖥️
Because Claude Code is deliberately low-level and unopinionated, its effectiveness on your problem is set by the harness you engineer around the model — the context, tools, and workflow you supply — not by the raw model alone. - Transcript for Cursor Team: Future of Programming with AI | Lex Fridman Podcast #447 Lex Fridman · 2024-10-06 source ↗ Reader 🖥️
AI coding tools should be built to maximize the human programmer's speed, control and agency over their code — not to replace programming with natural-language delegation to an autonomous agent — because the hardest and most valuable part of engineering is the dense sequence of small judgment calls that specifying intent upfront cannot capture, and because verifying AI-generated code is at least as hard a problem as generating it.
Propositions touching this concept (24)
By publication month, oldest first (extraction month when no publication date is known).
2024-10
- explicitContext management is a real trade-off, not a solved problem: feeding a model more context makes responses slower and more expensive, and some models actually get more confused with more irrelevant information in the prompt — so retrieval and relevance-filtering quality matter more than raw context-window size.
2025-12
- explicitdevelopedThe author's three-person team achieved 2–3x coding-agent throughput only after spending eight weeks deliberately redesigning how they collaborated around context management — not from better prompting alone.
2026-01
- explicitA central mindset shift for engineers is that the job increasingly means workflow and context engineering rather than writing a given line of code — the goal shifts to improving the process so that line never needs to be manually written again.
2026-02
- explicitOpenAI's harness for a 1-million-plus-line, 5-month, no-manually-typed-code product mixes deterministic and LLM-based components across three categories: context engineering (a continuously enhanced knowledge base plus access to dynamic context like observability data), architectural constraints (enforced by both LLM agents and deterministic linters/structural tests), and 'garbage collection' agents that periodically fight documentation and architectural decay.
2026-03
- explicitThree distinct context-management techniques — compaction (summarize/offload when context nears full), tool-call offloading (keep only head/tail tokens of large tool outputs), and skills (progressive disclosure, loading only front-matter until needed) — exist because today's harnesses are, in large part, delivery mechanisms for good context engineering against context rot.
2026-04
- explicitTwo products built on identical models can differ wildly in performance based solely on harness design; the harness (orchestration loop, tools, memory, context management, verification, guardrails) is the product and is not a commodity layer.
- explicitIn an AI-native company, context management becomes part of management itself.
2026-05
- explicitContext transfer is not the same thing as shared understanding.
- explicitcorroboratedContext management — keeping relevant state across multi-step agent reasoning within token limits — is the dominant technical challenge for systems like this.
2026-06
- explicitIn an analysis of the Claude Code codebase, only 1.6% is AI decision logic; the remaining 98.4% is operational infrastructure (permissions, context management, tool routing, recovery logic).
- explicitThe entire skill filesystem — SKILL.md plus references/, assets/, and scripts/ — should be treated as a deliberate form of context engineering and progressive disclosure: point Claude to files, and it will read them at the appropriate time rather than needing everything loaded up front.
- explicitContext engineering functions as a financial lever, not just a quality one: a dense, high-signal context payload raises an agent's first-pass success rate and avoids the token-burning trial-and-error loops that plague vibe coding.
2026-07
- explicitdevelopedThe agent harness is the complete non-model software wrapping an LLM (orchestration loop, tools, memory, context management, state, error handling, guardrails, verification); the 'agent' is the emergent behavior, the harness is the machinery — 'if you're not the model, you're the harness,' and 'when someone says I built an agent, they mean they built a harness and pointed it at a model.'
- explicitEngineering the model's environment nests in three concentric levels: prompt engineering (the instructions) is inside context engineering (what the model sees and when), which is inside harness engineering (both plus tool orchestration, state, error recovery, verification, safety, lifecycle). The harness is not a wrapper around a prompt.
- explicitcorroboratedA production harness decomposes into a fixed set of named components — the prose walks through eleven (orchestration loop, tools, memory, context management, prompt construction, output parsing, state management, error handling, guardrails/safety, verification loops, subagent orchestration) under a 'twelve components' heading — synthesized across Anthropic, OpenAI, LangChain and the practitioner community.
- explicitestablishedContext management is where agents fail silently: context rot degrades performance 30%+ when key content sits in mid-window positions (Chroma; Stanford 'Lost in the Middle'), even in million-token windows; the fix is not a bigger window but keeping the smallest set of high-signal tokens via compaction, observation masking, just-in-time retrieval, and subagent delegation.
- explicitAn agent framework is essentially a while loop -- cycling through model calls and tool execution until the model yields; an agent harness is the additional layer (context management, memory, persist-and-resume state, self-tracking tools like task lists) needed to sustain long-running, complex, multi-turn tasks beyond what a bare loop supports.
- explicitdevelopedAs models have become capable of longer and more complex reasoning/tool-use chains, Strands's engineering focus has shifted from the reasoning loop itself toward context management, persist-and-resume state, and self-tracking tools -- infrastructure hours-long agentic jobs need that synchronous chat-style agents did not.
- explicitMost current AI practices (prompt engineering, agents, RAG, context engineering, vibe coding, evals) are still emergent and variable rather than stable and codified.
- explicitAn agent harness is the non-model software — the loop, tool execution, context management, state, and safety layer — that surrounds the LLM at runtime, distinct in scope from prompt engineering (a single call) and context engineering (what the model sees).
- explicitHarness overhead (system prompt size, number of tools, active skills/MCP servers) consumes context budget that is scarcer locally than in cloud setups, making harness choice a resource decision as much as a UX one.
2026-09
- explicitAgents lack the tacit institutional memory (hallway conversations, accumulated intuition) that lets human reviewers catch things like an undocumented client dependency; organizations that skip deliberate Context Engineering find their agentic-review failures trace to missing organizational memory, not insufficient model intelligence.
- explicitDelegated reads are cheap to repeat because each invocation is ephemeral and stateless (nothing stored server-side) and the underlying file corpus goes to the worker model and never enters Claude's own context — so re-sending the same files on a follow-up question doesn't cost against Claude's context budget.
2026-10
- explicitcorroboratedFrequent intentional compaction means designing the entire workflow — not individual prompts — around context management and keeping utilization in the 40-60% range throughout, escalating from occasional ad-hoc restarts to a continuous practice.
Tensions
How much of the build pipeline should run with no human reading the code (the 'dark factory')?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): Toward a largely self-evolving software factory where a feature request is 'magically built' into the system; humans build and operate the factory and intervene only at explicit hand-off points.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Deliberately bounded autonomy — keep humans in the loop.
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Dark factories are only safe for organisations that already have high test coverage, skilled engineers, and a high-quality engineering culture; most should cover their fundamentals first.
Assessment: Not simple optimism vs pessimism but a disagreement about preconditions and hidden costs. Ocytko's is a projection of where tooling is heading; Bangser and Verraes both supply reasons the projection is unsafe by default — learning-loss and missing prerequisites. Bangser has the stronger argument that the loss is structural (you cannot buy back organisational learning), which even an improving platform does not address.
How far can day-2 operations be handed to self-healing / autonomous remediation?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): A self-healing platform foundation should make whole classes of failure 'disappear', with increasingly autonomous background 'guardrail' agents refactoring, adding tests, and protecting invariants.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Detection, context, and suggestion are safe wins, but automated remediation must remain an intentional, context-specific decision, not a default end state.
- What Survived Contact (Sam Ruby): Self-healing has, in practice, only moved halfway: diagnosis is automated while remediation is deliberately withheld from the machine.
Assessment: Ruby's report is descriptive (where practice actually stands) and Ocytko's is aspirational (where platforms could go); the gap between 'remediation is withheld' and 'failure modes disappear' is precisely the distance the optimists are projecting across. Bangser supplies the reason the gap may not close on efficiency grounds alone — the withheld human step is also the learning step.
Should the harness/platform-building function be centralised, or emerge per-team?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Notes from FOSE Europe (Giles Edwards-Alexander): Dedicated harness-engineering teams are a mistake; the friction of each team building its own harness is generative and creative.
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): A centralised platform / 'software factory' with tight, low-friction constraints should absorb operational concerns and guide both citizen developers and their agents from the first prompt.
Assessment: A precise split about the organisational form of the scaffolding, not its existence: both want shared architecture guidance, but Edwards-Alexander wants the building capability distributed (friction as feature) while Ocytko wants it concentrated in a platform (constraint as feature). Each concedes the other's pole — Edwards-Alexander keeps a central harness; Ocytko warns against over-constraining — which is why this is a live, unresolved tension rather than a clean contradiction.
Is the value question genuinely settled by evidence, or does uncertainty and sampling bias still dominate?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Notes from FOSE Europe (Giles Edwards-Alexander): The evidence is in; the value is clearly here and here to stay.
- Finding Comfort in the Uncertainty (Annie Vella): Nobody has it figured out; there is more uncertainty than certainty, and the shared set of questions is the real outcome.
- What Survived Contact (Sam Ruby): 'Rigor migrates' is about as settled as this young field gets, but the room is a non-random, incumbent-tilted sample, and the doubt is currently better evidenced than the hope.
Assessment: The single sharpest divergence, and it sits directly under the headline whether-to-how convergence: they narrate the same shift but disagree on what it establishes. Edwards-Alexander and Herlein read the room's confidence as evidence; Vella and Ruby read the same room as a self-selected in-group. Ruby has the better of it methodologically — he is the only one to interrogate the sample and to notice the evidence is asymmetric (upside anecdotal, downside studied), which is uncomfortable precisely because the cohort's confidence is built on the weaker side.
If code is no longer the bottleneck, what is the new binding constraint?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Finding Comfort in the Uncertainty (Annie Vella): Decision capacity and downstream absorption — 'humanity is not ready for this much software'; decision fatigue is becoming the real bottleneck.
- Notes from FOSE Europe (Giles Edwards-Alexander): Learning is the constraint now, not engineering delivery.
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Knowledge — the tacit, unwritten 'why' behind past decisions — is the scarce resource, not code.
Assessment: They agree code/delivery has ceased to be the constraint but name three different successors, with different investment implications — expand decision-making capacity (Vella), optimise for learning (Edwards-Alexander), or capture tacit knowledge (Herlein). These are complementary in principle but rivalrous for attention and budget; the disagreement matters because each implies a different 'first thing to fix.'
Where is the locus of safety for non-engineers / citizen developers building software?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): In a tightly-constrained self-healing platform — not universal upskilling.
- What Survived Contact (Sam Ruby): In the director's management skill — a non-engineer steering an agent has made a hire, and the requirement is that they can manage by objective.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): In API-first, MCP-accessible tooling that supports rather than restricts the new builders.
- Why did Martin Fowler invite 60 engineers to a ski resort? (Ivett Ördög): It is genuinely unsolved — the tension between democratisation and its risks is an open question.
Assessment: Four different answers to the same governance question: the platform (Ocytko), the director's discipline (Ruby), the tooling interface (Bangser), or nobody-knows-yet (Ördög). Ruby and Ocytko are the true opposites — Ruby puts the burden on a human management skill, Ocytko designs the human out by making failure modes disappear in the platform. That both are held by attendees of one retreat is a measure of how unsettled the citizen-developer problem is.
Will the classic fundamentals (especially DDD / domain modelling) actually deliver this time — is the revival evidenced or merely asserted?
from: What did the participants of the Thoughtworks 'Future of Software Engineering' Europe retreat (mid-2026) conclude about how agentic AI is reshaping software engineering?
- Notes from FOSE Europe (Giles Edwards-Alexander): Skeptical: domain modelling kept being proposed, but it is not a new idea and never became the standard before — why would it suddenly work now?
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Evidenced: feeding an agent an explicit domain model first yields better code structure and database performance, and bounded contexts also reduce token cost.
- Jimmy Nilsson's Post — reflections after the Thoughtworks 'Future of Software Development' retreat (Jimmy Nilsson): Asserted: DDD, XP, TOC, TDD, BDD, CD are 'more important than ever' in the agentic age.
Assessment: The single slogan 'fundamentals matter more' spans concrete evidence (Verraes), unargued assertion with admitted bias (Nilsson), and active skepticism (Edwards-Alexander) — from attendees of one retreat. This directly exposes the 'the fundamentals are agreed' assumption below: the cohort's flagship convergence is doing a lot of work with very uneven support underneath it.
What is the right metaphor for the human-AI relationship in coding?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Patterns for Reducing Friction in AI-Assisted Development (Garg): AI is a teammate — treat it like a junior pair programmer who needs onboarding, context, and rituals.
- Harness engineering for coding agent users (Böckeler): AI is a system to be governed — the cybernetic governor model with feedforward and feedback controls.
- Agent Harness Engineering (Osmani): AI is a runtime to be engineered — the harness is an engineering artifact, not a social relationship.
- Looking back at the Future of Software Engineering unconference (Thoughtworks): AI is a new organizational participant — Conway's Law applies, and agent topologies must be designed.
Assessment: These metaphors are not mutually exclusive but they lead to different design decisions. Garg's teammate metaphor emphasizes collaboration rituals and may underplay the need for hard constraints (you don't sandbox a teammate). Böckeler's governor metaphor is the most theoretically rigorous but may overclaim the applicability of control theory to creative work. Osmani's engineering metaphor is the most actionable but may miss the social and organizational dimensions. Thoughtworks' organizational metaphor captures the broadest scope but is the hardest to operationalize.
Will better models make current harness practices obsolete?
from: What is the right approach to building harnesses around AI coding agents, and where are the limits?
- Agent Harness Engineering (Osmani): Harnesses don't shrink, they move — better models create new failure modes at higher capability levels.
- Genie Tarpit (Beck): The Bitter Lesson (scale + compute) is listed as one possible solution — implying better models might eventually solve the problem without harnesses.
- Patterns for Reducing Friction in AI-Assisted Development (Garg): Does not address model improvement — the framework lacks a theory of its own obsolescence.
Assessment: Osmani makes the strongest case for permanence with concrete evidence of scaffolding migration. Beck keeps the door open for the Bitter Lesson hypothesis. The truth likely depends on the type of harness: mechanical safeguards (sandboxes, permission controls) may always be needed, while knowledge-transfer patterns (AGENTS.md, priming docs) may become less necessary as models improve at in-context learning.
Is the model a swappable, commoditized component (so selection is a cost decision), or is model choice load-bearing (so selection is a capability decision)?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. (musistudio): Swap camp: the model is fungible config behind Claude Code's durable harness; route each sub-task to the cheapest capable model across many providers and keep the harness.
- Hugging Face's Clem Delangue: Stop Comparing Engines to Cars (Turing Post (Ksenia Se interviewing Clem Delangue)): Swap camp: open weights are not 'behind' — they only look weaker because harnesses were optimized for proprietary APIs; the gap is a harness artifact.
- The Pulse: a new trend, smart model routing (The Pragmatic Engineer (Gergely Orosz)): Swap camp: 'which model to use' is shifting from a deliberate engineering decision to a commoditized, automatable one; open models cover ~60% of coding work by token spend.
- Coding Models Are Doing Too Much (nrehiew.github.io): Load-bearing camp: model choice materially changes output quality — the spread is enormous on the exact behavior that matters for brown-field editing.
- [MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796 (stellaraccident (via https://github.com/anthropics/)): Load-bearing camp: the specific model and its reasoning allocation are structurally required; degrading the SAME model catastrophically broke a proven workflow.
- Claude Code: Best practices for agentic coding (Anthropic (Claude Code best practices guide)): In the middle / silent: treats 'Claude' as one undifferentiated model and never addresses model selection at all.
Assessment: Both camps are right about different task strata, and the tie is broken by the routing camp's own artifact. Commoditization holds on the bulk/background tier (musistudio and the Pragmatic Engineer are correct that a cheap or open model suffices for a large share of tokens), but model choice is load-bearing exactly on the hard tier — the 'hardest 40%' the routing camp routes AWAY (the Pragmatic Engineer's own gap notes 60%-of-token-spend is not 60%-of-value). nrehiew's 6.5x over-editing spread and stellaraccident's collapse are measured on precisely that hard tier. The clincher the swap camp does not concede: musistudio's OWN per-model transformers (tooluse, enhancetool, reasoning, deepseek, gemini) prove the harness is NOT model-agnostic — every model needs bespoke request/response rewriting just to work behind Claude Code, so the 'any model' artifact self-refutes. Delangue even concedes the frontier gap himself. Verdict: select cheap-and-swappable for bulk, and treat the model as a load-bearing capability decision for the hardest slice — the two positions are not competitors but a partition of the task distribution.
Effort/reasoning: does more thinking make output better, or does more reasoning make it worse (over-engineering / over-editing)?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- [MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796 (stellaraccident (via https://github.com/anthropics/)): More thinking is better and structurally required: reducing thinking depth caused a catastrophic, measurable quality regression.
- Prompting Claude Fable 5 (Claude Platform Docs): More reasoning over-produces: higher effort yields unrequested tidying, refactoring, and over-planning that must be actively suppressed.
- Coding Models Are Doing Too Much (nrehiew.github.io): Reasoning is a double-edged sword: reasoning models over-edit MORE by default, yet respond BEST to explicit constraints and become the most faithful editors.
- Claude Code: Best practices for agentic coding (Anthropic (Claude Code best practices guide)): Middle: scale the thinking budget to difficulty via the think < think hard < ultrathink ladder.
Assessment: This looks like a head-on collision but is really the corpus resolving a category error, so I keep it as a divergence-under-adjudication rather than a live two-camp fight. The two things bundled into one 'effort' dial are separable: reasoning DEPTH (deliberation and research before acting — what stellaraccident measures as the Read:Edit ratio) versus action SCOPE (how much the model rewrites — what nrehiew measures as over-editing). They are separable but DEFAULT-COUPLED: more reasoning, unconstrained, tends to produce more scope. nrehiew is the empirical bridge — constrained reasoning models are the MOST faithful, proving depth and tight scope combine positively when you address them separately. Fable 5 already acts on this, pairing 'reduce effort' with a distinct anti-over-engineering instruction. The actionable verdict: do NOT cut reasoning depth to fix over-editing (that is stellaraccident's exact grievance and it backfires into shallow, edit-first behavior); keep the depth and add an explicit scope constraint. The failure is treating one knob as if it controls both correctness-depth and edit-scope.
Who selects the model/effort/context — a human deciding per task, or an automatic router — and who is trusted to hold the dial?
from: When working with AI coding agents, how should you select the model, its reasoning/effort level, and its context size for a given task?
- Charlie Hills 🦩's Post (Charlie Hills 🦩): Human selects: the developer manually assigns Opus to think and Sonnet to build.
- Claude Code: Best practices for agentic coding (Anthropic (Claude Code best practices guide)): Human selects: the user picks the thinking level (think/ultrathink) and configures the tools per task.
- The Pulse: a new trend, smart model routing (The Pragmatic Engineer (Gergely Orosz)): Auto-router selects — but beware who owns it: an intelligent router (or Cursor 'Auto') picks the cheapest capable model automatically.
- GitHub - musistudio/claude-code-router: Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic. (musistudio): Semi-automatic, user-owned rules: config-driven scenario routing plus custom-router JS and subagent pinning.
- [MODEL] Claude Code is unusable for complex engineering tasks with the Feb updates #42796 (stellaraccident (via https://github.com/anthropics/)): The dial must be transparent and user-controllable: the real harm was the PROVIDER silently rationing the effort dial.
Assessment: The human-vs-auto axis is less about capability than about (a) whether task difficulty can be detected a priori and (b) who bears the principal-agent risk. No router in the corpus actually measures difficulty — musistudio routes by token-count and static scenario, and the Pragmatic Engineer's routers infer 'good enough' without a demonstrated oracle — so 'auto' today means 'static-heuristic', not 'optimal'. Automation is safe when the user owns the policy (musistudio) and dangerous when the router profits from the choice (Cursor Auto) or when the provider adjusts the dial invisibly (stellaraccident). Verdict: keep the human holding the difficulty judgment and the effort dial until routers can both measure adequacy and prove neutral incentives; automate only the mechanical dispatch, over rules you own and can audit.
Where does the non-delegable human asset now live — the harness/platform, the oracle, the fundamentals, or the developer's understanding?
from: What is the future of software development in the agentic/AI age?
- Notes from FOSE Europe (Giles Edwards-Alexander): In the harness — the continuously-evolving scaffolding of architecture guidance and rigour around the agents — though it must stay team-distributed, not centralized.
- What Survived Contact (Sam Ruby): In the oracle — the objective's evaluation is the single thing the person directing the model cannot delegate back to it.
- Jimmy Nilsson's Post — reflections after the Thoughtworks 'Future of Software Development' retreat (Jimmy Nilsson): In the fundamentals plus a renewed 'Extreme Humanism' — the durable disciplines and the conspicuously human element.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): In right-sized boundaries and the operational loop — humans must stay in operations because their learning is the irreplaceable asset.
- Fragments: February 9 (Martin Fowler (Feb 9)): In the developer's model-building and shared understanding — the craft of devising abstractions to reason about the domain.
Assessment: This is the deepest structural disagreement — every author agrees a human residue remains but nominates a different residue, and the choice determines what to invest in and what to teach. The harness-centric (Edwards-Alexander), oracle-centric (Ruby), fundamentals-centric (Nilsson/Bangser), and understanding-centric (Fowler) camps are not merely emphases: they imply different career ladders, different hiring, and different failure modes. Ruby's oracle and Bangser's operational-learning are the most operationally concrete; Nilsson's is the least argued. The absence in the corpus of anyone who holds 'nothing is non-delegable' is itself telling (see unexamined assumptions).
Should the harness/platform and its safety be centralized or left distributed across teams?
from: What is the future of software development in the agentic/AI age?
- Notes from FOSE Europe (Giles Edwards-Alexander): Distributed — dedicated harness-engineering teams are a mistake; per-team friction in building harnesses is creative and generative.
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): Centralized — safety for non-engineers should come from a tightly-constrained, self-healing platform that ships access and data guardrails.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Centralized enabling layer — platform, SRE, and ops teams should provide API-first, MCP-accessible tooling that others safely consume.
- Fragments: February 18 (Martin Fowler (Feb 18)): Centralized golden path — platform teams should provide fast-but-safe 'bullet trains' with security built in by default.
Assessment: A real operating-model split. Edwards-Alexander's distributed stance rests almost entirely on the DevOps-team analogy (his own extraction flags it as asserted-on-intuition, not argued), whereas the platform camp has the stronger concrete case for the citizen-developer safety problem — you cannot distribute production-data guardrails to non-engineers. The tension is partly reconcilable: Ocytko himself concedes a platform tight enough for non-engineers may be too constraining for expert engineers' identity and innovation, which is exactly the freedom Edwards-Alexander is protecting. The unresolved question is whether one platform can be both.
How far should software be automated — toward the fully-autonomous dark/software factory, or held back to bounded autonomy with humans in the loop?
from: What is the future of software development in the agentic/AI age?
- Why did Martin Fowler invite 60 engineers to a ski resort? (Ivett Ördög): Full automation is genuinely viable in context and she is 'ironically' being pulled toward the dark-factory camp.
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): The aspirational endpoint is a largely self-evolving software factory; humans build and operate the backbone rather than the application.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Bounded autonomy — keep humans in the operational loop; automated remediation must stay an intentional decision.
- What Survived Contact (Sam Ruby): Self-healing has stalled halfway on purpose: diagnosis is automated, remediation withheld from the machine.
- Software Design in the Agentic Age: Place Your Bets (Mathias Verraes): Dark factories are safe only for orgs that already have high test coverage, skilled engineers, and a quality culture; most should cover fundamentals first and stay revertible.
Assessment: The spectrum runs from Ördög/Ocytko (full automation is arriving and desirable) to Bangser/Ruby/Verraes (deliberately withhold the last step). The decelerationists have the better of the safety argument today — Ruby's 'nobody will cede the blast radius' and Bangser's 'removing humans removes learning' identify concrete, unmet prerequisites — but Ördög's context-dependence (backends, COBOL) shows the boundary is domain-specific, not absolute. The real disagreement is less about capability than about who absorbs the blast radius when an autonomous fix goes wrong.
If code was never the bottleneck, what is the binding constraint now?
from: What is the future of software development in the agentic/AI age?
- Finding Comfort in the Uncertainty (Annie Vella): Human decision capacity and downstream absorption — 'decision fatigue is becoming the real bottleneck.'
- Notes from FOSE Europe (Giles Edwards-Alexander): Learning — 'learning is the constraint now, not engineering delivery.'
- We've Stopped Arguing About Whether AI Changes Software (Greg Herlein): Knowledge — the tacit, unwritten 'why' is the scarce resource agents starve for.
Assessment: A productive three-way split downstream of the shared 'code was never the bottleneck' finding. They are not incompatible so much as differently located — decision capacity (Vella) is organisational, learning (Edwards-Alexander) is about the team's rate of understanding the problem, and knowledge (Herlein) is about capturing rationale. But they imply different investments: expand downstream absorption, restructure around learning, or build knowledge-capture pipelines. The corpus has not reconciled which is the true binding constraint, and each author generalizes from a different vantage (a retreat-floor convergence, an org-design frame, a knowledge-engineering frame).
How should newly-empowered citizen developers be made safe — constrained platform, human stewardship, or supported API-first tooling?
from: What is the future of software development in the agentic/AI age?
- Looking back at the Future of Software Engineering unconference (Bartosz Ocytko): A tightly-constrained, self-healing platform — not universal upskilling — should absorb citizen developers.
- The "funhouse mirror": How AI reflects the hidden truths of your software pipeline (Rachel Laycock (interviewed by The New Stack)): Senior technologists must act as stewards — teaching the 'why' and building guardrails, not gatekeeping or replacing juniors.
- AI Is Changing Software Engineering. The Fundamentals Still Matter. (Abby Bangser): Support, don't restrict — provide API-first, MCP-accessible tooling that non-engineers can safely consume.
Assessment: All three agree citizen developers are inevitable and must not be blocked, but the safety mechanism differs — encode it in a constraining platform (Ocytko), transfer it through human relationships (Laycock), or expose it as consumable interfaces (Bangser). Ocytko's platform-first case is strongest on the specific failure mode both he and Ördög name (non-engineers leaking or bypassing production-data access), which stewardship alone cannot prevent at scale. Laycock's stewardship answers a different problem — sustaining the junior-to-senior pipeline — that a platform does not. The positions are complementary in principle but compete for the same finite investment, and none supplies a concrete governance model for vibe-coded shadow IT.
Open gaps (100)
- scopeAll referenced engineering principles come from Google. No acknowledgment that different organizational contexts (startups, regulated industries, open-source projects) may need different trade-offs.Agent Skills: Google-Backed AI Coding Agent Workflow — read next: Literature on context-dependent software engineering practices; critique of one-size-fits-all process frameworks.
- incompleteThe '--help as embedded SKILL.md' pattern assumes the --help text stays accurate, complete and token-cheap as the tool grows. The piece does not consider --help drift (help falling out of sync with behavior), how a large tool's full --help fits an agent's context budget, or when the embedded-skill approach should give way to a real SKILL.md or progressive disclosure.Have your agent record video demos of its work with shot-scraper video — read next: Agent-native design and progressive-disclosure/token-efficiency literature; compare with SKILL.md ecosystem write-ups on versioning and staleness.
- incompleteAll three case studies are well-resourced, AI-forward organizations (Block at 3,500 engineers with 90% daily AI tool usage; Cloudflare operating at web infrastructure scale; DryRun Security built AI-native from day one). The paper never addresses whether a smaller, legacy-constrained, or less-funded team can afford the Context Engineering and Multi-Agent Reviews infrastructure it recommends, or what a minimal-viable version of the pattern language looks like.Agentic AI and Code Reviews — read next: Look for case studies or guidance from smaller teams or resource-constrained organizations adopting agentic code review, to see which patterns remain accessible without Block/Cloudflare-scale investment.
- implicit premiseThe argument that 'more context degrades output' treats current LLM context-handling limitations as a stable architectural constraint rather than a temporary engineering limitation. If context handling improves significantly, the 'deterministic guardrails' prescription may need rebalancing.Agents don't know what good looks like. And that's exactly the problem. — read next: Research on long-context model performance, retrieval-augmented generation, and structured context management.
- incompleteThe evidence is anecdotal and constrained by the Chatham House Rule; the one quantified claim — that a modular refactor improved token usage and solution quality — is a single hallway-track data point with no magnitude, methodology, or generality.AI Is Changing Software Engineering. The Fundamentals Still Matter. — read next: Look for controlled studies on codebase modularity and file granularity versus LLM token cost and solution quality.
- incomplete'Right-sizing' is presented as clearly beneficial, but the author concedes many are 'still figuring out which primitives they are and how best to invest in them' — the piece provides no heuristic for finding the right boundary or context size.AI Is Changing Software Engineering. The Fundamentals Still Matter. — read next: Read on modularity heuristics such as Ousterhout's deep modules, and on context-window budgeting for LLMs.
- incompleteNo mechanism is given for *why* a model loses the ability to understand/maintain what it built — is it a context-window limit, a lack of persistent memory across sessions, an inability to re-derive prior design intent, or something else? Without naming the mechanism, 'iron grip on system size' is a size-based proxy for an underlying limit that isn't specified.All models, no matter how smart, will eventually build systems... — read next: Read against Anthropic's own Fable 5 prompting guidance (extract-how-to-actually-prompt-fable-5, extract-prompting-claude-fable-5) for its treatment of persistent memory and long-running-agent scaffolding, and against context-engineering material for named mechanisms (context window exhaustion, context rot) that would explain the 'outbuilt itself' failure concretely.
- incompleteThe decomposition is not orthogonal and specifies no module boundaries. Four of the named components — memory (3), context management (4), prompt construction (5), and state management (7) — are views of a single 'what the model sees / what persists' concern (Claude Code's git-commits-as-checkpoints sits under state, MEMORY.md under memory, compaction under context, prompt assembly under construction, but they are one persistence-and-window problem wearing four hats). Guardrails/permission (9) is not disjoint from tools (2) — the walkthrough runs the permission check INSIDE tool execution (step 4). Output parsing (6) is near-vestigial under native tool calling (a sub-step of the loop, not a peer module). And the orchestration loop (1) is a LEVEL above the contents it manages, not a coequal component ('the complexity lives in everything the loop manages'). The prose enumerates eleven items under a 'twelve components' heading. So the list reads as a practitioner checklist organized by mechanism and vendor vocabulary, not a coupling-minimizing partition into high-cohesion modules — it cannot tell you where to actually cut the system.The Anatomy of an Agent Harness — read next: Read Parnas ('On the Criteria To Be Used in Decomposing Systems into Modules'), Yourdon & Constantine on coupling/cohesion, and Ousterhout on deep modules; re-derive the harness as narrow-interface deep modules and test which of the eleven are genuinely separable versus one persistence/context responsibility split four ways — the structured-design question the piece's naming step presupposes but never answers.
- incompleteAnatomy without failure-mode interactions. The seven-step walkthrough gives happy-path dynamics only; the piece never addresses how components interfere when things go wrong — compaction (context management) discarding state the verifier still needed, a guardrail tripwire firing mid-tool-call and leaving state half-written, or a memory 'hint' that contradicts actual state after a context reset. The hardest engineering lives in these cross-component failure interactions, which the static list and the clean walkthrough elide.The Anatomy of an Agent Harness — read next: Read extract-anthropic-harness-design-long-running-application-development and extract-anthropics-three-agent-harness on context-reset handoff artifacts and evaluator calibration; look for how components must expose contracts to survive each other's failures rather than only cooperating on the happy path.
- incompleteNo interface or contract between components is specified. The piece names components but never states what each EXPOSES to the others — what memory hands to context management, what guarantees the loop makes to the tool layer, what verification consumes and returns. Without interface contracts, the 'independently improvable' premise (p13/p14) that the sibling's fitness-selection strategy depends on is unverified: 'add one mechanism' only stays local if the components are actually decoupled, which the piece asserts by layout rather than by design.The Anatomy of an Agent Harness — read next: Read on module interfaces/APIs (information hiding, contracts) and re-examine the sibling's automated 'add one mechanism, keep if better' loop to check whether a change to one component ripples across the coupled memory/context/state cluster.
- incompleteTwo overlapping taxonomies whose relationship is left unstated. The twelve components and the seven decisions substantially overlap: decisions 3/4/5/6 (context-window strategy, verification design, permission architecture, tool scoping) simply re-open components 4/10/9/2 as 'choices,' while only decisions 1/2/7 (single-vs-multi-agent, ReAct-vs-plan-execute, harness thickness) are architectural choices not already a component. The piece presents both frameworks without saying whether the seven decisions are just the tunable parameters of a subset of the twelve components.The Anatomy of an Agent Harness — read next: Consolidate into one model — components as nouns (what the harness contains) versus configuration axes as verbs (how each is set) — and test whether 'seven decisions' collapses into 'the tunable dials on four of the components,' leaving only single-vs-multi-agent, ReAct-vs-plan, and thickness as genuinely first-order architecture.
- incompleteThe post summarizes slide decks (149 pages) that are only available as images. The textual content is a curator's frame, not the primary source material. Key details, evidence, and nuance from the actual presentations are inaccessible.Jacob Langvad Nilsson's Post — read next: Access the original slide decks or video recordings if available to extract the full arguments from each talk.
- incompleteThe 'data sovereignty' claim from the Velatir talk is mentioned without elaboration. Why has it become a strategic necessity specifically for AI-native fast-scaling companies?Jacob Langvad Nilsson's Post — read next: Investigate the original Velatir presentation for the sovereignty argument, likely related to EU data regulations and LLM provider data handling.
- incompleteThe post does not address how these practices interact with different AI coding tools beyond Claude Code. The entire meetup is Claude Code-specific, but the thesis about structure seems tool-agnostic.Jacob Langvad Nilsson's Post — read next: Compare with practitioner reports from GitHub Copilot, Cursor, or other AI coding tool communities to test whether the structure thesis generalizes.
- incompleteCentralizing ownership, criticality, and dependency data for an entire organization into one queryable layer that both agents and humans access creates a high-value single target; the piece describes access controls inherited from human permissions but never discusses the security posture of the Context Lake itself as an attack surface (e.g., what happens if an agent's session is compromised — it now has structured, pre-digested access to the organization's ownership and criticality map, arguably a richer target than scattered raw APIs).
- incompleteCutler treats fiefdoms as cultural-political artifacts produced by unwilling leaders and self-interested fief-heads. He does not engage with the genuine structural pressures that may force fiefdom-like structures: capital-allocation cycles, headcount accounting, regulatory accountability, the way investors and boards read org charts, the difficulty of cross-fiefdom budgeting in a quarterly cadence. If those structural pressures are real, the 'hard choices' framing is too voluntarist.AI Won't Save the Kingdoms We Built — read next: Read management-accounting and capital-allocation critiques (e.g., Beyond Budgeting Round Table — Bjarte Bogsnes; Robert Simons on accountability systems; Niels Pflaeging on cell-structure designs). Also: Henry Mintzberg on configurations as responses to environmental contingency, not pathology.
- incompleteThe essay names 'coordination theater' but offers no test to distinguish it from real coordination in flight. Without a diagnostic, the concept risks becoming a rhetorical move rather than an operational lens.AI Won't Save the Kingdoms We Built — read next: Pair with Cutler's own prior work on operating systems / TBM 412 (institutional overload), and with explicit decision-rights frameworks (RAPID, DACI) that surface where decisions actually get made vs. where they are documented.
- incompleteThe 'people with a bias toward working alone' characterization is psychological, not structural. It does not interrogate why an organization rewards or selects for that bias — which is itself a fiefdom-era artifact (individual P&L-style accountability, individual performance ratings, etc.).AI Won't Save the Kingdoms We Built — read next: Allen Holub on accountability culture; Edmondson on psychological safety; Cutler's own earlier writing on directly-responsible-individuals and accountability culture.
- incompleteThe essay addresses leaders and the front lines but is silent on the middle layer — the fief-leaders themselves as actors who must decide whether to dissolve their own kingdoms. Their incentive structure is sketched (self-interest) but not engaged as a design problem.AI Won't Save the Kingdoms We Built — read next: Schein on organizational culture and middle-management as load-bearing; classic literature on 'turkey voting for Thanksgiving' problems in restructurings.
- incompleteNo binding-constraint diagnostic. The whole thesis presupposes the harness — not the model's capability ceiling — is what limits your task, but the piece offers no way to tell in advance whether a given task is harness-bound or capability-bound; you only learn which after gains flatten. The headline example (file-plumbing, 0% -> parity) is a selected case where the harness was the entire story and does not generalize to reasoning-bound tasks. This is the Meadows leverage-point question left unanswered.Don't train the model, evolve the harness — read next: Read Boeckeler's adaptive-control harness framing and Anthropic's 'remove components one at a time, keep only the load-bearing' methodology, looking for a procedure that predicts, before investment, which constraint binds — e.g. a cheap probe that separates 'model got the answer but the wrapper lost it' from 'model can't do this at all.'
- incomplete'Don't train' vs 'evolve the harness' is a soft strawman. Fine-tuning is never actually analyzed — no cost, no cases where training genuinely IS the right lever (domain shift, latency/cost at scale, proprietary capability the frontier lacks). For a rented frontier model the real contrast is harness-vs-nothing, so the title over-generalizes into 'never train.'Don't train the model, evolve the harness — read next: Read a fine-tuning cost/benefit source to bound when weight-changing is warranted, so the 'harness-first' heuristic has an explicit boundary rather than an absolute.
- incompleteThe automated 'add one mechanism, keep if better' loop has no pruning or garbage-collection step, so accreted mechanisms can ratchet harness complexity upward — precisely the cost the quoted deep-dive warns against (scaffolding should shrink; tight model-coupling creates lock-in). The maintenance and portability cost of an ever-growing auto-generated harness is named in the abstract but never quantified or bounded.Don't train the model, evolve the harness — read next: Read on harness co-training overfitting and the 'delete components one at a time' methodology; look for how an automated harness search can be given a complexity penalty or removal operator so it thins rather than only accretes.
- incompleteSecond-hand, single case, no first-party numbers. The entire empirical spine is one relayed Hugging Face experiment (7x cost, 14-point transfer, 3.5-80.1% spread) with no reproducible benchmark, dataset, task definition, or independent replication — thin ground for a rigorous adopter to act on.Don't train the model, evolve the harness — read next: Read the source Hugging Face post directly and seek independent harness-ablation studies before treating the 7x / 3.5-80.1% figures as generalizable.
- incompleteThe transfer of the 'cognitive artifacts' framework from human cognition to LLM systems is asserted but not defended. Human cognitive artifacts augment a general intelligence; LLM externalization compensates for specific architectural limitations (finite context, no persistent state). The analogy may be more misleading than illuminating.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Look for critiques of anthropomorphic framings of LLM capabilities; compare with distributed systems or compiler theory as alternative analogies.
- incompleteThe taxonomy assumes memory, skills, and protocols are 'distinct but coupled' — but the boundaries may be artificial. A skill with embedded memory and protocol-like interfaces blurs all three categories. The abstract does not address how to handle such overlap.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Check whether the full paper provides clear criteria for categorizing borderline cases.
- uninformedThe abstract does not address whether externalization introduces new failure modes (brittleness, composability failures, versioning conflicts) that may offset reliability gains. The framing is almost entirely positive.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Look for systems engineering literature on integration risk; check if the full paper's 'open challenges' section addresses this.
- illogicalThe historical progression 'weights -> context -> harness' is presented as a clean trajectory, but in practice these co-evolve. Larger context windows reduce the need for some externalization; better weights reduce the need for elaborate harnesses. The narrative oversimplifies.Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering — read next: Consider whether a co-evolutionary or dialectical framing would be more accurate than a linear progression.
- uninformedThe piece arrives at its fleet-sizing and context-budget numbers from a single incident without engaging existing multi-agent/harness literature that already proposes related numeric or structural heuristics — e.g. Osmani's 'correct number of parallel agents equals the number you can review' (tied to human review capacity rather than orchestrator context) or Zuill/Herr's practice of keeping an agent's context window around half-full by moving detail into on-demand skill files.The Orchestrator's Tax — read next: extract-osmani-orchestration-tax-is-you and extract-software-teaming-age-of-ai-zuill-herr, both already in the corpus, offer adjacent-but-distinct anchors for the same class of threshold.
- incompleteThe article treats AI as equivalent to a junior developer, but AI has fundamentally different failure modes — it can be confidently wrong in ways juniors rarely are, and it lacks the ability to say 'I don't understand the requirement.' The junior-developer analogy may lead to under-investment in verification.Patterns for Reducing Friction in AI-Assisted Development — read next: Research on AI confabulation/hallucination in code generation; studies comparing AI and human error patterns in software development
- incompleteThe framework assumes the developer can articulate their conventions and constraints explicitly enough for AI to follow. This is Polanyi's paradox — we know more than we can tell. The Sensible Defaults pattern may hit a ceiling where the most important quality signals are precisely the ones hardest to codify.Patterns for Reducing Friction in AI-Assisted Development — read next: Polanyi's 'The Tacit Dimension'; research on knowledge management and the limits of codifying expert judgment
- incompleteNo discussion of how these patterns interact with rapidly improving AI capabilities. If AI models become better at inferring project conventions from code context, some of these patterns (especially Knowledge Priming) may become unnecessary. The framework lacks a theory of its own obsolescence.Patterns for Reducing Friction in AI-Assisted Development — read next: Papers on in-context learning improvements in LLMs; research on retrieval-augmented code generation
- incompleteThe article focuses entirely on individual developer-AI interaction. There is no treatment of how AI collaboration patterns interact with team dynamics — e.g., whether standardized prompts reduce healthy variation in approach, or whether shared priming docs create new coordination costs.Patterns for Reducing Friction in AI-Assisted Development — read next: Research on coordination costs in software teams; Brooks's 'The Mythical Man-Month' on communication overhead
- uninformedNo engagement with the existing literature on human-AI teaming from other domains (aviation, medicine) where collaboration frameworks have been developed and empirically tested for decades.Patterns for Reducing Friction in AI-Assisted Development — read next: Research on crew resource management (CRM) in aviation; human-AI teaming frameworks from DARPA and military contexts
- incompleteNo measurable outcomes. 'Hundreds of hours/month' is unanchored to a baseline, a denominator, an accuracy figure, or a cost. There is no comparison to a non-agentic automation alternative (scripts, RAG-only chatbot, runbook automation).Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab — read next: Look for the original Grab Tech Blog post (engineering.grab.com/from-firefighting-to-building) for the actual numbers; if absent there too, this is a marketing artifact, not an engineering report. Compare to DORA-style AI productivity measurement methodology.
- incompleteThe article never offers a metric or boundary that distinguishes 'agent' from 'automation script'. The architecture as described (classify -> route -> tool-call under a supervisor, with constrained responsibilities and HITL on writes) is mostly compatible with a deterministic workflow engine plus LLM classifiers.Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab — read next: Anthropic's 'Building effective agents' (Schluntz & Carr) on workflows vs. agents; Simon Willison on the agent-definition problem; HumanLayer / Vercel's agent taxonomy work.
- incompleteThe supervisor's actual role is described abstractly ('controls communication flow and task delegation') but not behaviorally. Does it re-plan on failure? Loop? Spawn new agents? Without that, the 'multi-agent' label may be doing rhetorical work the architecture does not earn.Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab — read next: LangGraph supervisor docs and Cognition AI's 'Don't Build Multi-Agents' essay arguing most 'multi-agent' systems are sequential pipelines mislabeled.
- incompleteNo discussion of failure modes: hallucinated SQL passing validation, MRs that look correct but introduce regressions, automation bias in reviewers, drift as the platform changes under the agents' indexed context.Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab — read next: Literature on automation bias in code review; Google's 'AI in software engineering' DORA findings on review burden.
- incompleteContext management is named as the hardest problem and dispensed with in one sentence. 'Structured context compression and selective retrieval' is not described as a technique.Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab — read next: The original Grab post; Anthropic's context-engineering write-ups; recent work on agent memory architectures (e.g., MemGPT-style hierarchies).
- uninformedAuthor writes about Grab's system at a level entirely derivable from the company blog and a LinkedIn post; there is no independent reporting, no quote that wasn't already public, no comparison to other companies' similar systems.Designing a Multi-Agent System for Engineering Support at Scale: A Case Study From Grab — read next: Go to the primary source. Compare to Uber, Shopify, Stripe internal-tooling agent write-ups for triangulation.
- incompleteThe article names 'integration challenges in daily workflows' and reports the symptom (grep can feel faster on mid-sized repos) but never diagnoses the mechanism. Independent verification (WebSearch + direct fetch, done during this extraction, of Kevin Kinnett's actual hands-on review and a separate technical Graphify-vs-code-review-graph comparison) surfaces the real causes the article omits: Graphify's own `GRAPH_REPORT.md` summary output came out blank on Kinnett's run, breaking the intended 'Claude reviews the report before searching files' workflow; the Claude Code hook that reminds the agent a graph exists added latency without offsetting benefit, so Claude fell back to ordinary search anyway; and a measured multi-hour session on a 1,336-node monorepo found Graphify's BFS-based queries can cost more tokens than grep for targeted symbol lookups (~1,532 vs ~594 tokens) and its incremental graph-update (~10s) is too slow to trigger on every tool call without risking CPU/RAM exhaustion, so it can only safely run as a git post-commit hook. Kinnett's own four prerequisites for daily-driver adoption — reliable (non-silent-failing) output, conditional deactivation when data is stale/incomplete, human-readable summaries instead of raw graph.json, and frictionless automatic freshness — name precisely the gap between 'conceptual promise' and 'daily workflow' this article gestures at but never itself explains.Graphify: Unifying Codebase Context to Streamline Agentic Software Engineering — read next: Kevin Kinnett, 'Graphify Review: I Tried It on My Codebase With Claude Code' (https://www.kevinkinnett.com/posts/graphify-review-claude-code-knowledge-graph/); and the Graphify-vs-code-review-graph technical comparison (https://dev.to/mir_mursalin_ankur/graphify-code-review-graph-build-a-self-updating-knowledge-graph-for-claude-code-and-other-ai-j1m) for the measured token/latency data.
- incompleteNowhere does the article discuss how the knowledge graph stays synchronized as the underlying codebase changes — re-indexing frequency, staleness windows between an edit and the graph reflecting it, or rebuild cost on large repositories. This corpus's Cassie Shum talk on knowledge graphs for agentic systems treats exactly this kind of overhead as the deciding factor in whether a graph is worth adopting at all.Graphify: Unifying Codebase Context to Streamline Agentic Software Engineering — read next: extract-knowledge-graphs-agentic-ai-systems's Q&A discussion of graph overhead scaling with graph/data size and traversal design.
- incompleteThe talk's two headline successes (the BAML one-shot fix, the 35,000-line 7-hour session) and its one named failure (the Hadoop removal) are all personal anecdotes from the author's own small team and network, delivered by a founder actively promoting his own company's product (HumanLayer, explicitly pitched at the talk's close). There is no systematic success-rate measurement, no control group, and no accounting of how much total effort — including the research and plans he says were 'thrown out' along the way — went into producing the showcased wins, leaving open whether the research/plan/implement discipline reliably generalizes beyond founder-level, highly motivated use.No Vibes Allowed: Solving Hard Problems in Complex Codebases – Dex Horthy, HumanLayer — read next: Look for independent, outcome-measured adoption of research/plan/implement-style workflows outside HumanLayer's own network and marketing, ideally with quantified success/failure rates across many tasks.
- incompleteProvenance is asserted, not sourced, and the title oversells it. 'Straight from the team that built it' implies insider access, but the body reveals the actual source is Anthropic's PUBLIC official prompting guide, relayed by an anonymous X account with no link to the guide, no author attribution, and no way to see what was faithfully relayed versus added or distorted. The persuasive authority exceeds the sourcing.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Read the primary guide directly (extract-prompting-claude-fable-5) instead of this relay; treat 'straight from the team' as marketing, not provenance. Locate and confirm the thread-only specifics — the ultrathink/ultracode keywords, the thinking.display value semantics, the sub-5% refusal rate, prompt-cache-cost coverage, the 'audit beat softer phrasings' result, Mythos-drops-cyber — against Anthropic's actual published pages before relying on any of them.
- incompleteDouble staleness / secondary-source drift. The thread compresses an UNDATED official guide (flagged in the sibling extraction as drifting silently as the model and platform update) and is itself a dated July-1-2026 tweet — a dated secondary source of an undated primary. Every version-specific claim (effort defaults, classifier domains, thinking.display values, xhigh-model list, sub-5% refusal rate) is twice-removed from the changelog.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Re-verify every version-specific claim against the platform changelog and the 'Introducing Claude Fable 5 and Mythos 5' page at time of use; never migrate a production workflow on a tweet's restatement of an undated doc.
- incompleteNo evals or verification — the same bar as the docs, and no better. The thread inherits the official guide's central weakness (no reproducible benchmark, dataset, baseline, or numbers for any recommended prompt block) and layers on further unverified quantification ('audit-language produced more reliable self-checking than softer equivalents'; refusals affect 'under five percent of typical developer queries') with no method behind either. A thread adds zero measurement.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Do not treat the thread as evidence for any technique. Build an A/B eval harness (as the sibling gap prescribes) that measures each system-prompt block's marginal effect on your own tasks before adopting it; pair with an evals-disciplined source (extract-anthropic-harness-design-long-running-application-development).
- incompleteSelection/hype bias of the thread format: it reproduces the guide's recommendations but trims its hedges. It presents effort as 'not a quality dial' while dropping the guide's intelligence axis and its warning that higher effort can over-deliberate; it never addresses interaction effects among the stacked system-prompt blocks (brevity, audit, proactivity, memory, final-response) that the reader is told to add together; and the engagement-optimized 'different category of tool' framing amplifies upside while muting trade-offs.How to Actually Prompt Fable 5, Straight From the Team That Built It — read next: Read the primary guide for the caveats the thread trims; assemble and test the composed system prompt as a whole (the sibling's interaction-effects gap) rather than trusting the thread's flattened, upside-first presentation.
- incompleteThe intern-ramp-up and team-cost figures are offered as generalization evidence but remain internal to the author's own small company and network — the same limitation the corpus has already flagged for the companion talk (personal anecdotes from a founder's own team, no independent outcome measurement). A genuinely independent test of whether this transfers to a less-motivated or larger, less cohesive team at org scale is still missing.Advanced Context Engineering for Coding Agents (ace-fca.md) — read next: Look for independent case studies or post-mortems of research/plan/implement-style workflows adopted by teams with no connection to HumanLayer, ideally including teams that abandoned the practice, to test generalization beyond a founder-led, highly bought-in team.
- incompleteThe Ralph Wiggum while-loop is presented as a contrasting technique the author takes seriously, but the essay never states why he chose frequent intentional compaction over it for his own team — e.g. whether it's about task type (brownfield vs. greenfield), risk tolerance, or team review bandwidth. The two approaches sit side by side without a stated decision rule for choosing between them.Advanced Context Engineering for Coding Agents (ace-fca.md) — read next: Read extract-voss-what-the-hell-is-a-loop and extract-11-tips-ai-coding-with-ralph-wiggum for the task-loop (Ralph) discipline-progression model, and compare its stated preconditions (small, well-scoped, externally-verifiable tasks) against this essay's research/plan/implement preconditions (complex, brownfield, requiring human judgment) to build the missing decision rule.
- incompleteThe core empirical claim — that a knowledge-graph-curated context bundle reduces tokens/turns versus dumping all documents — rests on a single internal experiment across roughly 30 documents in one organization for one task type (on-call policy), explicitly not yet validated for accuracy or savings at customer scale.Presentation: From Retrieval to Reasoning: Building Production-Ready Agentic AI Systems with Knowledge Graphs — read next: Look for a follow-up talk or post from Cassie Shum / RelationalAI reporting the promised customer-scale validation, or independent benchmarks comparing graph-curated context assembly against raw-document retrieval on token/turn efficiency.
- uninformedThe talk never engages with non-knowledge-graph approaches to the same four problems — e.g. a plain versioned document store with metadata tagging for context bundling, git/PR history for provenance, or a dedicated telemetry platform for visibility — so it is unclear whether a knowledge graph specifically is necessary or simply one implementation choice among several.Presentation: From Retrieval to Reasoning: Building Production-Ready Agentic AI Systems with Knowledge Graphs — read next: Compare against extract-context-store-evolutionary-architecture's 'context store' proposal (a deterministic, versioned, repo-native record of intent, behavior, and architectural conformance) that claims similar benefits without a graph database — do the two proposals differ in capability, or mainly in storage technology?
- causalEven granting that Claude Code contains symbolic components, Marcus does not establish that these components (rather than, say, the agentic loop, tool-use design, context management, or the underlying LLM quality) are what make it effective. The causal claim is asserted, not argued.The biggest advance in AI since the LLM — read next: Look for ablation studies or engineering post-mortems that isolate the contribution of symbolic vs. neural components in agentic coding systems.
- uninformedThe article does not engage with the broader ML research debate over 'scale vs. data/context' (the so-called bitter lesson, which argues compute/capacity scaling tends to dominate hand-engineered signal over the long run). Netflix's finding that context enrichment beat a 7.5x capacity increase is presented as a standalone empirical result without situating it against that literature, so a reader can't tell whether this is evidence against the bitter lesson in production personalization settings specifically, or simply evidence that Netflix hadn't yet exhausted 'easy' context wins before this experiment.How Netflix Built GenPage: a Single GenAI Model to Build Personalized Homepages — read next: Rich Sutton's 'The Bitter Lesson' and industry responses/counterexamples to it, especially from applied (not research-lab) settings where labeled interaction data is unusually abundant.
- incompleteThe InfoQ piece explicitly acknowledges its own thinness ('There is much more in the original article... including details on how the system was designed, trained, and post-trained, as well as the trade-offs encountered and lessons learned') — this extraction pulled additional depth from the primary Netflix Tech Blog post directly, but even that primary source leaves open how GenPage's single 'maximize user satisfaction' objective interacts with other business objectives the old pipeline's separate stages may have individually served (e.g. contractual content-promotion obligations, catalog-breadth/diversity mandates independent of the RL side-effect observed, new-title cold-start business priorities beyond the technical cold-start solution described).How Netflix Built GenPage: a Single GenAI Model to Build Personalized Homepages — read next: Any Netflix or industry follow-up discussing multi-objective or constrained optimization inside single-model generative recommenders, beyond the single engagement-maximization objective described here.
- incompleteThe domain-modeling skepticism ('why would DDD work now when it never became standard before?') is raised sharply but never answered, leaving the proposed core mechanism for steering agents and scaling teams unresolved.Notes from FOSE Europe — read next: Read on domain-driven design applied to agent steering and on enterprise context/knowledge layers to see what, if anything, is different this time.
- incompleteThe metacognition argument depends on a tacit theory of practitioner skill — that individuals can correctly self-assess which cognition is 'central' to their job's value. No mechanism is offered for how to learn or verify this self-assessment, especially under pressure to shipThis Week in AI: Production Viability — read next: Adler/Polanyi on tacit knowledge; Kahneman on overconfidence in self-judgment; deliberate practice literature (Ericsson); workshop reports from teams that have institutionalized AI-judgment reviews
- incompleteFDE critique identifies the missing analyst layer but doesn't engage with current AI-firm playbooks (Anthropic, Palantir, Sierra) that explicitly pair FDEs with discovery / scoping phases. The piece treats FDE as monolithicThis Week in AI: Production Viability — read next: Gergely Orosz's FDE coverage (extract-pragmatic-engineer-pulse-fde-heats-up.json) for comparison; Anthropic Applied AI team writeups; Palantir's deployment-strategist literature
- incompleteOpenAI consumer-intent argument doesn't engage with the counter-case: that financial-data partnerships might actually be subject to materially stricter regulatory regimes (GLBA, PSD2, etc.) than ad-tech, which could constrain monetization pathsThis Week in AI: Production Viability — read next: Comparative regulation of fintech vs. ad-tech data flows; banking-API consent literature; Apple's privacy-vs-monetization positioning
- incompleteThe article proposes 'can the agent discover this?' as a clean binary filter but never grapples with discovery cost (tool calls, reasoning tokens, latency) as a continuum — the Arize result, which shows manual human judgment about what helps a model is often wrong, undercuts the article's own closing advice to apply this filter by intuition rather than by measurement.Stop Using /init for AGENTS.md — read next: Look for guidance or tooling that quantifies discovery cost per fact (not just possible/impossible) to make the discoverability filter operational and auditable rather than another intuition-based judgment call.
- incompleteThe '150-200 instructions' ceiling is asserted with no citation and no definition of what counts as one 'instruction' (a bullet? a sentence? a constraint?), so it can't be checked or applied precisely.Your AGENTS.md might be a big problem — read next: Anthropic/OpenAI docs and papers on instruction-following degradation with prompt length; the 'context rot' / lost-in-the-middle literature quantifying how many constraints models reliably honor.
- illogicalThe piece conflates two distinct costs — dollar/token spend and attentional dilution — treating 'burns tokens' and 'loses focus' as the same problem. A short file can still be badly written, and a long file can be cheap but confusing; the levers are related but not identical.Your AGENTS.md might be a big problem — read next: Work separating context-window cost/latency from instruction-following quality; prompt-engineering guidance on signal-to-noise vs. raw length.
- incompleteIgnores that nested files reintroduce the same reactive-accretion risk and add a governance/discoverability burden across a distributed doc set — the same 'messy docs' failure mode at a smaller granularity.Your AGENTS.md might be a big problem — read next: John Cutler on institutionalized overload and messy docs (TBM 411/412); documentation-governance and information-architecture practices for keeping distributed config coherent.
- incompleteThe article's evaluative back half (sections 5–7: cost/'tokenmaxxing' disappointment stories, the 'was it just a hack' argument, and the context-engineering conclusion) is paywalled; this extraction only had the one-line table-of-contents previews for that material, not the supporting evidence or full argument.What is “loop engineering?” — read next: Get subscriber access to read the full piece, especially the cost-tradeoff stories in section 5 and the closing argument in section 7 for why context engineering may matter more than loop engineering — directly relevant to the persona's 'rigorous adopter, not hype-follower' stance on AI-agent practice.
- incompleteNo eval methodology to verify that any recommended prompt actually works for the reader's own task. The single near-quantified claim ('nearly eliminated fabricated status reports') is unquantified, drawn from Anthropic's own testing, with no reproducible benchmark, dataset, baseline, or numbers — so a rigorous adopter cannot confirm which system-prompt blocks earn their place.Prompting Claude Fable 5 — read next: Pair with an evals discipline (e.g. extract-anthropic-harness-design-long-running-application-development, which uses graded evaluators); build an A/B eval harness that measures each system-prompt block's marginal effect before adopting it wholesale.
- incompleteThe document is undated. It is thoroughly version-specific (Fable 5 vs Opus 4.8, effort tiers, adaptive/summarized-only thinking, the `refusal` stop reason, safety-classifier domains) yet carries no published or last-updated date, so its claims will drift silently as the model and platform update.Prompting Claude Fable 5 — read next: Cross-check every version-specific claim against the platform changelog and the 'Introducing Claude Fable 5 and Mythos 5' page at time of use; re-verify before betting a migration on any stated default or limit.
- incompleteThe behavioral-improvement claims (bug-finding recall 'noticeably higher', vision accuracy 'substantially higher', single-pass implementations of multi-day systems, more dependable subagent dispatch) are all qualitative, with no benchmark numbers, task definitions, or independent verification.Prompting Claude Fable 5 — read next: Seek third-party or benchmark evidence for the specific claimed gains before relying on them; treat the improvement list as vendor signal, not measurement.
- incompleteNo guidance on interaction effects among the many recommended system-prompt blocks (brevity, anti-over-engineering, anti-overplanning, checkpoint, autonomy, readability, progress-audit, memory). The doc never says whether they conflict, how much instruction budget they consume together, or which takes precedence — awkward given its own advice to prefer brief high-level instructions over enumeration.Prompting Claude Fable 5 — read next: Consult context-engineering / progressive-disclosure material on instruction budgets; assemble and test the composed system prompt as a whole rather than validating each block in isolation.
- incompleteEnglish- and software-only. Every example prompt is English and targets agentic/coding/enterprise-document work; there is no guidance for non-English prompting or for non-software domains, even though the guide claims broad capability gains.Prompting Claude Fable 5 — read next: Look to practitioner reports on multilingual and domain-specific steering; do not assume the English software-agent prompts transfer unchanged.
- uninformedNo stated boundary for when 'steer with a brief instruction' stops working and explicit enumeration becomes necessary. The doc asserts brevity suffices, yet its own recommended blocks are long, multi-clause instructions — leaving the reader without a rule for where high-level steering degrades.Prompting Claude Fable 5 — read next: Use eval-driven tuning to find the point where high-level steering fails and enumeration is required for a given behavior and effort level.
- incompleteThe article doesn't address how the agent decides whether it needs a research phase. The Liquid case didn't need one; the llama.cpp case did. But the agent couldn't have known this in advance. A decision heuristic ('when should I read before coding?') is the missing meta-skill that would make this approach self-directing rather than human-configured.Research-Driven Agents: What Happens When Your Agent Reads Before It Codes — read next: Metacognitive agent architectures; 'knowing what you don't know' in AI systems; confidence calibration research
- incompleteThe claim that well-optimized codebases (Redis, PostgreSQL, SQLite) are harder targets is mentioned in one sentence but not explored. This is actually the most interesting boundary: at what point has a codebase been optimized enough that agent-driven improvement becomes uneconomical? This would define the useful scope of the entire approach.Research-Driven Agents: What Happens When Your Agent Reads Before It Codes — read next: Performance engineering literature on diminishing returns; the 'last mile' problem in optimization
- incompleteThe research phase is described as reading papers and studying forks, but the article doesn't discuss how the agent evaluates which papers and forks are relevant. With thousands of arxiv papers and potentially dozens of forks, the agent needs a research strategy — and that strategy itself requires domain knowledge.Research-Driven Agents: What Happens When Your Agent Reads Before It Codes — read next: Information retrieval for technical literature; RAG architectures for agent research; the 'research taste' problem
- incompleteThe article is honest about agent overconfidence (the benchmark bug) but doesn't propose a solution. How should agents sanity-check their own instrumentation? This is a general agent reliability problem that extends far beyond optimization benchmarks.Research-Driven Agents: What Happens When Your Agent Reads Before It Codes — read next: Agent self-verification; Anthropic's work on AI oversight; the 'quis custodiet' problem in autonomous systems
- incompleteThe headline '87% benchmark with 4B-active model' is the entire credibility hook and is completely unspecified in the body. No benchmark name (SWE-Bench? Aider polyglot? HumanEval? a custom suite?), no subset, no scoring methodology, no comparison baseline (what does a frontier model score on this same eval? what does the same 4B model score without SmallCode?), no link to results. For a rigorous adopter this is the single most disqualifying gap.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Check the GitHub repo itself for an evals/ or results/ directory; check the project's `/eval` command output; check whether any third party has reproduced. Compare against published SWE-Bench / Aider / HumanEval+ leaderboards for similar-sized models. Look for the actual model named in the example (gemma-4-e4b) and find its baseline scores.
- incompleteNo comparison to other small-model-aware agentic coding tools — Aider (with local models), Cline + Ollama, Continue, OpenHands with local backends, Roo. The only named comparator is OpenCode, which is set up as a strawman ('assumes frontier models').GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Read Aider's local-model documentation and benchmark notes (Paul Gauthier publishes Aider polyglot scores for many models). Compare with Cline's local-model guidance and OpenHands' SWE-Bench results with open models.
- incompleteOne-author ecosystem risk: SmallCode depends on BoneScript, MarrowScript, and budget-aware-mcp — all by the same GitHub user. If the author stops maintaining, four projects rot together. This single-maintainer concentration is not flagged anywhere.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Check commit history and contributor counts on all four repos; check npm download stats for smallcode and budget-aware-mcp; check whether MarrowScript / BoneScript have any external adopters.
- misinformedThe escalation target list cites 'Claude Sonnet 4.5 / 4.6, Haiku 4.5' and 'GPT-5.4 Mini / Nano' and 'DeepSeek V4 / V4 Pro / V4 Flash'. As of the document's apparent date, these specific named version numbers may be aspirational, outdated, or fabricated. The presence of confidently-named future/non-existent model versions weakens credibility on other un-checkable claims.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Cross-check the named model versions against vendor product pages; if they are not real, treat the rest of the README's confident numbers (87%, '8-15 → 1-2 tool calls', '1400+ lines from 50 lines') with proportional skepticism.
- illogicalThe marketing claim ('87% with 4B-active model') and the body text ('7B-20B local models') are inconsistent. The title advertises a 4B-active model; the body describes the project as targeting 7B-20B. If 4B-active means MoE active params with a larger total, both can be true — but the README never reconciles them, leaving the reader to guess.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Identify the actual model used to produce the headline number; if it is MoE (e.g. gemma-4-e4b with ~4B active), check whether 7B-20B framing in the body is meant as total-parameter range, active-parameter range, or both — the project's positioning depends on which.
- incompleteNo discussion of how the harness itself is engineered, tested, or evaluated. The Observability section mentions traces and `/eval` but provides no example evaluation results, no harness-coverage metrics, no failure-mode regression tests beyond 'trace-to-test'. The harness is presented as fait accompli, not as something the reader could audit.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Connect to Birgitta Böckeler's harness-engineering article (already in the user's library): her steering-loop concept asks how a team iterates the harness based on observed failures. Apply that lens here — what is SmallCode's own steering loop?
- incompleteThe cybernetic / control-theory framing latent in the design (variety reduction via BoneScript topologies, feedback via early-stop detection, model profiles as adaptive control) is never made explicit. Connecting this project to the broader harness-engineering conversation (Anthropic's effective harness paper, Böckeler's framework) would let it argue from theory rather than just engineering instinct.GitHub - Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. — read next: Read SmallCode against Böckeler's 'Harness engineering for coding agent users' (in this batch) — map SmallCode's components to her feedforward/feedback and computational/inferential axes. Read against the Anthropic harness-design materials the user is also tracking.
- incompleteThe workflow's entire safety mechanism rests on one human continuously holding architectural context across every change ('I still know every choice that was made above the function level'). The article never considers the team-scale version of this: what happens to the approach when more than one human must jointly own that architect role, how plan files or chat transcripts become durable shared artifacts rather than one person's private conversation history, and how disagreement among human architects (not just among reviewer models) would be resolved.How I write software with LLMs — read next: Look for work that extends a single-practitioner architect/developer/reviewer agent pattern to a team setting with multiple human architects and durable, shared planning artifacts -- e.g. extract-skills-v1-1-wayfinder-flow-skills and extract-claxton-ai-native-sdlc-playbook, which both formalize the plan-then-approve gate as a team-shareable artifact rather than a private chat.
- incompleteThe Maven Assistant case study — the essay's single detailed low-complexity example — describes an already-live consumer health product with meaningful compliance stakes (self-harm handoffs, withheld high-cost benefits questions). The essay never shows a genuinely minimal internal/low-stakes agent receiving the 'keep it small' advice, leaving open whether even Maven's 'moderate action complexity' harness (routing, bounded tools, guardrails, handoffs) is itself already more than many builders need.Stop Overengineering Your Agent Harness — read next: Read case studies of minimal single-tool, single-turn internal agents to test whether even Maven's harness is over-built for lower-stakes use cases.
- incompleteThe essay names but doesn't explain the skew whereby public harness-engineering discourse is dominated by coding/personal-agent problems even though support, sales, and enterprise agents are described as the majority of what builders actually build — leaving unaddressed whether this reflects genuine attention bias, differing incentives to publish, or something else.Stop Overengineering Your Agent Harness — read next: Read industry-adoption surveys on where AI agents are actually deployed (support/sales/enterprise vs. coding) to check whether the discourse mismatch tracks a real minority-attention bias.
- incompleteNo method for developing the one skill it names as decisive. The essay says attention is the key, says it can't be taught, and then offers only the paid 'Inner Circle' as a path — leaving the practical reader without an actionable next step, which is ironic for a self-styled 80/20 practical newsletter.The real skill behind good AI prompts is older than computers — read next: Cal Newport 'Deep Work'; Nir Eyal 'Indistractable'; William James on attention; mindfulness / meta-attention research — the how-to layer the essay withholds
- illogicalThe thesis is close to unfalsifiable: any AI success is credited to attention, any failure blamed on inattention. It also equivocates between 'attention' as (a) present-moment noticing and (b) accumulated domain expertise ('knowing what matters about the task') — much of what he calls noticing is actually expertise/tacit knowledge, a different faculty.The real skill behind good AI prompts is older than computers — read next: Michael Polanyi 'The Tacit Dimension'; Gary Klein 'Sources of Power' (expert intuition as pattern recognition); Ericsson on expertise — to separate 'attention' from 'expertise'
- incompleteTitle/body mismatch. The headline promises a skill 'older than computers,' but the body only asserts the pre-digital, timeless pedigree of attention — it never substantiates the historical claim it uses as a hook.The real skill behind good AI prompts is older than computers — read next: Matthew Crawford 'The World Beyond Your Head' (attention as a cultural/historical achievement); Simone Weil on attention
- implicit_premiseCutler's argument depends on the implicit premise that multi-perspective input produces better understanding of complex product territory than single-perspective input amplified, regardless of how powerful the amplification. This premise is doing enormous work — it is the reason a 'cartographer for places you haven't visited' is a bad metaphor even if the cartographer is brilliant. The premise is plausible but not defended, and it is exactly the premise that AI optimists would contest: 'what if the AI cartographer can simulate enough perspectives well enough that the collision-of-stakes advantage shrinks toward zero?' Cutler dismisses this as 'directing a puppet show' but does not say why simulated diversity must always be epistemically inferior to embodied diversity.TBM 418: Campfires, Trails, and Quests — read next: Cass Sunstein and Reid Hastie 'Wiser' on group decision-making and the conditions under which diverse groups outperform individuals; Helene Landemore 'Democratic Reason' on epistemic diversity; Andy Clark on extended/predictive cognition and where the boundary between simulated and real perspectives lies
- implicit_premiseThe piece assumes that the friction of collaboration is itself epistemically valuable — that 'wait, go back' moments and the trading of the steering wheel produce understanding that solo work cannot. The opposite hypothesis is plausible: collaboration friction is a cost teams pay because they have no better way to integrate perspectives, and AI that genuinely integrates multiple perspectives could deliver the integration without the friction. Cutler's strongest moment ('the back-and-forth... was the outcome') is also his most assertion-heavy.TBM 418: Campfires, Trails, and Quests — read next: Karl Weick on sensemaking and the role of equivocality; the literature on collective intelligence (Anita Williams Woolley); critiques of meeting-heavy cultures (Cal Newport, 'A World Without Email')
- unacknowledged_questionCutler's prescription assumes psychological and organizational conditions for genuine multiplayer collaboration — trust, time, willingness to be redirected mid-stream, role flexibility. He notes these implicitly (his diagram is for 'a team with real trust') but does not engage with what teams should do when those conditions are absent. The advice 'make AI a shared surface' presupposes the willingness to share. In a low-trust team, single-player AI may be a rational defensive posture, and 'multiplayer or bust' could be advice that only works for teams that already don't need it most.TBM 418: Campfires, Trails, and Quests — read next: Amy Edmondson on psychological safety as a precondition for collaborative learning; Patrick Lencioni's trust pyramid; research on remote/distributed team trust formation
- incompleteThe trails/stigmergy framing inherits a curation problem the analogy obscures. Pheromone trails decay biologically; Wikipedia has revert mechanisms and stewards. Context pointers in a codebase do not decay — they accumulate, can become stale, can contradict each other, and can mislead future readers and AI agents. The piece names trails as an asset without acknowledging the maintenance liability or the political question of who has authority to prune.TBM 418: Campfires, Trails, and Quests — read next: Brian Foote and Joseph Yoder 'Big Ball of Mud' on accumulated context as decay; Ward Cunningham on technical debt; the documentation-rot literature (Daniele Procida's 'Diataxis')
- incompleteCutler identifies that it's hard to tell which artifacts are 'live' versus 'relics' but offers no concrete heuristic or signal for making that determination — e.g. last-updated metadata, authorship, revision/consensus history, or explicit 'still valid as of' annotations. The piece's central practical problem is named vividly but left without even a candidate method.TBM 439: Day At The Gig... — read next: His own TBM 418 'Campfires, Trails, and Quests' — specifically its unclosed gap that trails/context pointers, unlike wikis, have no revert/staleness mechanism — or documentation-rot literature (Diataxis, 'Big Ball of Mud') for maintenance-liability frameworks.
- incompleteThe piece never discusses the closed-world limitation implied by a fixed-schema architecture — what happens when real-world input doesn't fit any anticipated category or field, how schemas are authored, versioned, and maintained over time, or the cardinality ceiling (255, per the Wikiracing nuance) for open-set or high-cardinality classification tasks.Introducing System One Models & Jev — read next: Reading direction: schema/type design as a new maintenance burden and failure surface for AI-powered workflows, parallel to how prompt/context engineering became one for LLM-based agents.
- incompleteOntology maintenance and curation cost is entirely unaddressed. The post treats the ontology as a layer that 'supplies' semantic memory, but says nothing about who authors the shared formal vocabulary, how it is governed as many notes link into it, or that this is scarce knowledge-engineering labour. If maintaining the ontology is the hard part, the bottleneck moves from markdown convenience to specialist curation — undercutting the linked 'simplest thing that could possibly work' framing.Tony Seale's Post — read next: Read the historical adoption record of formal ontologies and the Semantic Web (OWL/RDF, schema.org governance) for why ontology upkeep, not authoring notes, is the recurring failure point. Compare with this repo's own knowledge/ layer, which runs the same episodic+semantic split but deliberately diverges from Vault-LD: it keeps the ontology in an external, human-curated registry (concepts.yaml) rather than inline YAML-LD, and uses positional refs (slug#p3) rather than linked-data URIs. That a working instance of the pattern chose an external registry is direct evidence that inline 'one file, each layer optional' is not the only viable architecture — and that someone still has to own the semantic layer by hand.
- incompleteThe inference payoff is asserted but never demonstrated. 'Project into a graph, where inference, validation, query and integration are already waiting' names four benefits without a single worked example of what an agent can now answer, or what a validation constraint would catch, that a plain markdown wiki could not. The most consequential claim in the piece — that the ontology overhead buys real capability — is left as a promise.Tony Seale's Post — read next: Seek the linked Vault-LD spec for a concrete example, then pressure-test it against the counter-claim in the corpus (Karpathy: an LLM-maintained markdown index is sufficient for complex Q&A at ~100-article scale without any graph). Ask specifically: what query, inference or validation justifies the ontology, and at what vault size does flat markdown actually break?
- incompleteThe net-positive assumption skips the sync/drift ledger. Keeping typed fields and ontology links in agreement with prose as the prose evolves is ongoing cost, and 'each layer optional until you need it' in practice tends to mean 'skipped' — which leaves the graph sparse exactly where semantics were supposed to add value, and leaves the annotated minority prone to silent divergence from the text it describes.Tony Seale's Post — read next: Read on documentation drift / doc-rot and on the divergence between described and enforced structure over time (cf. the static-sensors debate on markdown guides vs enforcement rules). Consider whether YAML-LD frontmatter has the same rot dynamics as any duplicated metadata, and what would keep it honest.
- incompleteThe JSON-LD-on-HTML analogy imports an inevitability it has not earned. The web's structured-data adoption was driven by a concrete incentive — search engines reward JSON-LD with ranking — and is itself uneven and gamed. The post identifies no equivalent forcing function for private or team vaults, yet treats 'the same move' as a settled outcome rather than a hopeful one.Tony Seale's Post — read next: Examine schema.org adoption data and its SEO dynamics — how much of the web's 'knowledge graph' is genuine semantics versus ranking-driven boilerplate — and ask what a vault-world analogue of search-ranking pressure would even be. If none exists, the adoption story needs a different engine than the analogy provides.
- incompleteNo treatment of the trustworthiness of the memory itself. Agent memory is largely LLM-written; a hallucinated or drifting note, once given typed fields and ontology links, inherits machine-queryable false authority. The semantic layer is presented purely as validation upside, with no acknowledgement that it propagates bad facts as readily as it structures good ones, or that memory poisoning becomes more consequential once memory is formally queried.Tony Seale's Post — read next: Read on agent-memory poisoning and knowledge-base trust (how errors propagate through an LLM-maintained base over time). Distinguish validation that catches contradictions from structure that merely launders unverified claims into confident graph facts.
- incompleteThe article never addresses teams whose native artifacts are themselves weak or absent (no real schema contracts, thin or no test suite, no telemetry). For them, 'keep durable facts in their native form' recommends a home that doesn't yet exist, and the article gives no guidance on sequencing — build the native artifact first, or use prose as a legitimate transitional stopgap while it matures.When AI Writes the Code, Specifications Need an Exit Strategy — read next: Look for material on artifact/observability maturity models, or on how teams bootstrap schema, test, and telemetry discipline in codebases that currently have none, to test whether prose specification is a legitimate transitional artifact rather than pure waste.
- uninformedThe mapping of durable-fact categories to native artifacts (API shape to schemas, data invariants to types, security to policies, architecture to tests, reliability to telemetry, release to CI/CD) treats each category as if it maps cleanly one-to-one, without engaging cases where a single durable fact spans several categories at once (e.g., a business policy that is simultaneously a data invariant, a security rule, and a UX constraint), or with prior literature on the difficulty of converting tacit organizational knowledge into formal artifacts.When AI Writes the Code, Specifications Need an Exit Strategy — read next: Knowledge-elicitation and requirements-engineering literature on tacit-to-explicit knowledge conversion (e.g., Nonaka & Takeuchi's SECI model), and this corpus's own organizational-forgetting material (extract-3-ways-ai-can-free-orgs-from-legacy-workflows) on how depersonalized evidence surfaces facts nobody wrote down anywhere.
- incompleteThe empirical studies cited (ambiguity repair improving results ~31%, SWT-Bench doubling precision, TLA+ translation reaching only ~27%/9% syntactic/semantic correctness) support 'small specs plus independent verification' in general, but none of them actually measures this article's central claim — that treating specs as temporary and promoting only durable facts to native artifacts reduces total cost or drift compared to alternative approaches.When AI Writes the Code, Specifications Need an Exit Strategy — read next: Look for empirical work directly comparing 'temporary change-brief' workflows against both prose-heavy and specless workflows on drift, rework, or maintenance cost — the same empirical gap already flagged in extract-eisele-ai-coding-agents-need-clear-specs#g1 for the U-shaped cost curve, now recurring for this piece's 'expire the spec' claim.
- incompleteThe article asserts that the agent layer is where coding competition now happens, but doesn't decompose what makes one harness materially better than another (context management, tool-use design, model-harness coupling, evals, ecosystem). For someone evaluating Claude Code vs. Antigravity vs. Codex on engineering merits, this is the question that matters most.Why Google Isn't Chasing Claude Code — read next: Addy Osmani on Claude Code agent patterns; Alex Wang on Claude Code setup quality; Anthropic engineering blog on Claude Code internals; any direct head-to-head harness eval (e.g. SWE-bench Verified with different harnesses on the same base model).