Pattern-Completion Generation (Not Reasoning)

LLMs generate by statistically continuing patterns — from training data or from whatever sits in the live context window — rather than by reasoning, so output is steered as much by what surrounds the model (a codebase, a prompt, prior examples) as by explicit instruction.

Also known as: next-word prediction, mimicry, bounded patterns, in-context learning, agents amplify what they see

Part of: LLM Limitations

How authors use it

Oldest first (extraction date when no publication date is known).

Documents (6)

• How to turn your AI into a world-class designer Anshu Chimala · 2026-09-01 Reader 🖥️
  AI models default to bland, repetitive ('design-by-committee') design because their training rewards the statistically safest choice at every token, so producing distinctive AI-generated design requires deliberately counteracting that bias at each stage of a Discover/Define/Deliver process — injecting externally-sourced variety and ambition, judging output with a fresh-context critic instead of the generating agent, enriching it with image/video generation, and then subtracting rather than adding to reach a polished result.
• 11 Tips For AI Coding With Ralph Wiggum Matt Pocock · 2026-07-11 source ↗ Reader 🖥️
  Autonomous agent loops ("Ralph") become reliably productive only when the human stops writing code and instead wraps the loop in disciplined scaffolding — an explicit end-state/stop-condition, an externalized progress file, commit-blocking feedback loops, small steps, risk-first sequencing, stated quality expectations and a sandbox — scaffolding that compensates for the agent's lack of judgment and cross-session memory and that, unguardrailed, would let the loop accelerate software entropy.
• LLMs Can't Jump Tom Zahavy, Google DeepMind · 2026-05-23 source ↗ Reader 🖥️
  Modern LLMs have mastered Induction (statistical pattern-matching) and are rapidly mastering Deduction (formal proof), but are structurally incapable of Abduction — the embodied-simulation-grounded leap from scarce sense experience to novel explanatory axioms that produced discoveries like General Relativity — so genuine AI scientific invention requires physically-consistent, interactive, multimodal world models rather than more language-model scale.
• Richard Dawkins and The Claude Delusion Gary Marcus (Marcus on AI, Substack) · 2026-05-09 Reader 🖥️
  Dawkins' claim that Claude may be conscious is a textbook Argument from Personal Incredulity — the very fallacy he once famously ridiculed — because it infers internal states from output behavior while ignoring that LLMs are mimics whose fluent language is produced by statistical pattern-matching over training data, not by felt experience or genuine understanding.
• A model that produces code which compiles and passes the tests it was given is not the same as a model that produces robust code Gary Marcus · 2026-05-09 Reader 🖥️
  Code that compiles and passes its given tests is not the same as robust code; conflating the two inflates AI-coding claims, and progress requires acknowledging this gap rather than celebrating throughput.
• Philosophy Eats AI: What Leaders Should Know MIT Sloan Management Review · 2025-05-14 source ↗ Reader 🖥️
  Because generative AI is built from and operates through philosophical constructs (purposes, categories, knowledge), the executives who win with AI will be those who deliberately map and reconcile their organization's teleology, ontology, and epistemology — not those who optimize ethics, metrics, or models in isolation.

Propositions touching this concept (4)

By publication month, oldest first (extraction month when no publication date is known).

2025-05

• explicitThe relevant constraint for GenAI is bounded patterns rather than bounded rationality, and purpose is what should do the bounding.
  Philosophy Eats AI: What Leaders Should Know · p4

2026-05

• explicitcontestedLLMs produce human-like text through statistical mimicry of training data, not as reports of genuine internal states.
  Richard Dawkins and The Claude Delusion · p1
• causal claimNext-word prediction gets surprisingly far in writing code but less far in ensuring robustness.
  A model that produces code which compiles and passes the tests it was given is not the same as a model that produces robust code · p2

2026-07

• explicitAn agent treats the existing codebase as evidence that outweighs a few lines of instruction, so it imitates whatever patterns it sees ('agents amplify what they see; poor code leads to poorer code'); an autonomous loop therefore ACCELERATES software entropy — piling dozens of commits per hour where a human commits once or twice a day — unless the codebase is kept clean, quality expectations are made explicit, and feedback loops enforce standards.
  11 Tips For AI Coding With Ralph Wiggum · p9

Open gaps (21)

• The mimicry argument assumes a sharp mimicry/genuine-experience binary
  Richard Dawkins and The Claude Delusion
• No engagement with Anthropic's own published work on Claude's internal representations
  Richard Dawkins and The Claude Delusion
• The essay's central irony may undercut its epistemic content
  Richard Dawkins and The Claude Delusion
• incompleteNo discussion of how these patterns interact with rapidly improving AI capabilities. If AI models become better at inferring project conventions from code context, some of these patterns (especially Knowledge Priming) may become unnecessary. The framework lacks a theory of its own obsolescence.
  Patterns for Reducing Friction in AI-Assisted Development — read next: Papers on in-context learning improvements in LLMs; research on retrieval-augmented code generation
• incompleteThe article never reconciles its headline framing ('built in three prompts,' 'built in two prompts') with the seven distinct named techniques it goes on to describe — it's unclear how many techniques were actually stacked to produce the opening hero demos, or what the realistic cost/iteration/wall-clock budget of the full pipeline is for a team that isn't the author.
  How to turn your AI into a world-class designer — read next: Treat 'N prompts' claims skeptically until technique count and iteration count are reconciled; look for a follow-up or reader Q&A addressing total cost.
• illogicalThe central mechanism claim — RLHF-style training causes consensus-seeking causes generic design — is stated as settled fact via an intuitive 'design-by-committee' analogy, with no citation, benchmark, or reference to the actual mode-collapse literature it implicitly invokes.
  How to turn your AI into a world-class designer — read next: Compare against more rigorous treatments of RLHF-induced output homogenization/mode collapse and the empirical AI-creativity debate elsewhere in this corpus (ai-creativity, pattern-completion-generation concepts).
• incompleteThe paper's positive proposal -- that action-controllable, physically-consistent multimodal world models will supply the sensory grounding needed for abduction -- is asserted but not operationalized. No benchmark, no success criterion, and critically, no account of how a 'counterfactual physical simulation' would itself get translated into a formal axiom: translation-from-simulation-to-axiom is exactly the bottleneck the paper identifies as the Jump, and it recurs unaddressed inside the proposed solution rather than being solved by it.
  LLMs Can't Jump — read next: Genie / Genie 2 / Genie 3 technical reports and any successor work on translating interactive world-model states into formal symbolic theories; LeCun's JEPA and world-model architecture papers for how (or whether) symbol grounding is actually operationalized there.
• incompleteThe entire argument rests on one historical case (Einstein/General Relativity), reconstructed via a single secondary source (Norton, 2020). No comparison is made to other major discoveries made under data scarcity -- Darwin's natural selection, Wegener's continental drift, Mendel's genetics -- to test whether 'manipulative abduction via embodied simulation' is the general mechanism of discovery-under-scarcity or an idiosyncrasy of how Einstein specifically thought (he is quoted saying words play no role in his mechanism of thought -- a documented personal trait, not obviously evidence about scientific discovery in general).
  LLMs Can't Jump — read next: Case studies of scientific discovery in non-physics domains (biology, geology) under comparable data scarcity, to test whether the embodied-simulation account generalizes or is Einstein-specific.
• illogicalThe paper concedes that an AI could plausibly identify the conceptual inconsistency between Newtonian absolute time and Maxwell's constant speed of light that motivated Einstein's search in the first place -- an act of noticing which surprising Result is worth explaining. Yet the paper classifies this act as merely deductive ('much like a system identifying buggy code'), while its own Peircean framework defines exactly this kind of selection (choosing which Case merits explanation) as characteristically abductive. This blurs the sharp induction/deduction/abduction boundary the paper otherwise insists on, without acknowledging the tension.
  LLMs Can't Jump — read next: Peirce's own writing on abduction as hypothesis-selection (not just hypothesis-generation) would clarify whether 'noticing an inconsistency worth resolving' counts as abduction under his original scheme.
• evidentiaryNo evidence or examples of the robustness gap — the post asserts the distinction without demonstrating it
  A model that produces code which compiles and passes the tests it was given is not the same as a model that produces robust code — read next: Read the linked TNW article for the substantive argument
• conceptualThe 'compiles and passes tests' vs. 'robust' distinction needs operationalization: what specific failure modes does Marcus have in mind?
  A model that produces code which compiles and passes the tests it was given is not the same as a model that produces robust code
• argumentativeNo engagement with counterarguments (e.g., that test coverage can be systematically expanded to close the gap)
  A model that produces code which compiles and passes the tests it was given is not the same as a model that produces robust code
• referentialOpenClaw reference is opaque — unclear whether it's a real tool or rhetorical device
  A model that produces code which compiles and passes the tests it was given is not the same as a model that produces robust code
• structuralThe post is a pointer; the substantive argument lives in the TNW article which is not included here
  A model that produces code which compiles and passes the tests it was given is not the same as a model that produces robust code — read next: Follow the TNW link for the full argument
• incompleteThe conversation calls for executives to do teleology/ontology/epistemology mapping but offers no concrete method, template, or worked example of how to do it. Starbucks and Amazon are gestured at but not decomposed into a reproducible exercise.
  Philosophy Eats AI: What Leaders Should Know — read next: The companion MIT SMR article ('Philosophy Eats AI') likely supplies more; also relevant: Cynefin frameworks, OKR/teleology-mapping methodologies, and ontology-engineering literature from knowledge-graph practice.
• incompleteThe 'indifference, not ignorance' diagnosis of the Gemini case is asserted but not evidenced. It is rhetorically convenient (it lets philosophy do explanatory work) but the alternative hypothesis — that the team genuinely failed to anticipate the conflict — is dismissed rather than refuted.
  Philosophy Eats AI: What Leaders Should Know — read next: Reporting on Google's internal Gemini launch decisions; postmortems of similar AI launch failures.
• incompleteSchrage's claim that simulated reason 'may be better than the real thing' for many use cases is dropped without elaboration. Which use cases? On what evidence? This is a load-bearing claim about epistemology that is not defended.
  Philosophy Eats AI: What Leaders Should Know — read next: Daniel Kahneman / Gary Klein on heuristics vs. analytical reasoning; recent benchmarks on LLM reasoning vs. expert human reasoning.
• uninformedNo engagement with critiques that 'philosophy eats AI' is itself a marketing framing — a management aphorism designed to sell consulting and articles, rather than a tested empirical claim. The thesis is defended by examples chosen to fit it.
  Philosophy Eats AI: What Leaders Should Know — read next: Critical management studies on the 'X eats Y' aphorism genre; the history of how Drucker's 'culture eats strategy' was actually used and misused.
• incompleteThe learn-to-prompt / prompt-to-learn cycle treats human and model learning rates as observable and comparable. But no operational definition is offered for either learning rate, and there is no discussion of how an executive would measure whether 'humans are learning faster than the models'.
  Philosophy Eats AI: What Leaders Should Know — read next: Organizational learning literature (Argyris, Senge); ML evaluation/eval-set methodology; recent work on continuous evaluation in production AI systems.
• uninformedThe conversation foregrounds teleology/ontology/epistemology but is silent on axiology (theory of value) — even though the entire argument is about value creation. The choice of three of the four classical branches is unexplained.
  Philosophy Eats AI: What Leaders Should Know — read next: Standard introductions to philosophy that include axiology; literature on value-sensitive design in HCI.
• incompleteSchrage's hint that pattern-based meaning-making is a 'different philosophical insight' is not developed. Is this a continental/post-structuralist claim about meaning-as-similarity? A pragmatist one? The philosophical lineage of the new account is left implicit.
  Philosophy Eats AI: What Leaders Should Know — read next: Wittgenstein on family resemblance; connectionism vs. symbolic AI debates; recent philosophy-of-mind work on LLM cognition.