The new GPT-5.6 family: Luna, Terra, Sol
Simon Willison Β· email Β· 2026-07-10 Reader π₯οΈ
AI Unit EconomicsEvalsFrontier Model Convergence / CommoditizationFrontier-Lab HypeLong-Running & Managed AgentsMCP (Model Context Protocol)Multi-Agent OrchestrationToken Efficiency
OpenAI's new GPT-5.6 family (Luna/Terra/Sol) leads on long-running agentic benchmarks and is pitched on token efficiency, but its benchmark story is mixed and partly self-serving and in hands-on coding it is merely competitive with Claude Fable 5 β so the more consequential news is the new API primitives (programmatic tool calling, native multi-agent, explicit prompt caching) that adopt patterns Anthropic pioneered.
practical Β· mixed β A practitioner's launch-day appraisal (expository reporting of specs/pricing/benchmarks fused with a lightly argumentative adopter's verdict). Extracts only the GPT-5.6 family section of the newsletter; the sqlite-utils 4.0 write-up, links, quotes and releases in the same email are out of scope. The piece is practical: it exists to help a rigorous adopter decide what, if anything, changes for them.
Structure
| Part | Role |
|---|---|
| Launch facts (sizes, pricing, shared specs) | Establishes the object under appraisal and immediately problematizes its headline cost comparison |
| OpenAI's headline benchmark claim (Agents' Last Exam) vs the SWE-Bench Pro reversal + audit article | Presents the vendor's strongest evidence, then undercuts it with a countervailing benchmark and a suspiciously timed audit |
| First-party hands-on verdict | Substitutes the author's own early-access experience for benchmark scores |
| New API features (programmatic tool calling, multi-agent, prompt cache breakpoints, detail:original) | Redirects attention from the model to the platform surface |
| Pelican-benchmark cost/effort probe + OpenAI demo | Concrete, whimsical illustration of cost-vs-reasoning-effort spread |
Key terms
- Luna / Terra / Sol
The three sizes of the GPT-5.6 family from smallest to largest, priced (per 1M input/output tokens) at $1/$6, $2.50/$15 and $5/$30 respectively; all share a Feb 16 2026 cutoff, 1M context and 128K max output - Agents' Last Exam
An evaluation of long-running professional workflows across 55 fields; OpenAI's flagship benchmark evidence, on which Sol scores 53.6 - SWE-Bench Pro
A self-reported coding benchmark on which Claude Fable 5 (80%) decisively beat GPT-5.6 Sol (64.6%) β and which OpenAI publicly questioned (β~30% of tasks brokenβ) the day before launch - Token efficiency (βmore useful work from every tokenβ) Token Efficiency
OpenAI's framing of GPT-5.6's advance as getting more done per token / lower cost-per-task, not a raw-capability jump - Reasoning tokens
The variable, model-specific hidden tokens spent thinking on a task; because they differ so much between models for the same task, price-per-million-tokens no longer indicates real cost - Programmatic Tool Calling
A new API feature letting the model compose and run JavaScript that orchestrates tool calls; Willison speculates it could bridge MCP tools and full terminal sessions that compose CLI utilities, akin to Anthropic's dynamic filtering - Multi-agent (subagents in the core API) Multi-Agent Orchestration
A new API feature letting the model spin up subagents for parallel, focused work β the sub-agent pattern now baked into the core API rather than the harness - Prompt cache breakpoints
A new API feature bringing Claude-style explicit prompt-cache boundaries to OpenAI (vs OpenAI's default automatic detection, which Willison prefers)
Propositions
- explicitOpenAI's GPT-5.6 reached general availability in three sizes β Luna, Terra, Sol (smallest to largest) β all sharing a February 16 2026 knowledge cutoff, a 1M-token context window, and 128,000 max output tokens.conf: high
- explicitOpenAI positions long-running agentic performance as GPT-5.6's flagship strength, citing Agents' Last Exam (long-running professional workflows across 55 fields) where Sol sets a new high of 53.6, beating Claude Fable 5 by 13.1 points, with the smaller Terra and Luna also beating Fable at around one-sixteenth the cost.conf: high
- explicitHeadline price-per-million-token figures no longer meaningfully indicate real cost, because the number of reasoning tokens a model spends on the same task now varies enormously between models.conf: highsupportsGuest post: AI Inference Is Breaking Unit Economics Β· p2 β Willison's 'price-per-token no longer tells us much because reasoning tokens differ so much' is a concrete instance of the opposing cost vectors p2 describes (per-token costs falling while reasoning inflates per-query compute).
- explicitOpenAI frames GPT-5.6's core advance as token efficiency β getting βmore useful work from every token,β i.e. a lower cost-per-task rather than a raw-capability leap.conf: highsupportsDeveloper Newsletter: higher usage limits, dreaming for Claude Managed Agents, and Claude Security Β· p6 β OpenAI pitching GPT-5.6 as 'more useful work from every token' / lower cost-per-task is a direct example of model improvements now being expressed as efficiency (tokens per task) rather than raw capability.
- explicitGPT-5.6's benchmark story is mixed and partly self-serving: Claude Fable 5 decisively beat it on SWE-Bench Pro (80% vs 64.6%), and OpenAI published an article the day before launch estimating ~30% of SWE-Bench Pro tasks are broken.conf: highsupportsWhat OpenAI and Anthropic Think Happens Next With AI Β· p9 β Supports the premise underlying p9 β that benchmarks are weak, gameable capability signals β by showing a lab curating which benchmark it leads with and discrediting (via a same-week audit article) the one it lost; it is evidence for the premise, not for p9's release-timing claim itself.
- explicitIn first-party hands-on use, GPT-5.6 Sol is very competent but has not struck Willison as better than Claude Fable 5 on the complex coding tasks he uses Anthropic's model for.conf: highsupportsGenerative AI in the Real World: Aishwarya Naresh Reganti on Making AI Work in Production Β· p13 β Hands-on parity between GPT-5.6 Sol and Claude Fable 5 on complex coding is direct evidence that frontier models are converging on capability, per p13.
- implicitThe most consequential part of the release is a set of new API primitives β Programmatic Tool Calling, native Multi-agent subagents, explicit prompt-cache breakpoints, and detail:original image handling β several of which adopt patterns Anthropic pioneered.conf: medium
- explicitProgrammatic Tool Calling β letting the model compose and run JavaScript that orchestrates tool calls β could bridge the gap between MCP tools and full terminal sessions that compose CLI utilities.conf: medium
Arguments
For a rigorous adopter, GPT-5.6 does not clearly surpass Claude Fable 5, and the release's real significance is cross-lab convergence plus new API primitives rather than a decisive capability leap. strength: medium
Explicit premises:
- OpenAI's own headline benchmark (Agents' Last Exam) is countered by a benchmark it lost badly (SWE-Bench Pro: 64.6% vs Fable's 80%).
- OpenAI published an audit article discrediting SWE-Bench Pro the day before launch, exactly the benchmark on which it lost.
- In hands-on complex coding, GPT-5.6 Sol has not struck Willison as better than Fable so far.
- The headline gain is framed as efficiency (work per token / lower cost), not raw capability.
- Several new API features explicitly mirror Anthropic mechanisms (dynamic filtering, subagents, prompt caching).
Implicit premises:
- Vendor-selected benchmarks are motivated evidence and should be discounted absent independent replication.
- First-party hands-on testing on one's own hardest tasks is more decisive for an adoption verdict than aggregate benchmark scores.
- A single reviewer's early-access sample on unspecified coding tasks generalizes enough to license a comparative verdict (the shakiest load-bearing assumption).
- Cross-lab feature borrowing signals convergence/commoditization of the model surface rather than durable differentiation.
- Cost claims stated as vendor 'estimated cost' and round multiples ('roughly one-quarter', 'one-sixteenth') are themselves estimates to be treated cautiously.
Inferences:
- From mixed + self-serving benchmarks combined with hands-on parity: benchmark leadership does not equal real-world superiority.
- From explicit feature borrowing: the frontier is converging, so the model API surface is where the interesting movement is.
Price-per-million-tokens is no longer a meaningful way to compare model cost. strength: high
Explicit premises:
- The number of reasoning tokens spent on the same task now differs enormously between models.
Implicit premises:
- The decision-relevant quantity is cost per completed task, not price per token.
- Per-token price multiplied by a highly variable token count decouples the sticker price from the actual bill.
Inferences:
- Therefore efficiency (useful work per token / cost per task) is the correct frame for comparing these models.
Narratives
- The pelican-riding-a-bicycle probe: a full page of 18 pelicans generated across reasoning efforts (none, low, medium, high, xhigh, max) for all three models, with token counts and calculated costs β from 0.71 cents (gpt-5.6-luna at effort 'none') up to 48.55 cents (gpt-5.6-sol at max reasoning).
β Concrete, whimsical illustration that reasoning effort β not just model size β drives cost, reinforcing the proposition that price-per-token cannot capture real cost. - The SWE-Bench Pro reversal: Fable 5 scored 80% to GPT-5.6 Sol's 64.6%, and OpenAI happened to publish a benchmark-audit article estimating ~30% of SWE-Bench Pro tasks are broken the day before launch.
β Worked example that vendor benchmark presentation is strategic/self-serving β supports the 'mixed and partly self-serving' judgment.
Questions addressed
- β
Is GPT-5.6 actually better than Claude Fable 5 for serious coding work?
Partially: benchmarks are mixed (wins Agents' Last Exam, loses SWE-Bench Pro) and in hands-on use it is competent but 'not better than Fable so far' β a provisional 'no clear win' verdict. - β
Does price-per-token tell you which model is cheaper to run?
No β because reasoning-token counts vary so much per task, per-token pricing no longer maps to real cost-per-task. - β
What is genuinely new and interesting in this release?
The new API primitives β programmatic tool calling, native multi-agent subagents, explicit prompt-cache breakpoints, detail:original images β which Willison flags as the most interesting details. - β Are these new API features genuinely novel, or borrowed?
Willison notes several mirror Anthropic (dynamic filtering, subagents, Claude-style caching) but does not ask whether OpenAI's implementations differ meaningfully or perform better β the novelty question is raised implicitly and left open.
Gaps
- incompleteThe comparative verdict rests on OpenAI's own benchmark numbers plus one reviewer's early-access impressions on unspecified tasks β there is no independent, replicated head-to-head, no task list, no sample size, and no reproducible methodology behind either the 'wins Agents' Last Exam' or the 'not better than Fable' claim.
Read next: Read against sources that demand benchmark methodology and task specification before trusting scores (extract-experiences-with-local-models-for-coding on benchmark numbers being near-meaningless without task/method, extract-dont-train-evolve-harness on a score measuring model-and-harness together) and against Fable-evaluation guidance (extract-how-to-actually-prompt-fable-5 on evaluating on your hardest previously-abandoned tasks). - incompleteThe new API primitives are catalogued but untested β Willison explicitly flags them as features he 'needs to explore,' so there is no evidence yet whether programmatic tool calling or native multi-agent actually deliver, nor how they differ in behaviour or quality from Anthropic's existing dynamic-filtering and subagent mechanisms they resemble.
Read next: Read alongside harness/subagent treatments (extract-anatomy-of-an-agent-harness on subagent orchestration components, extract-agent-harness-engineering on converging harness patterns) and Anthropic's own tool-composition primitives to test whether OpenAI's versions are differentiated or merely catching up. - incompleteThe efficiency case relies on OpenAI's 'estimated cost' multiples ('roughly one-quarter', 'around one-sixteenth') with no independent measurement of cost-per-completed-task across a realistic workload β the very confound (variable reasoning tokens) Willison invokes to dismiss price-per-token also undermines taking these vendor cost-multiples at face value.
Read next: Read against unit-economics analysis of opposing cost vectors (extract-ai-inference-unit-economics on per-token costs falling while reasoning pushes per-query compute up) and against over-routing critiques (extract-hbr-energy-strategy-for-ai on routing tasks to models that exceed the work's requirements).
Related documents
- Generative AI in the Real World: Aishwarya Naresh Reganti on Making AI Work in Production
- What OpenAI and Anthropic Think Happens Next With AI
- Guest post: AI Inference Is Breaking Unit Economics
- GLM-5.2 is the new leading open weights model on the Artificial Analysis Intelligence Index
- 10 Things Developers Want from their Agentic IDEs in 2025
- The Almedra Token-Efficiency Benchmark, Updated For GLM 5.2
- Harness design for long-running application development
- GitHub Copilot's Project HydraFusion Promises Frontier Level Performance Through Multi-Model Routing
- How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks
- How to Actually Prompt Fable 5, Straight From the Team That Built It