Token Throughput

The rate at which a person or organization can productively consume AI inference tokens — the new utilization metric, and a metric that invites gaming.

Also known as: token throughput, Token throughput, token burn, tokenmaxxing, tokens (as consumed by CMOs)

How authors use it

Oldest first (extraction date when no publication date is known).

AuthorTheir termTheir meaning
Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI
No Priors: AI, Machine Learning, Tech, & Startups · 2026-03-20
token throughputThe rate at which you can consume AI inference tokens — the new equivalent of GPU utilization, representing your productive capacity
Wow, this tweet went very viral!
Andrej Karpathy · 2026-04-02
token throughputThe volume of LLM input/output tokens consumed by a user's workflow, here shifting from code to knowledge manipulation
LLM Knowledge Bases
Andrej Karpathy · 2026-04-10
token throughputThe volume of LLM tokens consumed per unit time, here shifting from code generation to knowledge manipulation.
Hard truths about building in the AI era | Keith Rabois (Khosla Ventures)
Lenny's Newsletter · 2026-04-12
tokens (as consumed by CMOs)AI inference compute — LLM API calls. Rabois predicts marketing will consume more AI compute than engineering.
I benchmarked CC's caveman plugin against 'be brief'. The token math is wild.
TroyHay6677 · 2026-04-30
Token burnThe rate at which output tokens are consumed, treated as a resource management problem analogous to CPU profiling
Reinventing team flow within AI uncertainty
Avanscoperta Blog · 2026-05-14
TokenmaxxingBorrowed from Gergely Orosz: the pattern of organizations incentivizing AI usage by measuring token consumption, which the author argues is close to certain to be gamed and is especially unreliable in collaborative settings like pairing.
This Week in AI: Production Viability
Michelle Smith (O'Reilly Network) · 2026-06-06
tokenmaxxingOptimizing for token volume as a proxy for AI productivity, which incentivizes inefficient code and runaway spend
The tokenmaxxing party is over, and Revenium is mopping up
Chris J. Preimesberger · 2026-06-09
tokenmaxxingThe ~18-month corporate phenomenon of maximizing token/LLM consumption as an internally tracked metric (including leaderboards ranking engineers or departments by tokens consumed), driven by top-down mandate rather than tied to business outcome.
The 8 software engineering metrics AI broke
Michael Hill · 2026-06-16
TokenmaxxingThe practice of deliberately maximizing AI token consumption to game a productivity metric rather than to produce better software — presented here as the purest current instance of Goodhart's Law under AI.
Agentics / Tech Things: Tokenmaxxing is dead, long live tokenmaxxing
theahura · 2026-06-27
tokenmaxxingDeliberately maximizing AI inference-token consumption as a policy or strategy — spending (or encouraging spend of) large sums on tokens as an end or a forcing function, not merely as a byproduct of doing work. The author splits it two ways: temporally (v1 = subsidy-era incentive-gaming to force adoption, now dead; v2 = ROI-driven maximal spend justified by compounding correctness, being reborn) and by target ('tokens for your developers' via Claude Code + loops, vs 'tokens for your pipelines' via brittle custom agents).
The Pulse: Interesting AI coding stats from Cursor
The Pragmatic Engineer (Gergely Orosz) · 2026-07-09
tokenmaxxingRaised as a possible explanation for power users' extreme volume — spending tokens to top usage leaderboards rather than to ship value.
What is “loop engineering?”
The Pragmatic Engineer · 2026-07-14
tokenmaxxingPer the section-5 preview only: implied to describe loop setups (especially at companies paying per-token API prices) that burn tokens/cost disproportionately once looping is adopted uncritically — the term itself is not defined in the available text.
How building software is changing at Anthropic
The Pragmatic Engineer · 2026-07-28
TokenmaxxingGaming or inflating token-usage metrics that a token budget or leaderboard would otherwise incentivize; named here only to say Anthropic doesn't have this problem because there is no token budget or usage tracking to game.
Presentation: A Few Predicted Talks From QConAI 2030
Meryem Arik · 2026-09-14
tokenmaxxing (reframed)A metric she borrows from another QCon talk and reframes: rather than maximizing raw token consumption, the thing to maximize is the ratio of delivered output to total cost (salary plus token spend) -- someone spending $20,000/month on tokens can be exactly as good as someone spending $500/month if their output justifies it.

Documents (17)

Propositions touching this concept (11)

By publication month, oldest first (extraction month when no publication date is known).

2026-03

2026-06

2026-07

2026-08

Open gaps (30)