You Probably Won’t Read This Article…and That’s OK
Rufus Rock · rss · 2026-07-23 source ↗ Reader 🖥️
AI SlopAI-Driven Vulnerability DiscoveryAttention as a Hijackable ResourceAuthenticity Premium (Human Signal in an AI World)Credibility Gating InstitutionsTrustVerifiability (as the Quality Bar)
The collapse in the cost of producing credible-looking work — papers, code, bug reports, blog posts — across every domain is the latest instance of a recurring historical pattern in which cheap production overwhelms a scarcity-based trust signal and forces a new socio-institutional gate to be invented, but for AI specifically neither leaning on existing human-centric gatekeeping institutions (which entrenches incumbents) nor building an AI-based gatekeeper (which inherits the same blind spots and incentive problems as what it gates) is a clean solution.
theoretical · mixed — Primarily theoretical — the author is diagnosing a dynamic (why credible-looking content is flooding every domain) and searching for a conceptual understanding of what comes next, not prescribing a specific action. The mode mixes exposition (the cost-collapse diagnosis), narrative (the printing-press/journal history), and argument (evaluating two candidate solutions and rejecting both).
Structure
| Part | Role |
|---|---|
| Self-referential opening ("Stop there! If you are reading this...") | context |
| The curl/open-source maintainer bug-report flood (Daniel Stenberg) | evidence establishing the core cost asymmetry |
| Author's own Claude Code fake-research-paper anecdote | evidence, personalized and self-implicating |
| General claim: cost of credible-looking work is heading to zero across domains | the diagnostic core claim |
| History of book/document abundance and the invention of the curated journal (Gutenberg, Gessner, Rich, Blair, Schopenhauer, Oldenburg/de Sallo) | analogical evidence establishing 'gate collapse → new gate invented' as a recurring pattern |
| Critique of digital popularity-proxy gates (PageRank, engagement-driven recommenders, algorithmic attention rents) | evidence that the current gate was already broken before AI arrived |
| "AI is a dam buster" — AI floods domains that relied on human-judgment gates | conclusion tying the diagnosis to the present AI moment |
| Candidate solution 1: lean harder on human-centric institutional gates | evaluated and rejected (entrenches incumbents, undoes democratization) |
| Candidate solution 2: build an AI-based gatekeeper | evaluated and rejected (turtles-all-the-way-down + adversarial incentive problem) |
| Closing admission of no clean answer ("Maybe ask Claude?") | conclusion / open question |
Key terms
- gate Credibility Gating Institutions
Any socio-institutional mechanism — scarcity, a curated journal, peer review, a credential, a citation count, an algorithmic ranking — that stands between production and consumption, rationing scarce attention and vouching for quality. - credible-looking
The surface appearance of rigor and quality (citations, data, p-values, plausible prose, proper structure) that AI can now produce almost for free, and which does not reliably correlate with actual soundness — a deliberate split between appearance and substance. - the baby (in 'throw the baby out with the bath slop')
The genuinely good, often undiscovered work that risks being filtered out along with AI slop if a gate is too restrictive or too entrenched — his coined variant of the idiom names the specific risk of over-correcting. - scarcity gate Credibility Gating Institutions
The pre-modern default gate, in which the sheer difficulty and cost of producing something (a hand-copied book, a hard-won degree) functioned as an imperfect proxy filter for whether it was worth attention.
Propositions
- explicitcorroboratedThe cost of producing credible-looking work — papers, code, cover letters, bug reports, mathematical proofs, risk analyses — is collapsing toward zero across virtually every domain, while the cost of validating that work has not fallen.conf: highsupports ←When Content Is Free, Trust Is the Product · p1 — Both open from the same premise: production cost has collapsed while the cost/capacity of evaluating output has not, flooding readers with more plausible content than they can assess.
- explicitThis cost asymmetry produces a flood of high-volume, low-signal content that diverts expert attention away from genuinely valuable work — exemplified by open-source maintainers (e.g. curl) drowning in plausible-but-mostly-worthless AI-generated bug reports.conf: high
- explicitdevelopedHistorically, whenever the cost of producing information collapses (Gutenberg's press, cheap paper, spreading literacy), the prior scarcity-based gate stops working and society invents new socio-institutional gates — exemplified by the curated journal (Oldenburg's Philosophical Transactions, de Sallo's Journal des sçavans).conf: highextends ←Are We Entering a New Age of Creativity with the Help of AI? · p4 — The Atlantic's bet on curated 'meaning' as the monetizable layer is a concrete instance of a society inventing a new gate once the prior cost-of-content-production barrier collapses.
- explicitcontestedExisting digital popularity-based proxies for quality (PageRank, engagement-driven recommendation algorithms) don't measure whether something is worth attention — they measure how much attention it has already received — creating a self-reinforcing, winner-take-all attention dynamic where the platform's incentive (engagement, ad revenue) diverges from the user's interest (content worth their time).conf: highextendsAdam Mosseri: AI is a tailwind for authenticity · p23 — Both critique recommendation algorithms as unreliable arbiters of value — Mosseri from the illegibility of embedding vectors to human interest, this document from the self-reinforcing, winner-take-all popularity dynamic (attention accrues attention).contradicts ←When Content Is Free, Trust Is the Product · p7 — Baron invokes PageRank approvingly as the correct model for how reputation should work among practitioners; the existing extraction argues PageRank-style popularity proxies are dysfunctional because they measure attention already received rather than genuine worth — a live tension in the corpus over the same mechanism.
- explicitdevelopedAI did not break a working gate — the popularity-proxy gate was already dysfunctional — but AI is now flooding every domain that relied on scarcer, human-judgment-based gates (academic journals, open-source repos) simultaneously with the already-strained algorithmic platforms.conf: highextends ←Are We Entering a New Age of Creativity with the Help of AI? · p7 — Provides a concrete case (the Atlantic under Powell Jobs) of AI flooding an information domain and a human-judgment editorial gate consolidating power in response, rather than being displaced.
- explicitdevelopedLeaning harder on existing human-centric institutional gates (reputation, credentials, follower counts, h-index, personal networks) is the most likely near-term response, but it entrenches incumbents and undermines the democratization of contribution that cheap AI-assisted production made possible.conf: highextendsAdam Mosseri: AI is a tailwind for authenticity · p21 — Mosseri's answer — judge content by point of view and the person behind it, label provenance, let users decide — is a concrete third gate design (neither pure human-institutional gatekeeping nor an AI reviewer) that this document's two-candidates framing never considers.supportsThe Kubernetes Approach to AI-Assisted Maintainership Prioritises Human Accountability · p3 — Kubernetes mandating final human review and authority over every AI-assisted contribution is a concrete, already-adopted instance of 'lean harder on human-centric gates' — the exact candidate solution this document argues entrenches incumbents and adds friction, here observed in the open-source maintainer domain this document's own opening example is drawn from.extends ←When Content Is Free, Trust Is the Product · p3 — Gives a concrete, first-person instantiation of the abstract prediction that the near-term response to the content flood is leaning harder on existing human-centric institutional gates (reputation, credentials, track record).
- explicitBuilding an AI-based gatekeeper (a model that reads and filters content directly) faces a turtles-all-the-way-down problem: since the gate and the content it gates are drawn from the same underlying model capabilities, a detector built from frontier-model capability may inherit the same blind spots as the content it's meant to catch.conf: highsupportsA cautionary tale about AI in tech writing: Why "Trust but Verify" is the only way to scale · p2 — Williamson's warning that raw LLM output must never be trusted directly, but wrapped in a deterministic verification pipeline, illustrates exactly why 'ask another LLM to gate the content' can't work as stated — the validating work has to be structurally separated from the generating model, echoing this document's turtles-all-the-way-down concern.
- explicitdevelopedAn AI gatekeeper also creates an adversarial incentive problem: once both the generating side and the gate-checking side use powerful AI, each side is incentivized to build systems that deceive the other (a deceptive job-applicant AI vs. a hiring AI; a p-hacking-friendly research AI vs. an editorial-review AI).conf: highextends ←Co-Existence and the End of Co-Intelligence · p7 — Mollick's account of designing content to satisfy AI evaluators is a concrete producer-side instance of the adversarial AI-gatekeeper dynamic that piece analyzes theoretically.
- implicitThe author assumes 'worth reading'/'worth attention' is knowable in principle by some evaluator (human or AI) prior to consumption — i.e. that a ground truth of quality exists separate from any particular gate's proxy for it — without ever defining what that ground truth actually is.conf: medium
- implicitThe essay implicitly treats AI-origin and human-origin as the two candidate quality tiers to sort between, without considering a future in which 'who or what produced this' stops predicting quality altogether — i.e. AI output eventually converging with human output not just in appearance but in the actual quality distribution.conf: medium
- explicitThe article enacts its own thesis by opening with an ironic acknowledgment that the reader probably won't read it — self-referentially performing the attention-scarcity/gate problem it goes on to analyze.conf: high
Arguments
A new socio-institutional gate is needed to replace the collapsed scarcity/credibility signal. strength: medium
Explicit premises:
- The cost of producing credible-looking work has collapsed across domains (p1).
- Historically, whenever production cost collapses, old gates fail and new institutional gates get invented (p3).
- Existing digital-era gates (popularity/engagement proxies) were already imperfect and are now overwhelmed by both AI volume and their own perverse feedback loops (p4, p5).
Implicit premises:
- Some rationing/signaling mechanism is necessary in principle for any attention economy — pure abundance without gating cannot self-sort into worth-reading and not-worth-reading.
- Quality is not directly perceivable at the moment of choice, so a third-party proxy signal is structurally required.
Inferences:
- If the historical precedent holds, whatever gate comes next will itself eventually be overwhelmed by cheaper ways of gaming it — implying gates are a permanent arms race rather than a stable equilibrium, a conclusion the author gestures at but never states outright.
Neither of the two obvious candidate solutions — lean on human-centric gates, or build an AI-based gate — is a clean answer. strength: high
Explicit premises:
- Leaning on human gates entrenches incumbents and undoes the democratizing benefit of cheap production (p6).
- An AI gate inherits the blind spots of the model it's built from (turtles-all-the-way-down) and creates a new deception-arms-race incentive between generator and gatekeeper (p7, p8).
Implicit premises:
- A viable gate must both preserve broad access (avoid incumbency entrenchment) and reliably discriminate quality (avoid inheriting blind spots) — the author treats these as necessary joint criteria for 'clean' without ever stating them as explicit criteria.
Inferences:
- Since each named candidate fails a different one of these two criteria, a workable gate — if one exists — probably has to be a hybrid or something structurally different from either, an inference the author gestures toward ('Maybe the answer lies somewhere between the two avenues') but never develops.
Narratives
- Daniel Stenberg (curl maintainer) documenting a rising tide of plausible-but-mostly-worthless AI-generated bug reports — cheap to produce, expensive to validate.
→ Grounds the abstract cost-asymmetry thesis (p1, p2) in a concrete, verifiable case and sets the article's opening emotional register ('drowning'). - The author's own experiment prompting Claude Code to research an alignment idea, which produced a full, professional-looking LaTeX paper (real experiments, p-values, figures, mostly-real bibliography) that was substantively poor but would take a domain expert only 2–3 minutes to spot as slop.
→ Personalizes and self-implicates the author in the dynamic he critiques, and supplies a first-hand, calibrated cost estimate for the validation side of the cost asymmetry. - The centuries-long history of 'too much to know' complaints — Conrad Gessner (1545) on the 'confusing and harmful abundance of books,' Barnaby Rich (1613) on 'the multiplicity of books,' Ann Blair's historical framing, and Schopenhauer's tirade against 'the immense number of bad books' — culminating in the 1665 invention of the curated journal by Oldenburg and de Sallo.
→ Implicitly supports the argument that 'gate collapse → new gate invented' is a recurring historical pattern rather than a novel AI-era problem, licensing the analogy to today.
Questions addressed
- ✅ Why are open-source maintainers and academic journals suddenly overwhelmed by low-quality submissions?
Because AI has collapsed the cost of producing credible-looking work while the cost of validating it stayed constant, so volume floods past whatever gate previously worked. - ⭕ What new gate should replace scarcity/human-judgment gates now that AI floods them?
- ⭕ Is AI-driven credibility collapse categorically different from earlier information-abundance crises (printing press, industrialized printing), or just a faster instance of the same pattern?
The author flags caution ('AI is a truly novel technology in its radical generality') but never actually settles the question either way. - ⭕ Who would build, own, or be incentivized to build the next gate?
Gaps
- incompleteThe essay never asks who would build, own, or be incentivized to build the next gate. Its own historical example (Oldenburg curating Philosophical Transactions) was an act of individual/institutional entrepreneurship, but the forward-looking discussion of candidate solutions stays abstract ('we' invent gates) without asking who has the incentive, capital, or authority to do it this time — especially since, per the essay's own PageRank point, whoever builds the gate is also likely to own the incentive to bias it toward profit rather than quality.
Read next: Sources on platform governance and who controls attention infrastructure — the 'algorithmic attention rents' work the author references (with Tim O'Reilly and Ilan Strauss) would be the natural next read.closed byWhen Content Is Free, Trust Is the Product — That essay never asked who would build, own, or be incentivized to build the next content-credibility gate. This essay answers concretely from the inside: an existing publisher-institution with decades of pre-AI reputation capital (O'Reilly) is repositioning its editorial vouching network as a paid product ('Expert Intelligence') for AI agents — naming both the incentive (commercial) and the capital (its expert relationships) that the earlier essay left abstract. - illogicalThe essay's own practice is not obviously exempt from the problem it describes: it is itself a credible-looking piece of content (citations, footnotes, historical erudition) written by an author who elsewhere admits using Claude 'to help me editorialize and think through my ideas,' and its closing line ('Maybe ask Claude?') jokes past, rather than resolves, whether AI-assisted argumentative writing should be gated or trusted any differently than the AI-generated bug reports or papers it condemns.
Read next: extract-franco-what-we-lose-when-ai-writes takes the harder version of this same self-exemption question head-on (whether AI-assisted writing degrades authorial selfhood/credibility). - incompleteThe essay treats 'lean on human institutions' and 'build an AI gatekeeper' as the only two candidate solutions, never considering structural/economic responses that don't require any single evaluator to certify quality up front — e.g. market mechanisms (reputational staking, financial bonds against bad submissions), friction taxes on submission volume itself, or provenance/attestation schemes that gate by traceability rather than by judging content quality directly.
Read next: Software supply-chain security's provenance/SBOM/attestation work already in the corpus is a working example of 'gate by provenance rather than by quality judgment' this essay doesn't consider. - incompleteThe essay's two candidate gates are evaluated only on who they exclude (incumbents entrenched, or genuine work missed) and on blind-spot/incentive failure — never on cost. The entire argument's premise is a cost asymmetry (cheap to produce, expensive to validate), yet the essay never asks how expensive either candidate gate is to build and run relative to the near-zero cost of the content it must filter.
Read next: extract-williamson-trust-but-verify-ai-tech-writing's concrete pipeline (deterministic tooling plus human review concentrated only at the genuine bottleneck) is a worked example of a gate designed explicitly around where validation cost is cheapest to spend, which would sharpen this essay's abstract discussion.
Closes gaps elsewhere
- Assessing Claude Mythos Preview's cybersecurity capabilities · g1 — The same analysis applies directly: this essay's diagnosis (cost of production down, cost of validation flat) and its evaluation of candidate structural responses (human-gate entrenchment vs. AI-gate turtles-all-the-way-down and incentive problems) is the general theory of which 'can the volunteer-maintainer model survive AI-scale vulnerability discovery' is a specific instance.
- Meta's new model is Muse Spark, and meta.ai chat has interesting new tools · g1 — Supplies the missing structural analysis that gap flags as absent: frames the maintainer-overload dynamic as the latest instance of a recurring 'scarcity gate collapses → new institutional gate gets invented' pattern, and evaluates the two live candidate structural responses (lean harder on human-centric gates vs. build an AI-based gate), showing why each fails on its own terms rather than simply calling for 'more money and more maintainers.'
Related documents
- The Kubernetes Approach to AI-Assisted Maintainership Prioritises Human Accountability
- When Content Is Free, Trust Is the Product
- Podcast: Will Agentic AI Bring Fantasia's Sorcerer's Apprentice to Life?: A Conversation with Tracy Bannon
- DeepSeek v4, and the end of the OpenAI/Microsoft AGI clause
- The Hidden Realities of AI Adoption
- Are We Entering a New Age of Creativity with the Help of AI?
- How a Museum Marketing Team Used AI to Bring People Closer to Art
- IBM and Red Hat Commit $5 Billion to Redefine the Future of Open Source in the AI Era
- Andrew Kelley Interview: Why He Built Zig, Banned AI Contributions, and Moved Zig off GitHub
- Adam Mosseri: AI is a tailwind for authenticity