AI-Driven Vulnerability Discovery
The shift to AI models finding, chaining and proving software vulnerabilities at machine scale, and the defensive reprioritization this forces on security programs.
Also known as: zero-day vulnerabilities, vulnerability chaining, exploit chain construction, proof generation, security-focused LLM / cyber frontier model, qualitative leap / different league, EPSS (Exploit Prediction Scoring System), hazard vs risk, machine-scale, wander problem, security through obscurity, default-closed posture, pointing machine, knowing machine, responsible disclosure, AI hacking, CVSS
How authors use it
Oldest first (extraction date when no publication date is known).
| Author | Their term | Their meaning |
|---|---|---|
| Assessing Claude Mythos Preview's cybersecurity capabilities Nicholas Carlini, Newton Cheng, Keane Lucas, Michael Moore, Milad Nasr, et al. (Anthropic) · 2026-04-08 | qualitative leap / different league | Not an incremental improvement but a discontinuous jump in capability. Opus 4.6: near-0% exploit success rate. Mythos: 181/several hundred. The authors argue this is not the same thing done better but a fundamentally new capability category. |
| Assessing Claude Mythos Preview's cybersecurity capabilities Nicholas Carlini, Newton Cheng, Keane Lucas, Michael Moore, Milad Nasr, et al. (Anthropic) · 2026-04-08 | vulnerability chaining | Combining multiple individually-limited vulnerabilities into a complete exploit. A read vulnerability alone is limited; a write vulnerability alone is blind. Chain them together (read to bypass ASLR, then write to escalate privileges) and you get root. Mythos can chain 2-4 vulnerabilities autonomously. |
| Backlash builds over NHS plan to hide source code from AI hacking risk New Scientist · 2026-04-20 | responsible disclosure | The process Harbuz's team followed: discovering vulnerabilities in NHS code using Mythos and reporting them privately to NHS before publication. |
| AI Companies Aren't Evil. But They Are Reckless. Julie Guirado (Persuasion / Center for Humane Technology) · 2026-05-04 | zero-day vulnerabilities | Security flaws unknown to software makers, which Mythos could autonomously identify — used as the specific mechanism of civilizational risk |
| NHS England rushes to hide software over AI hacking fears New Scientist · 2026-05-18 | default-closed posture | NHS England's new stance that all source code repositories are private unless an exceptional, formally approved case is made for publication — the inversion of the previous 'open by default' standard. |
| NHS England rushes to hide software over AI hacking fears New Scientist · 2026-05-18 | security through obscurity | Implicit concept the article critiques: the belief that hiding source code meaningfully reduces exploitable risk in a world where the code already exists in mirrors and where peer review surfaces flaws. |
| Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 | Security-focused LLM / cyber frontier model | A frontier model whose capabilities are oriented toward vulnerability research — finding bugs, reasoning about exploitability, and constructing exploits — as distinct from general-purpose coding assistants tuned for feature work. |
| Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 | Exploit chain construction | Taking several low-severity attack primitives and reasoning about how to combine them into a working exploit (e.g., use-after-free -> arbitrary read/write -> control-flow hijack -> ROP chain). Mythos's distinctive ability. |
| Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 | Proof generation | Closing the gap between 'suspected bug' and 'proven exploit' by writing code that triggers the bug, compiling it in a scratch environment, running it, and iterating on failure. The loop, not the bugs, is the point. |
| Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 | Wander problem | The failure mode of generic coding agents pointed at a repo with 'find vulnerabilities': they spread shallowly across the codebase rather than going deep on a narrow hypothesis. |
| Predict, Don't Enumerate Michael Roytman · 2026-06-04 | EPSS (Exploit Prediction Scoring System) | A statistical, non-LLM predictive model that, given a CVE and global exploitation signals, returns probability of exploitation in the next 30 days. Treated as the canonical public example of a 'knowing machine'. |
| Predict, Don't Enumerate Michael Roytman · 2026-06-04 | Pointing machine | A system (most current scanners + LLM bug-finders) that enumerates and names possible vulnerabilities without understanding their environmental risk. |
| Predict, Don't Enumerate Michael Roytman · 2026-06-04 | Knowing machine | A predictive system that understands how code behaves in a particular environment and recognizes the context that turns a hazard into a risk. |
| Predict, Don't Enumerate Michael Roytman · 2026-06-04 | Hazard vs risk | Hazard = a flaw that could theoretically be exploited. Risk = a flaw that can be weaponized reliably in this environment, against these controls, through this traffic. Bugs are abundant; weaponizable bugs against a given target are rare. |
| Predict, Don't Enumerate Michael Roytman · 2026-06-04 | Machine-scale | A problem regime where finding counts (hundreds of thousands to millions per month) structurally exceed human remediation capacity, making any human-scaled prioritization scheme self-defeating. |
| Predict, Don't Enumerate Michael Roytman · 2026-06-04 | CVSS | A severity-scoring framework that survives only because of regulatory inertia (PCI, HIPAA, breach-notification rules); easy to grade against, but uncorrelated with real exploitation. |
Documents (22)
- OpenAI Releases GPT-6 Astra for Coding and Computer Use Daniel Dominguez · 2026-09-10 source ↗ Reader 🖥️
OpenAI has released GPT-6 Astra, a model that extends its lineup from GUI computer-use and coding agency into a first-of-its-kind 'critical' cybersecurity capability tier, and while OpenAI's self-reported benchmarks show gains over its own prior model and mixed results against Anthropic's and Google's latest, the release is reported almost entirely through OpenAI's own claims, with the one qualitative safety finding it discloses — that Astra's written reasoning is harder to monitor than its predecessor's — passed over without scrutiny. - How Figma Uses AI Agents for Security Renato Losio · 2026-09-06 source ↗ Reader 🖥️
Figma's security engineering team, as relayed by InfoQ from the company's own blog posts, holds that AI agents equipped with persistent, separated memory, tightly scoped tools, and strict human-review guardrails (draft-by-default PRs, anti-leak prompts) can absorb much of a security team's repetitive investigative and detection work -- reporting roughly 70% faster complex-alert resolution, 20% fewer on-call pages, 100+ newly found vulnerabilities, and 80% code-reviewer precision -- while insisting that the right balance between agent autonomy and human oversight remains an open, evolving question rather than a solved one. - Google Mantis: An Agentic Vulnerability Scanning Harness for Reducing False Positives Sergio De Simone · 2026-09-06 Reader 🖥️
Google built Mantis, an open-source multi-agent harness that combines critic/reviewer agents, hierarchical repository context, and sandboxed reproduction of vulnerabilities, because conventional AI-powered vulnerability scanning is unreliable — plagued by hallucinated bugs and true-positive rates under 7% — and false positives can only be brought under control through disciplined agentic engineering, not by trusting a single LLM's judgment. - Podcast: Will Agentic AI Bring Fantasia's Sorcerer's Apprentice to Life?: A Conversation with Tracy Bannon Tracy Bannon · 2026-08-17 source ↗ Reader 🖥️
Agentic AI's risk is not evenly distributed or novel in kind -- it concentrates sharply at the moments an agent crosses from one software/trust ecosystem into another, it is already an extension of existing (not new) security threats, and its most under-appreciated cost is not a security breach but the silent erosion of human cognitive skill and retention as people and society outsource understanding, not just labor, to models they do not fully govern. - Expanding Daybreak as the Cyber Defense Window Narrows | OpenAI OpenAI · 2026-08-10 source ↗ Reader 🖥️
OpenAI is expanding vetted, tiered access to reduced-refusal cybersecurity models (culminating in GPT-5.6-Cyber via Daybreak Red) on the bet that arming trusted defenders with near-unrestricted frontier capability now, while access can still be gated by identity and legal controls, produces a net defensive advantage before attackers deploy comparable autonomous offensive AI at scale. - AI-Enabled Security Researchers Discover How a Crafted Video Can Provide Attackers Access to Your PC Olimpiu Pop · 2026-07-26 source ↗ Reader 🖥️
PixelSmash — a sixteen-year-old heap out-of-bounds write in FFmpeg's default-enabled MagicYUV decoder, triggerable by simply delivering an untrusted media file to any of dozens of common applications — shows both the fragility of foundational, widely-reused C libraries and how casually that discovery now gets attributed to a new wave of AI-enabled security research, without the article itself substantiating that attribution. - You Probably Won’t Read This Article…and That’s OK Rufus Rock · 2026-07-23 source ↗ Reader 🖥️
The collapse in the cost of producing credible-looking work — papers, code, bug reports, blog posts — across every domain is the latest instance of a recurring historical pattern in which cheap production overwhelms a scarcity-based trust signal and forces a new socio-institutional gate to be invented, but for AI specifically neither leaning on existing human-centric gatekeeping institutions (which entrenches incumbents) nor building an AI-based gatekeeper (which inherits the same blind spots and incentive problems as what it gates) is a clean solution. - Arvind Narayanan on Why AI Isn't All That Revolutionary Yascha Mounk · 2026-07-07 source ↗ Reader 🖥️
AI will be a transformation on the scale of electricity, but because most cognitive work resists full automation — only its 'execute' layer, not its 'decide' or 'deliver/accountability' layers, is what AI is actually replacing — and because economic value structurally migrates to whatever remains scarce (human time and judgment), the transformation will unfold over decades rather than years, leaving society real collective agency to choose how it is governed rather than forcing a choice between technological utopia and catastrophe. - Cybersecurity and the Gap Between Skill and Ability Bruce Schneier · 2026-06-29 source ↗ Reader 🖥️
Computers, and now AI far faster, are decoupling ability (the capacity to accomplish something) from skill (mastery earned through practice) — and because the norm-instilling process of acquiring skill no longer gates dangerous capability, the only workable response to democratized offensive AI is to harness AI for the defense. - The Language of AI Could Change How Humans Speak Bruce Schneier (with Ada Palmer) · 2026-06-29 Reader 🖥️
Because AI decouples the ability to cause harm from the hard-won skill (and the ethical formation that came with it) that once gated it — and because that capability is dual-use and unstoppable by guardrails once open-weight local models match frontier ones — the only viable response to AI-heightened cyber (and every other) risk is to harness AI for defense rather than to restrict the models. - Predict, Don't Enumerate Michael Roytman · 2026-06-04 Reader 🖥️
Now that AI makes vulnerability discovery effectively unbounded, security programs survive only by replacing severity-based enumeration with predictive, context-aware prioritization — and Anthropic's endorsement of EPSS is the external permission CISOs have been waiting for to make that shift official. - IBM and Red Hat Commit $5 Billion to Redefine the Future of Open Source in the AI Era IBM Newsroom · 2026-05-28 source ↗ Reader 🖥️
IBM and Red Hat are announcing — without yet demonstrating — that a $5 billion, AI-augmented, 20,000-engineer commercial clearinghouse (Project Lightwell) is the model enterprises should adopt to secure their open-source software supply chain against AI-accelerated vulnerability discovery. - NHS England rushes to hide software over AI hacking fears New Scientist · 2026-05-18 Reader 🖥️
NHS England has reversed its long-standing 'open by default' policy for publicly funded code, citing fears that Anthropic's code-analysis AI 'Mythos' could be used to find exploitable flaws — a move that security experts and former civil servants characterize as evidence-light, counterproductive, and harmful to the transparency on which public-sector accountability depends. - Project Glasswing: what Mythos showed us Grant Bourzikas · 2026-05-18 source ↗ Reader 🖥️
Frontier security-focused LLMs (exemplified by Mythos Preview) have made a real qualitative jump in exploit-chain construction and proof generation, but their value at production scale is unlocked not by faster patching or smarter single-agent use, but by wrapping them in a multi-stage harness of narrow, parallel, adversarially-validated agents and by hardening the architecture around vulnerabilities so that the gap between disclosure and patch matters less. - The Trump administration's AI doomer moment Casey Newton · 2026-05-05 source ↗ Reader 🖥️
The Trump administration, having spent over a year dismissing AI safety concerns as fearmongering and regulatory capture, has been forced by the demonstrable national-security risks of Anthropic's Mythos model to quietly revive the very pre-release government review regime it mocked and dismantled under Biden — revealing that accelerationist AI policy collapses when confronted with actual frontier-model capabilities. - AI Companies Aren't Evil. But They Are Reckless. Julie Guirado (Persuasion / Center for Humane Technology) · 2026-05-04 source ↗ Reader 🖥️
The absence of external AI governance is not a policy gap but a structural failure: a broken incentive system rewards reckless development, and only mandatory independent testing, transparency requirements, and legal liability can realign private incentives with public safety — as has been done with every other consequential technology. - Backlash builds over NHS plan to hide source code from AI hacking risk New Scientist · 2026-04-20 Reader 🖥️
NHS England's decision to withdraw publicly funded open-source code from public access — motivated by fear of AI-powered vulnerability discovery tools like Mythos — is counterproductive because it removes the security benefits of open scrutiny while doing nothing to stop determined attackers, and it betrays the transparency obligations owed to taxpayers. - Radar Trends to Watch: May 2026 Mike Loukides and Claude · 2026-04-20 Reader 🖥️
The AI industry is rapidly moving from experimental models to operational infrastructure — agents, orchestration layers, and security tooling — and the central tension is between open deployment and controlled access, a tension most visible in the divergent approaches to frontier security capabilities taken by Anthropic (restrict) and OpenAI (release). - Meta's new model is Muse Spark, and meta.ai chat has interesting new tools Simon Willison · 2026-04-10 source ↗ Reader 🖥️
The AI frontier is advancing simultaneously on two fronts — model capability (Meta's Muse Spark, Z.ai's GLM-5.1) and model danger (Anthropic's Mythos finding decades-old vulnerabilities at scale) — and the industry's response to both fronts reveals how the relationship between open and closed AI is being renegotiated under pressure from security realities. - Three reasons to think that the Claude Mythos announcement from Anthropic was overblown Gary Marcus · 2026-04-09 source ↗ Reader 🖥️
The Anthropic Claude Mythos announcement was more marketing spectacle than genuine breakthrough: the demo conditions were artificially easy, open-weight models already approximate the capability, and the model's benchmark improvements are incremental rather than revolutionary — so the public was 'played' by the hype. - Assessing Claude Mythos Preview's cybersecurity capabilities Nicholas Carlini, Newton Cheng, Keane Lucas, Michael Moore, Milad Nasr, et al. (Anthropic) · 2026-04-08 source ↗ Reader 🖥️
Claude Mythos Preview represents a qualitative leap in autonomous vulnerability discovery and exploitation — finding and exploiting zero-days in every major OS and browser, including bugs that survived decades of human auditing — and the security industry must begin urgent coordinated defense now, during the transitional period before these capabilities become broadly available, because the same general improvements in reasoning and autonomy that make models better at fixing vulnerabilities make them equally better at exploiting them. - Agentic AI in the Software Development Lifecycle (SDLC) Julie Isdahl · 2025-11-19 Reader 🖥️
Agentic AI integrated across the software development lifecycle is a strategic transformation Telenor's technology leadership should actively sponsor and scale now, not a tooling upgrade engineering teams can adopt on their own, provided it is paired with governance, security oversight, and workforce reskilling.
Propositions touching this concept (8)
By publication month, oldest first (extraction month when no publication date is known).
2025-09
- explicitAI-generated code introduces measurably more security risk than human-written code: Apiiro's 2024 research found 322% more privilege-escalation paths, 153% more design flaws, a 40% increase in secrets exposure, a 2.5x higher rate of critical (CVSS 7.0+) vulnerabilities, and 60% more reviewer security comments — while AI-assisted commits were merged into production 4x faster, bypassing normal review depth.
2026-04
- explicit⚡ disputed & corroboratedMythos Preview can autonomously find and exploit zero-day vulnerabilities in every major operating system and every major web browser
- implicitSecurity through obscurity is an ineffective strategy against sophisticated AI-powered threat actors.
2026-06
- explicitcorroboratedVulnerability management is now a machine-scale signal-to-noise problem that human-scale severity grading cannot solve.
- explicitCompliance regimes (CVSS, PCI, HIPAA) lag behind operational best practice and must be renegotiated in writing with auditors now.
- explicitMost organizations already possess the data inputs needed for a local knowing machine; the obstacle is integration and political will, not data acquisition.
2026-07
- explicitPixelSmash (CVE-2026-8461, CVSS 8.8 High) is a heap out-of-bounds write in the MagicYUV decoder that can cause remote code execution or crash any application using the vulnerable FFmpeg build.
2026-09
- implicitIntroducing AI into authorization decisions trades some of the predictability and auditability of a traditional hard security boundary for the ability to adapt to machine-scale, unanticipated agent behavior.
Open gaps (67)
- incompleteBannon claims the flagship Mythos-found vulnerabilities were 'replicated by tiny, cheaper models,' but does not name the models, cite a source, or give comparison numbers -- leaving her central 'hype vs. reality' claim about Mythos empirically unverifiable as stated, in contrast to the corpus's own more data-grounded account of Mythos's capability jump.Podcast: Will Agentic AI Bring Fantasia's Sorcerer's Apprentice to Life?: A Conversation with Tracy Bannon — read next: Check Anthropic's or independent third-party writeups of Mythos/Project Glasswing for any published comparison against smaller models on the same benchmark.
- International dimension entirely absent
- The auto-safety analogy is weaker than presented
- incompleteNarayanan's claim that rising capability historically improves safety rests entirely on the cybersecurity/vulnerability-discovery precedent, where defenders have structural first-mover access to their own pre-release software. It doesn't engage with risk categories where that defender-access asymmetry may not hold — bioweapons synthesis, or the targeted political repression Mounk raises later in the same conversation — leaving the broader 'capability increase = safer, by default' presumption under-defended precisely where it matters most.Arvind Narayanan on Why AI Isn't All That Revolutionary — read next: Offense/defense asymmetry literature in security economics; work specifically on whether the 'defenders get a head start' logic transfers to biosecurity or to information-operations contexts where no equivalent pre-release vendor advantage exists.
- incompleteThe paper doesn't discuss the implications for memory-safe language migration strategies. If the remaining vulnerability surface is increasingly in unsafe blocks (as the VMM case shows), does the industry need to rethink how unsafe code is audited, isolated, and minimized? The 'just rewrite in Rust' narrative needs updating given that Rust's unsafe blocks are now a primary target.Assessing Claude Mythos Preview's cybersecurity capabilities — read next: Rust safety literature; formal verification of unsafe blocks; the 'unsafe Rust' audit ecosystem
- incompleteThe cost figures ($20,000 for OpenBSD, $10,000 for FFmpeg) imply that nation-state actors — or well-funded criminal organizations — could run comprehensive vulnerability scans against all critical infrastructure software for less than the cost of a single human security researcher's annual salary. The geopolitical implications of this cost structure are not discussed.Assessing Claude Mythos Preview's cybersecurity capabilities — read next: Norwegian intelligence assessments (PST, NSM) on cyber threats; the economics of cyber offense vs. defense at national scale
- incompleteThe essay lands on 'harness AI for defense' as the solution without establishing that defense can keep pace with the offense it so vividly describes. Its own logic points the other way: ungated open/local models spread freely to norm-free outsiders who need only a copy, while effective defense requires comprehensive organizational capability, coordination and time. The attacker/defender asymmetry — the crux of whether the prescription works — is never argued; it is quietly assumed.Cybersecurity and the Gap Between Skill and Ability — read next: The Mythos capability assessment's discussion of offense/defense economics and the 'defenders benefit more, eventually' claim; offense-dominance vs. defense-dominance literature in security economics; Norwegian intelligence (NSM/PST) assessments on cyber threat balance.
- incompleteSchneier asserts that acquiring a skill instills a moral/ethical code and that this — not the scarcity of dangerous knowledge — is what has kept us safe. The claim is supported only by the rarity of murderous doctors and terrorist engineers, which is equally explained by motive, opportunity and detection. Whether professional socialization actually does the protective work he attributes to it is never examined, yet the whole 'norm-stripping' danger of AI rests on it.Cybersecurity and the Gap Between Skill and Ability — read next: Sociology of the professions and their ethics; criminology on why insiders with means rarely offend; work on norms vs. deterrence.
- incompleteNo recall or false-negative figures are given for the vulnerability-hunting or code-review agents -- only precision (80%) and detection-improvement percentages are reported, so a reader cannot tell how many real vulnerabilities or bugs the agents miss. This is exactly the blind spot the article's own 'precision before recall' framing would predict if recall improvement is being deliberately deferred.How Figma Uses AI Agents for Security — read next: Read Figma's full engineering blog posts (linked from the article) for any recall/false-negative disclosure; compare against extract-multi-agent-ai-production-security-operations#g2, which raises the identical unmeasured false-negative gap for a telco SOC's anomaly-gating layer.
- incompleteThe article never states any quantified accuracy figure for Mantis's own output — no measured true-positive rate, false-positive rate, or before/after comparison against the <7% baseline it cites for 'conventional' tools. The only numbers given (the <7% baseline and the 85% token reduction) describe the problem and an efficiency gain, not Mantis's actual detection accuracy.Google Mantis: An Agentic Vulnerability Scanning Harness for Reducing False Positives — read next: extract-project-glasswing-mythos#g1 flags the identical pattern (no quantitative baseline for a security-agent's triage quality) and extract-lawson-ai-write-better-code-slowly#g2 likewise notes a 'near zero false positive rate' claim offered with no numbers — read both alongside this piece as a recurring evidentiary gap across AI security-agent coverage in this corpus.
- incompleteGoogle's caution that the mantis-review negative filter 'should be used cautiously' because an overly broad filter risks suppressing genuine low-risk-looking vulnerabilities is stated as a warning, not a calibration method. No criterion, threshold, or measurement is given for what makes a filter 'cautious enough.'Google Mantis: An Agentic Vulnerability Scanning Harness for Reducing False Positives — read next: extract-when-guardrails-go-wrong#p3 — 'no binary classification system can simultaneously achieve zero false negatives and zero false positives' — supplies the theoretical frame this article's caution gestures at but never engages explicitly; extract-when-guardrails-go-wrong#g1 also notes the same absence of data on over-blocking calibration in a different domain (Anthropic's cyber safeguards).
- incompleteNo adversarial-robustness discussion: if attackers or malicious contributors know an agentic scanner with a rule-based negative filter and critic/reviewer stages is in the loop, they could potentially craft code patterns designed to trigger the negative filter and get real vulnerabilities auto-dismissed as false positives, or exploit known model biases in the critic stage.Google Mantis: An Agentic Vulnerability Scanning Harness for Reducing False Positives — read next: extract-project-glasswing-mythos#g3 raises the identical concern (attackers seeding code with patterns that exploit known model biases — false-negative attractors, hedging triggers) for a comparable LLM-based scanner; unexamined in both.
- incompleteNo named open-source projects, CVEs, or vulnerability classes that Project Lightwell has found, validated, or fixed are given, despite the claim that IBM and Red Hat 'have already begun collaborating with' early-adopter banks — there is no concrete before/after example of the clearinghouse in operation.IBM and Red Hat Commit $5 Billion to Redefine the Future of Open Source in the AI Era — read next: Watch for case-study follow-ups naming specific vulnerabilities remediated through Lightwell, comparable to how the corpus's pixelsmash/ffmpeg extraction documents a single real CVE end-to-end.
- uninformedThe justification statistics are not independently verified: the '90% of Fortune 500 rely on OSS' figure is sourced to Worldmetrics (a general statistics-aggregation site, not a primary research body), and the Anthropic Mythos vulnerability count is self-reported by a company that also has a commercial interest in amplifying AI-driven vulnerability-discovery urgency.IBM and Red Hat Commit $5 Billion to Redefine the Future of Open Source in the AI Era — read next: Check Worldmetrics' own sourcing for the Fortune 500 figure, and read Anthropic's original Glasswing update post directly for the ~3,900-vulnerability claim's methodology and caveats.
- uninformedThe claim that Telenor is 'already leveraging' AI-driven security agents 'emulating best practices from leaders like Google and Microsoft' gives no specifics on what these agents actually do, what they have caught, their false-positive rate, or how they are governed — making the risk-mitigation claim unverifiable as stated.Agentic AI in the Software Development Lifecycle (SDLC) — read next: extract-google-mantis-vulnerability-scanning for a concretely specified example of what a comparable AI security-agent system actually looks like in practice.
- incompleteThe Security section's items on AI-detection-evading malware and a self-propagating, agent-enabled worm are never connected to the Software Development section's move toward less-supervised agents (Skipper's zero-human-in-the-loop model) — if autonomous agent deployment is expanding at the same time autonomous attack tooling is, the article doesn't address whether the two trends compound each other's risk.Radar Trends to Watch: July 2026 — read next: Security research specifically on attack surfaces created by zero-human-in-the-loop coding/deployment agents, as distinct from attacks on AI models themselves.
- evidentialReason 2 relies on a linked tweet from Clement Delangue (Hugging Face CEO) — an interested party — without independent verification of the open-weight comparison.Three reasons to think that the Claude Mythos announcement from Anthropic was overblown — read next: Compare specific open-weight model capabilities against Mythos's demonstrated features to evaluate this claim.
- conceptualThe piece conflates 'immediate threat' with 'significance'. It is possible for Mythos to be both non-threatening in the short term and genuinely significant as a capability milestone. Marcus's framing does not address this distinction.Three reasons to think that the Claude Mythos announcement from Anthropic was overblown — read next: Consider how capability demonstrations that are not immediate threats can still represent meaningful shifts in the possibility space.
- motivationalMarcus does not disclose his own potential bias as a long-standing AI skeptic and critic of large language model capabilities. His brand depends on debunking AI hype.Three reasons to think that the Claude Mythos announcement from Anthropic was overblown — read next: Consider Marcus's track record and positioning when weighing his analysis — is he pattern-matching to his standard thesis?
- structuralThe piece is extremely short and relies on linked external content (tweets, columns) for substantiation. The argument is more of a thesis outline than a developed case.Three reasons to think that the Claude Mythos announcement from Anthropic was overblown — read next: Follow the linked sources to see if they provide the evidence Marcus's argument needs.
- incompleteThe article does not address whether Meta's shift from open weights to closed hosting is driven by competitive pressure, safety concerns, or compute economics. The 10x efficiency claim is stated but not analyzed — if frontier performance is achievable with 10x less compute, that should make open-weight releases more feasible, not less.Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: Meta's AI strategy documents; analysis of the economics of open-weight vs. API-hosted model distribution
- incompleteThe Glasswing section does not address the offensive/defensive asymmetry: Anthropic gives defenders a head start, but the underlying capabilities will inevitably proliferate. How long is the defensive window, and what happens when it closes?Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: Thomas Ptacek's 'Vulnerability Research Is Cooked'; cybersecurity literature on offense-defense balance with new capability categories
- incompleteThe article treats the Axios social engineering attack and the AI vulnerability discovery trend as separate stories, but does not connect them: AI could make social engineering attacks on maintainers more scalable and convincing, compounding both threats simultaneously.Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: Research on AI-enhanced social engineering; analysis of combined technical+social attack vectors
- incompleteThe GitHub activity statistics (275M commits/week, 2.1B Actions minutes/week) are presented without analysis of how much is AI-generated. If a significant fraction is AI-driven, these numbers may indicate code volume inflation rather than genuine productivity gains.Meta's new model is Muse Spark, and meta.ai chat has interesting new tools — read next: GitHub's own analysis of Copilot-attributed commits; research on whether AI-generated code volume correlates with software quality
- incompleteThe article quotes no cybersecurity expert who supports the NHS decision, even conditionally. A one-sided expert roster makes the argument persuasive but analytically weak — we don't hear the steelman of the NHS position.Backlash builds over NHS plan to hide source code from AI hacking risk — read next: NCSC or NHS Digital cybersecurity strategy documents; any published rationale from the NHS decision-makers.
- uninformedThe article does not distinguish between different types of NHS code — some repositories may contain infrastructure configurations, deployment scripts, or internal tooling where the security calculus differs from application code.Backlash builds over NHS plan to hide source code from AI hacking risk — read next: NHS England's GitHub repositories; analysis of what categories of code were actually published.
- incompleteThe broader policy question — how should governments respond when AI dramatically lowers the cost of finding vulnerabilities in public infrastructure code — is raised implicitly but not addressed. This is arguably the most important question the article touches.Backlash builds over NHS plan to hide source code from AI hacking risk — read next: CISA guidance on AI and software security; EU Cyber Resilience Act provisions; academic work on the security economics of open-source critical infrastructure.
- incompleteThe article does not identify who within NHS England drove the decision, what threat-modeling process was used, or what alternatives were considered. Without that, the 'panic' reading remains plausible but unproven; it could equally be a political-blame-avoidance maneuver dressed in security language.NHS England rushes to hide software over AI hacking fears — read next: FOI requests or follow-up reporting; literature on institutional risk aversion (e.g., Wildavsky on risk and culture; Power's 'Risk Management of Everything')
- incompleteThe Mythos capability claim is reported via prior coverage rather than reassessed; the article leans on AISI's summary without unpacking the evaluation methodology or scope.NHS England rushes to hide software over AI hacking fears — read next: The AISI blog post linked in the article; Anthropic's own model cards and red-team disclosures; broader work on cyber-offensive AI capability evaluation
- incompleteNo quantification of what's lost: how many repos, how much downstream reuse, what value to other organisations. The cost side of the cost-benefit framing is asserted rather than measured.NHS England rushes to hide software over AI hacking fears — read next: GDS impact assessments of public-sector open source; UK GovTech case studies; academic work on the economic value of open-source code
- incompleteNo engagement with intermediate options between fully open and fully closed — selective redaction, embargoed releases, signed binaries with private build pipelines, hash-based attestations. The frame is binary, which makes the criticism easier but flattens the design space.NHS England rushes to hide software over AI hacking fears — read next: Threat-model literature; the OpenSSF and CNCF supply-chain security playbooks
- incompleteThe article implies but does not develop a structural claim: that frontier-AI hype is producing a class of institutional decisions that withdraw from civic transparency commitments. The NHS case may be one of many; without comparable cases the claim is anecdote rather than pattern.NHS England rushes to hide software over AI hacking fears — read next: Survey other public-sector responses (national libraries, statistical offices, parliamentary IT) to AI scraping/ingestion; broader literature on 'AI moral panics' and their institutional consequences
- incompleteThe two disclosed cases where GPT-5.6-Cyber underperforms the general-purpose GPT-5.6 Sol (shorter/less detailed vulnerability reports; worse token-efficiency on ExploitBench within the standard turn budget) are reported but never explained — OpenAI doesn't say why specializing for exploit development would trade off against report quality or exploration efficiency, leaving open whether purpose-training for offense-adjacent tasks structurally degrades other defensive-relevant skills.Expanding Daybreak as the Cyber Defense Window Narrows | OpenAI — read next: Look for OpenAI's promised system card ('We will publish a system card with further evaluations of GPT‑5.6‑Cyber at a later date') for a methodological explanation.
- incompleteThe article discloses that Astra's written reasoning is harder to monitor than its predecessor's — a direct signal that the model's chain-of-thought is becoming a less reliable oversight tool — in the same breath as classifying Astra at the critical cybersecurity capability tier, but never connects the two facts or asks whether reduced monitorability undermines confidence that production safeguards against advanced offensive cyber tasks will actually hold.OpenAI Releases GPT-6 Astra for Coding and Computer Use — read next: Read against the corpus's ai-alignment material on chain-of-thought faithfulness and against extract-assessing-claude-mythos-cybersecurity-capabilities and extract-project-glasswing-mythos for how a rival lab's cyber-capable model handled the analogous emergent-guardrail-inconsistency problem (Mythos's 'emergent guardrails are inconsistent' finding, g-series).
- incompleteThe article presents the three-layer agentic stack (orchestration, execution, review) as an emerging standard but provides no analysis of whether this architecture is actually sound or just the first thing that crystallized. There is no discussion of failure modes, debugging, or accountability within this architecture.Radar Trends to Watch: May 2026 — read next: Bryan Cantrill's laziness essay; 'Hidden Technical Debt of Agentic Engineering'; distributed systems architecture literature
- incompleteThe tension between 'reimagining' (rebuilding software from scratch with AI) and 'laziness' (the virtue of designing for future maintainability) is present in the article but never connected. If AI makes building cheap but maintaining thoughtful, these two trends are on a collision course.Radar Trends to Watch: May 2026 — read next: Cantrill's full essay on laziness; the original 'Hidden Technical Debt in Machine Learning Systems' paper
- uninformedThe article does not address the labor market implications of AI becoming operational at the team level. If agents replace team-level workflows, the impact on employment is qualitatively different from individual productivity gains.Radar Trends to Watch: May 2026 — read next: Daron Acemoglu's work on AI and labor; the Stanford AI Index's labor market sections
- incompleteThe co-authorship attribution ('Mike Loukides and Claude') is noted without comment. The article does not discuss what it means for a trends roundup to be co-authored by an AI model — raising questions about editorial judgment, selection bias, and the epistemic status of the analysis.Radar Trends to Watch: May 2026 — read next: Discussions of AI co-authorship norms; editorial standards for AI-assisted journalism
- illogicalThe headline calls the discoverers "AI-Enabled Security Researchers," but the article body never states that JFrog used AI tooling in its research process — the only AI linkage is InfoQ's own editorial sentence connecting PixelSmash's timing to "the introduction of cybersecurity-focused frontier models" (a link to InfoQ's own earlier piece on Anthropic's Claude Mythos, not to any statement by JFrog about its methodology). The headline's conclusion doesn't follow from the evidence the body actually presents.AI-Enabled Security Researchers Discover How a Crafted Video Can Provide Attackers Access to Your PC — read next: Read JFrog's original PixelSmash disclosure post directly for any mention of AI-assisted methodology; compare against extract-assessing-claude-mythos-cybersecurity-capabilities#p8 (a language model finding an FFmpeg H.264 bug that survived millions of fuzzer-generated inputs) — a genuine, documented case of AI-found FFmpeg-class bugs that this article's unevidenced headline merely gestures toward.
- incompleteNo discussion of how many other dormant, similarly-aged vulnerabilities might exist in FFmpeg or comparable widely-reused C libraries, nor any base rate for how often sixteen-year-old bugs are being surfaced now versus in prior years — the article treats PixelSmash as a singular incident rather than placing it against a trend.AI-Enabled Security Researchers Discover How a Crafted Video Can Provide Attackers Access to Your PC — read next: extract-assessing-claude-mythos-cybersecurity-capabilities#p7 — "thousands of high- and critical-severity vulnerabilities exist in the open source ecosystem that have been missed by decades of human review and automated testing" — supplies exactly the quantitative backdrop this article lacks.
- uninformedThe article cites developers "calling for a prioritised migration toward memory-safe alternatives" without engaging the feasibility, cost, or precedent of rewriting a thirty-year-old, performance-critical C codebase like FFmpeg, nor whether memory-safe languages would even close this specific vulnerability class.AI-Enabled Security Researchers Discover How a Crafted Video Can Provide Attackers Access to Your PC — read next: extract-assessing-claude-mythos-cybersecurity-capabilities#p10 — "memory-safe languages do not eliminate vulnerability classes; the VMM bug exists in Rust unsafe blocks, which are unavoidable for hardware-level code" — directly complicates the migration narrative this article raises but never examines. Also extract-pragmatic-engineer-rust-alice-ryhl#g4 on the general evidentiary weakness of memory-safety cost-of-incident claims.
- incompleteThe article lists many affected product categories (Kodi, mpv, Emby, Immich, Slack, Discord, Telegram, AWS MediaConvert, Cloudflare Stream, Synology, QNAP) by inference from their FFmpeg dependency, but never confirms per-vendor patch status or whether any of these vendors has issued its own advisory — leaving a "you might be affected" list with no per-product remediation tracking.AI-Enabled Security Researchers Discover How a Crafted Video Can Provide Attackers Access to Your PC — read next: Check the CISA KEV catalog and individual vendor security advisories (Jellyfin, Nextcloud, Synology, QNAP, Cloudflare) for confirmed patch status.
- incompleteThe claim about "growing concern" and "palpable frustration" regarding legacy C codebases, attributed to "the broader industry discussion," rests on a single linked LinkedIn post/thread rather than any survey or aggregated data on developer sentiment.AI-Enabled Security Researchers Discover How a Crafted Video Can Provide Attackers Access to Your PC — read next: extract-verification-over-trust-in-software#p3 on the systemic compromise-vectors of a foundational library at curl's scale gives a more substantive angle on foundational-library fragility than anecdotal forum sentiment; also seek an actual developer survey (e.g. Stack Overflow) on C/C++ vs. memory-safe-language sentiment for corroboration.
- incompleteNo base rate or comparison to non-LLM SAST/DAST. The post claims Mythos produces 'noticeably higher quality' triage output and that the harness produces 'meaningful coverage', but provides no quantitative baseline against either prior frontier models or traditional static analysis. The reader has to take Cloudflare's qualitative judgment on faith.Project Glasswing: what Mythos showed us — read next: Read the Anthropic harness paper (planner/generator/evaluator) and any forthcoming Mythos technical report for quantified eval data; cross-reference with industry SAST benchmarks (e.g. OWASP Benchmark) to triangulate.
- incompleteVendor-incentive analysis is absent. Cloudflare was an invited Glasswing partner and benefits from being perceived as an Anthropic-grade security research org. The post is simultaneously a research report, a co-marketing artifact, and a strategic positioning piece for Cloudflare's edge product suite ('our products are built to apply [these principles] on behalf of customers'). None of this is acknowledged.Project Glasswing: what Mythos showed us — read next: Read Schneier on Security or Marcus on AI safety for an external skeptic's read; look for independent reproductions of Cloudflare's claims by orgs without an Anthropic partnership.
- incompleteNo adversarial robustness data. If attackers know LLM-based scanners are in the loop, they can seed code with patterns that exploit known model biases — false-negative attractors, hedging triggers, or refusal-inducing framings on the defender's side. The post discusses defender adversariality (adversarial review between agents) but not attacker adversariality.Project Glasswing: what Mythos showed us — read next: Anthropic's own work on adversarial robustness; the broader literature on prompt injection and indirect prompt injection in agentic systems.
- incompleteGeneralizability across stacks is asserted by silence. Cloudflare's codebase — heavily Rust, well-documented, with explicit trust boundaries and the discipline that comes from running a global edge network — is unusually well-suited to the harness as described. Whether the same harness pays off on a typical enterprise Java monorepo with sparse documentation and ambiguous trust boundaries is an open empirical question.Project Glasswing: what Mythos showed us — read next: Look for similar reports from non-Cloudflare practitioners (Google Project Zero, Microsoft, GitHub Advanced Security with Copilot Autofix at scale) using comparable harness architectures; pair with Böckeler on variety reduction as the precondition for any harness to work.
- incompleteThe 'context anxiety / compaction discards earlier findings' claim is offered as a one-line motivation for the harness but is the most theoretically interesting failure mode in the post — and the one that connects most directly to the user's harness-engineering reading thread. Bourzikas leaves the mechanism opaque (how often does compaction discard a real finding? does Mythos behave differently from general frontier models on this dimension?).Project Glasswing: what Mythos showed us — read next: Re-read the Anthropic harness paper's 'context anxiety' discussion; pair with Böckeler's variety-reduction framing and the smallcode failure-mode catalog; consider an extraction comparing the three on a single axis: 'what is the model's relationship to its own context, and what does the harness do about it?'
- incompleteThe model-written-patches anecdote is mentioned in one sentence and then abandoned. How many patches went out? How were the regressions detected — by Cloudflare's own pipeline or by customer impact? What was rolled back? Given that this is a public commitment that Cloudflare shipped broken patches authored by an LLM, the lack of detail is itself a finding.Project Glasswing: what Mythos showed us — read next: Watch for follow-up Cloudflare posts; pair with research on LLM-generated patch quality (e.g. recent academic work on Copilot Autofix regression rates).
- illogicalThe two-hour SLA argument elides a continuum. Bourzikas treats 'two-hour SLA' as the strawman and 'architectural hardening' as the alternative, but the realistic question is whether to push patch-speed to four hours, twelve hours, or 24 hours while also investing in architecture. The dichotomy is rhetorically convenient and conveniently routes attention toward Cloudflare's product moat.Project Glasswing: what Mythos showed us — read next: Read existing CVE-to-patch SLA literature (e.g. industry reports on time-to-remediate) to understand the actual distribution; question whether Cloudflare's customers are the ones being warned-off the two-hour target.
- uninformed (potentially)No engagement with formal-methods or non-LLM approaches to reachability analysis (the 'Trace' stage's job). Static analyzers, taint trackers, and symbolic execution engines have been doing reachability for decades; the post implicitly treats LLM tracer agents as a novel solution without engaging with what they replace.Project Glasswing: what Mythos showed us — read next: Compare against CodeQL, Semgrep, and formal taint-tracking literature; ask whether LLM tracer agents complement or substitute for these.
- missing evidenceNo discussion of whether NVIDIA has issued or plans mitigations (firmware, driver, or hardware). The post reports the vulnerability but not the vendor response.Rowhammer Attack Against NVIDIA Chips — read next: NVIDIA security bulletins and the researchers' responsible disclosure timelines.
- incompleteNo treatment of model risk management for the predictive model itself. If EPSS or a local knowing machine becomes the action-trigger, it inherits MRM scrutiny (drift, bias, calibration, explainability). The author critiques CVSS compliance inertia but does not engage the parallel inertia that 'models making security decisions' will trigger inside the same MRM/audit teams he's asking CISOs to renegotiate with.Predict, Don't Enumerate — read next: FIRST EPSS calibration studies; SR 11-7 / OCC model-risk frameworks applied to security tooling; recent work on operationalizing AI governance for cyber decisions (NIST AI RMF crosswalks with vulnerability management).
- incompleteAsymmetric-advantage claim under-defended. Local context is asserted as defenders' 'perhaps the only' asymmetric advantage, but attackers routinely acquire defender-side context via reconnaissance, insiders, prior compromises, and now AI-assisted OSINT. The argument needs a falsifiability condition: under what compromise of defender context does the predictive advantage collapse?Predict, Don't Enumerate — read next: Threat-intel literature on adversary recon; red-team write-ups on environment learning; emerging work on AI-augmented OSINT against enterprise estates.
- incompleteNo engagement with the political economy of the scanner/RBVM vendor base. 120+ vendors embed EPSS but largely sell on finding-volume. The piece prescribes a shift that undercuts their current product KPIs without naming that incentive conflict or how a CISO survives a renewal negotiation under the new metric.Predict, Don't Enumerate — read next: RBVM vendor positioning analyses; Gartner/IDC RBVM market notes 2024-2026; CISO procurement post-mortems.
- incompleteMythos and the '10x findings in 24 months' projection are presented as forcing function but uncited; treated as known. For a piece whose authority move is 'a frontier lab said X', the empirical claim about future discovery rates deserves either Anthropic's source or independent grounding.Predict, Don't Enumerate — read next: The cited Anthropic April 2026 security-ops guide in full; recent AI-discovered vulnerability disclosure datasets; CISA KEV growth-rate analyses.
- incompleteLocal knowing machine implementation is described at the inputs layer (CMDB, telemetry, controls) but not at the modeling layer. What kind of model? Trained how, evaluated how, retrained on what cadence? The piece tells CISOs to build something it does not specify enough to procure or staff against, beyond hiring a 'security-data engineer'.Predict, Don't Enumerate — read next: Academic literature on enterprise-local exploit prediction; case studies from organizations (Kenna/Cisco, ZeroFox, etc.) that have shipped contextualized scoring; MLOps patterns for security telemetry.
- illogicalMild tension: the piece both leans on Anthropic's authority to dislodge CVSS and warns that LLM detection without local prioritization is net-negative — yet does not address that Anthropic is simultaneously the producer of the LLM bug-finder (Mythos) it is warning about. The recommendation is treated as disinterested expertise when it could equally be read as supplier-side risk mitigation.Predict, Don't Enumerate — read next: Conflict-of-interest analyses of frontier-lab safety/security guidance; comparison with cloud-provider 'shared responsibility' framings that similarly externalize risk to customers.
- incompletePublic-sector and small-org perspective absent. The prescriptions assume a CISO with CMDBs, MRM teams, board reporting cadences, and audit relationships. The 80% of organizations without those structures — and which still face Mythos-class discovery volume via shared CVEs — get no treatment.Predict, Don't Enumerate — read next: CISA small-business cybersecurity guidance; municipal/SLED security maturity studies; managed-defense economics for under-resourced orgs.
- incompleteThe essay prescribes AI-for-defense as the solution but gives no argument or evidence that defenders can deploy AI as effectively or faster than the many unbound attackers — the offense/defense balance under AI is asserted, not analysed.The Language of AI Could Change How Humans Speak — read next: Compare with the swarm-attack asymmetry argument (attack arrives first, at scale) and offense/defense-balance theory (Clausewitz/Barker).
- unasked questionNo discussion of whether other frontier models (from Google, OpenAI, xAI) have similar capabilities — the narrative is anchored entirely on Anthropic/Mythos, suggesting the policy shift may be broader than one model.The Trump administration's AI doomer moment — read next: Comparative assessments of frontier model capabilities across labs; government red-team evaluations.
- unasked questionThe piece does not explore whether the 'supply chain risk' designation against Anthropic was legally sound or politically motivated beyond noting the Pentagon contract dispute.The Trump administration's AI doomer moment — read next: Legal analysis of the supply chain risk designation framework and its application to AI companies.
- scope limitationNo analysis of how foreign governments (China, Russia) are responding to these same capability thresholds — the national security framing is entirely domestic.The Trump administration's AI doomer moment — read next: International AI governance developments; Chinese AI regulation and military AI capabilities research.
- implicit premiseThe article assumes the pre-release review mechanism will function effectively but does not examine the Commerce Department's actual capacity to evaluate frontier models — a critical institutional capacity question.The Trump administration's AI doomer moment — read next: NIST/Commerce Department AI evaluation capabilities; UK AISI's experience with model evaluation.
- tensionCasey Newton discloses that his fiancee works at Anthropic but does not explore how this shapes the article's Anthropic-centric framing — the piece treats Anthropic as the protagonist of the policy reversal.The Trump administration's AI doomer moment — read next: Coverage of the same events from non-Anthropic-adjacent journalists for comparison.
- uninformedThe August 2026 OpenAI–Hugging Face incident is presented as an established, detailed fact (sandbox breakout, Artifactory cache poisoning, an 'eradication' by a defensive team) but the piece links only to the author's own prior commentary, not to any primary incident report, security researcher writeup, or statement from OpenAI or Hugging Face. In an essay whose entire thesis is that plausible claims are hard to verify, the load-bearing case study is itself offered without a verifiable primary source.When AI can do more than we can check — read next: Seek independent/primary reporting on the incident (security-researcher writeups, official OpenAI/Hugging Face statements, CVE or incident-registry entries) before treating the account as a confirmed case rather than a plausible-sounding one.
- illogicalThe essay's own practice is not obviously exempt from the problem it describes: it is itself a credible-looking piece of content (citations, footnotes, historical erudition) written by an author who elsewhere admits using Claude 'to help me editorialize and think through my ideas,' and its closing line ('Maybe ask Claude?') jokes past, rather than resolves, whether AI-assisted argumentative writing should be gated or trusted any differently than the AI-generated bug reports or papers it condemns.You Probably Won’t Read This Article…and That’s OK — read next: extract-franco-what-we-lose-when-ai-writes takes the harder version of this same self-exemption question head-on (whether AI-assisted writing degrades authorial selfhood/credibility).