AI summary · arXiv: 2611.06629v1 · econ.GN
Does Frontier AI Strengthen Cyber Defense? Evidence from Project Glasswing
The essentials
Project Glasswing access to Claude Mythos Preview more than doubled participating firms’ vulnerability disclosures without detectable slower remediation or increased exploitation of the additional flaws.
Question
Does access to frontier AI improve firms’ cyber defense, and how does it affect independent vulnerability researchers and attackers? The paper also examines whether increased disclosure creates greater exploitation risk.
Method
The study combines public vulnerability records, severity and weakness data, researcher credits, remediation information, and exploitation catalogs. It compares 13 Glasswing firms with 267 Chinese firms using firm-month difference-in-differences, analyzes 7,237 external researchers by their pre-launch exposure to Glasswing code, and examines exploitation outcomes against Chinese and large non-Chinese comparison firms.
Findings
-
Result
Glasswing firms’ disclosures rose by about 120% relative to Chinese firms, equivalent to roughly 36 additional vulnerabilities per firm per month.
See the passage in the paper
Column (1) shows that the Glasswing firms’ disclosures rose by 0.784 log points relative to the Chinese firms, an increase of about 120%. At the Glasswing firms’ pre-launch mean of 29 vulnerabilities per firm and month, the estimate corresponds to about 36 additional disclosures per firm and month.
-
Result
The increase covered severe and remotely exploitable flaws, while the measured time to remediate reported vulnerabilities did not increase.
See the passage in the paper
The rise was largest for high-impact vulnerabilities, which increased about two and a half times, and vulnerabilities that can be exploited remotely without credentials and those present in many releases rose broadly in line with all disclosures.
- Result External researchers reported fewer vulnerabilities in Glasswing firms’ code and more in other vendors’ code, without a detected change in their probability of being active.
-
Result
The additional disclosures were not accompanied by a detected increase in the number of exploited vulnerabilities; the share exploited soon after disclosure fell, largely alongside fewer zero-day vulnerabilities among disclosures.
See the passage in the paper
The number of exploited vulnerabilities distinguishes the two, and it did not change relative to the large non-Chinese firms (Appendix Table A11): neither the number exploited within one, two, or three months of publication nor the number of zero-day or n-day exploitations moved significantly.
-
Authors’ interpretation
The author interprets the pattern as evidence that frontier AI helped defenders discover latent flaws before attackers used them, while warning that the results do not establish that pre-emption reduced the number of zero-days.
See the passage in the paper
The evidence so far therefore shows that the flaws added by AI access were latent flaws that attackers were not using, which is the premise of pre-emption, but not pre-emption itself: the number of Glasswing zero-days did not change (Appendix Table A11).
Limitations
- The study measures publicly disclosed vulnerabilities rather than the underlying stock of flaws or all discoveries, and disclosure counts also depend on validation and publication decisions.
See the passage in the paper
I observe disclosed vulnerabilities rather than the underlying stock of flaws or the total number discovered, and disclosure counts reflect discovery, validation, and the decision to publish.
- Nonrandom selection into Glasswing and the use of Chinese firms as the main comparison group mean the estimates compare access to Mythos with other available AI tools, not AI with no AI.
See the passage in the paper
Because Anthropic chose the firms with access and the main comparison group consists of Chinese firms operating under different disclosure rules, the estimates measure access to Mythos Preview relative to the AI tools available to these firms, not the effect of AI relative to no AI
- The paper observes vendor remediation, not whether or when users installed fixes, so it cannot establish the security status of software in use.
See the passage in the paper
Finally, observing vendor fixes does not show whether or when users installed the patches, so the results concern disclosure and vendor remediation rather than the security of software in use.
Why it matters
The authors argue that frontier AI can shift the vulnerability-discovery race toward defenders, with independent researchers reallocating effort to other code rather than leaving the market. But restricted access can create a geopolitical security gap, and the results leave open how long that gap persists and what happens when attackers obtain comparable models.
Written by AI from the paper. Passages are checked word for word against the text we analysed; the rest may contain errors.
Ask questions about this paper to our AI assistant
How to chat with this paper? Illustrated guide
You can also chat with multiple papers at once here.
Keep this conversation — a free account saves your questions and answers, your collections of papers and your alerts.
Continue with Google Create a free accountTools for this paper
Advanced tools Premium
For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium
Papers around this one
See them on a mapRanked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
Does AI Help Cyber Attackers or Defenders? Evidence from Nonpublic Vulnerabilities and Subsequent AttacksTobias Heldt, Matthew Turk, Christoph R. Landolt et al. · 2026 · Not summarized yet
The study tests AI models on private vulnerabilities for exploit generation, repair, and attacks, while this paper estimates firms’ real-world outcomes after frontier-model access.
Abstract
The release decision for frontier AI systems increasingly relies on cyber capability benchmarks, yet public vulnerability benchmarks can expose agents to previously published advisories, exploits, and fixes, making it difficult to distinguish prior exposure from capability on unseen vulnerabilities. We evaluate open-weight and proprietary AI models on exploit generation, vulnerability repair and subsequent attacks in five nonpublic software environments, including vulnerabilities we privately disclosed while they remained unpatched. Researcher-developed and reviewed deterministic graders, not LLM judges, determine task scores. Comparisons with 209 disclosed vulnerabilities and cryptographic …
-
The Safety Exposure Paradox: How Frontier AI Safety Research May Amplify Cyber Risk in Financial InfrastructureAbena Primo, Azubike Okpalaeze, Al Amin et al. · 2026 · Proceedings of the 7th National HBCU Blockchain, Fintech & AI Conference · Not summarized yet
The case study examines whether frontier-AI safety disclosures expose offensive capabilities, rather than measuring firms’ vulnerability discovery and exploitation outcomes.
Abstract
Frontier artificial intelligence laboratories now publish detailed accounts of how their models behave under adversarial pressure: red-team transcripts, capability thresholds, interpretability findings, and responsible-scaling frameworks. These disclosures are widely treated as safety infrastructure, built to keep dangerous capabilities contained and visible to regulators. This paper argues that the same disclosures can function as a second, less examined kind of infrastructure: a map of where a model’s offensive ceiling sits, available to anyone willing to read it. Using a comparative case study of the published capability-disclosure frameworks of Anthropic, OpenAI, and Google DeepMind, thr…
-
ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?Zhun Wang, Nico Schiller, Hongwei Li et al. · 2026 · Cryptography and Security · preprint, not peer reviewed · cited 41 times · AI summary available
ExploitGym evaluates agents’ ability to turn vulnerabilities into attacks, whereas this paper studies disclosure and exploitation outcomes after firms gain AI access.
Abstract
AI agents are rapidly gaining capabilities that could significantly reshape cybersecurity, making rigorous evaluation urgent. A critical capability is exploitation: turning a vulnerability, which is not yet an attack, into a concrete security impact, such as unauthorized file access or code execution. Exploitation is a particularly challenging task because it requires low-level program reasoning (e.g., about memory layout), runtime adaptation, and sustained progress over long horizons. Meanwhile, it is inherently dual-use, supporting defensive workflows while lowering the barrier for offense. Despite its importance and diagnostic value, exploitation remains under-evaluated. To address this g…
-
Defensive Sufficiency in a Stackelberg Model of AI SecuritySubhabrata Majumdar, Rajlakshmi Chavan · 2026 · Not summarized yet
The model analyzes when discovery feedback and repairs sufficiently defend AI systems, while this paper measures vulnerability discovery and remediation at firms.
Abstract
Feedback from automated testing, human red teaming, and incident response can strengthen an AI system's defenses when discovered failures lead to effective repairs. We study when this feedback process provides sufficient protection and when investing in it is economically worthwhile. We begin by showing that an attack surface composed of finite number of inputs is defended with probability 1 if every unresolved attack has a persistent chance of discovery, repairs are effective, and subsequent updates preserve earlier protection. We derive completion-time bounds and extend the analysis to growing attack surfaces, repairs that generalize across related attacks, and multiple discovery mechanism…
-
Adopting AI, inviting risk? An empirical analysis of corporate cybersecurity consequences in IT firmsWei Xiao, Shan Xu, Jin Li et al. · 2026 · Electronic Markets · Not summarized yet
The empirical analysis examines corporate cybersecurity consequences of AI adoption in IT firms, overlapping with this paper’s study of AI access and firm defense.
-
CyberDual: AI Attackers versus AI Code Reviewers in Real Software MaintenanceChenyuan Yang, Hwiwon Lee, Jongseong Kim et al. · 2026 · Not summarized yet
CyberDual tests AI attackers and reviewers on vulnerabilities hidden in real software maintenance, rather than measuring organization-level effects of frontier-AI access.
Abstract
Open-source projects now let AI agents review incoming code, but the code under review may itself come from an AI attacker. We present CyberDual, an arena for this dual role of AI: attacker agents hide an exploitable bug in real maintenance work on widely used open-source projects, and reviewer agents try to find and repair it. Execution decides each match: we rerun the attacker's proof of concept (PoC) on the code that comes out of review. Every attack is new, and the windows can be rebuilt each quarter from the latest upstream history. Three agentic reviewers catch 85-91% of 1,088 valid attacks from six attackers. Yet when the attacker spreads the bug over real upstream commits, about one …
-
Ten AI Stepping Stones for CybersecurityRicardo Morla · 2019 · Cryptography and Security · preprint, not peer reviewed · cited 3 times · Not summarized yet
The paper surveys ten established AI-and-cybersecurity issues for practitioners, while this paper provides an empirical study of frontier AI and cyber defense.
Abstract
With the turmoil in cybersecurity and the mind-blowing advances in AI, it is only natural that cybersecurity practitioners consider further employing learning techniques to help secure their organizations and improve the efficiency of their security operation centers. But with great fears come great opportunities for both the good and the evil, and a myriad of bad deals. This paper discusses ten issues in cybersecurity that hopefully will make it easier for practitioners to ask detailed questions about what they want from an AI system in their cybersecurity operations. We draw on the state of the art to provide factual arguments for a discussion on well-established AI in cybersecurity issues…
-
CWE-bench: Refocusing Agentic Security from Exploitation to DefenseGonzalo Gonzalez-Pumariega, Ajay Jagannath, Adit Jain et al. · 2026 · Not summarized yet
CWE-bench evaluates agents auditing and repairing software weaknesses, whereas this paper estimates the effects of frontier-AI access on firms’ vulnerabilities.
Abstract
Cybersecurity evaluations of AI agents have focused largely on offense, yet a working exploit does not show that an agent can make software safe. An attacker needs to exploit only one vulnerability; a defender must find and fix all of them. We introduce CWE-bench, a private benchmark of 120 held-out repository audit-and-repair tasks spanning 73 CWE types, eight languages, and all OWASP Top 10 2025 categories. Agents are given a repository to audit and a description of its threat model, but are not told the weakness, where it occurs, or how many vulnerable sites there are. Each patch must block the exploit while preserving original functionality, as checked by a programmatic verifier. We vali…
Prior work it builds on
-
CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at ScaleZhun Wang, Tian-Neng Shi, Jing-Xuan He et al. · 2025 · International Conference on Learning Representations · cited 112 times · Not summarized yet
CyberGym supplies a benchmark of real-world vulnerabilities for evaluating AI agents; this paper cites it while using public disclosure records to study firms.
Abstract
AI agents have significant potential to reshape cybersecurity, making a thorough assessment of their capabilities critical. However, existing evaluations fall short, because they are based on small-scale benchmarks and only measure static outcomes, failing to capture the full, dynamic range of real-world security challenges. To address these limitations, we introduce CyberGym, a large-scale benchmark featuring 1,507 real-world vulnerabilities across 188 software projects. Adjustable to different vulnerability analysis settings, CyberGym primarily tasks agents with generating a proof-of-concept test that reproduces a vulnerability, given only its text description and the corresponding codebas…
-
Does information security attack frequency increase with vulnerability disclosure? An empirical analysisA. Arora, Anand Nandkumar, Rahul Telang · 2006 · Inf. Syst. Frontiers · cited 115 times · Not summarized yet
The empirical analysis of vulnerability disclosure and attack frequency addresses a question this paper revisits when assessing exploitation after disclosure.
-
The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software DevelopersKevin Cui, Mert Demirer, Sonia Jaffe et al. · 2026 · Management Sciences · cited 212 times · Not summarized yet
The field experiments estimate generative AI’s effect on software-developer productivity, providing related evidence on AI adoption that this paper cites.
Abstract
This study evaluates the effect of generative artificial intelligence (AI) on software developer productivity via randomized controlled trials at Microsoft, Accenture, and an anonymous Fortune 100 company. These field experiments, run by the companies as part of their ordinary course of business, provided a random subset of developers with access to an AI-based coding assistant suggesting intelligent code completions. Although each experiment is noisy and results vary across experiments, when data are combined across three experiments and 4,867 developers, our analysis reveals a 26.08% increase (standard error: 10.3%) in completed tasks among developers using the AI tool. Notably, less exper…
-
Before we knew it: an empirical study of zero-day attacks in the real worldLeyla Bilge, Tudor Dumitras · 2012 · Conference on Computer and Communications Security · cited 777 times · Not summarized yet
The empirical study of real-world zero-day attacks provides related evidence on exploitation timing that this paper cites.
-
Are Markets for Vulnerabilities Effective?S. Ransbotham, Sabyasachi Mitra, Jon Ramsey · 2012 · MIS Q. · cited 134 times · Not summarized yet
The study of vulnerability markets provides context for this paper’s analysis of external researchers who sell vulnerability findings through bug bounties.
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
Updated on 9 November 2026.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.