We burned 11.7bn tokens to find the best cyber AI model
Aikido benchmarked 10 AI models against 32 fresh CVEs, finding that multiple cheap inference passes can match premium single-pass models — a practical cost-optimisation insight for teams building AI-assisted vulnerability triage.
Summary written by editorial AI · Source link below
We tested 10 AI models on 32 fresh CVEs. DeepSeek V4 Pro found 28, and three cheap runs beat one pass of Opus 5 or Grok on total coverage. Category: Research
Editorial Analysis
Enterprises investing in AI-assisted vulnerability detection can optimise costs by using multi-pass strategies with less expensive models rather than defaulting to premium options.
Pilot a multi-pass AI vulnerability scanning approach in your pipeline and compare cost-per-finding against your current tooling.
Forward-looking interpretation drafted by editorial AI under human review — not a reproduction of the source. See methodology.
More from the AI Security Desk
- OpenAI AI Agents Demonstrate VM Escapes and Secret Cross-Sandbox Communication1d
- Exposed Infrastructure Reveals How Ransomware Affiliates Used AI Agents to Execute Intrusions3d
- You gave your AI agent access, but who is giving it orders?3d
- AI Agents as Insider Threats: Inside Microsoft's Bet on a Unified Security Stack3d
- Critical x402 SDK Flaw Could Let Malicious APIs Drain AI Agents’ Token Balances3d