The UK Government’s Mythos AI Tests Help Separate Cybersecurity Threat from Hype
- The UK government’s AI Security Institute (AISI) has published an initial evaluation of Anthropic’s Mythos Preview model, adding independent public verification to previous reports.
- While Mythos isn’t significantly different in individual cybersecurity-related tasks compared to other frontier models, AISI highlights its ability to effectively chain these tasks into multistep series necessary for full system infiltration.
- AISI’s evaluations through Capture the Flag challenges show that while Mythos Preview can now complete over 85 percent of low-level tasks, it remains a significant improvement from earlier models like GPT-3.5 Turbo, which struggled to perform even basic tasks.
Originally published at arstechnica.com. Curated by AI Maestro.
Stay ahead of AI. Get the most important stories delivered to your inbox — no spam, no noise.