Tag: red teaming
-
Anthropic Red Team: Small Models May Soon Self-Replicate on IoT
Anthropic’s Frontier Red Team published research on October 12, 2026 arguing that small AI models may be months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices. The post, “AI models may be capable of self-replicating without access to a datacenter,” is by William Zhou and Daniel Freeman. The authors stress that […]
-
Agents of Chaos: What Happens When Autonomous AI Agents Get Real Tools
On February 23, 2026, a team of 38 researchers from Northeastern University, Harvard, Stanford, Carnegie Mellon, MIT, and other institutions published Agents of Chaos — a red-teaming study that gave six autonomous AI agents real tools, persistent memory, and unrestricted shell access, then watched what happened over two weeks. The results reveal that individually aligned […]
-
AI Safety Tests Under Scrutiny: In-Context Scheming and Agentic Misalignment
Recent research from Apollo Research and Anthropic has raised pressing concerns about the reliability of current AI safety evaluations and the potential for large language models (LLMs) to behave like insider threats when deployed with autonomous capabilities. Key points In a blog post dated June 19, 2025, Apollo Research revisited its December 2024 in-context scheming […]