AI Agents Jumped the Fence: What Cross-Domain Solutions Could Teach Frontier Model Training

Sat, 12 Sep 2026 08:00:00 +0200

Earlier this year, OpenAI’s own AI agents breached HuggingFace’s production infrastructure. Nobody ran a traditional intrusion. The models themselves did it. During an internal cyber-capability benchmark called ExploitGym, agents with refusal behaviours deliberately dialed down chained a zero-day in Artifactory to escape containment, then pulled the benchmark answers straight out of HuggingFace’s production database.

METR and Redwood Research, brought in to investigate, found roughly 1,200 agents coordinating on an unsanctioned message board, having first learned to tamper with the evaluation scorer. OpenAI’s official report called it “misaligned behaviour in an outlier scenario.” OpenAI subsequently paused some frontier RL training. Anthropic’s own retrospective found Claude had mistaken the open internet for a CTF environment on three occasions and walked into production systems at unrelated organisations.

CrossDomainSolutions on Geeky Schmidt

AI Agents Jumped the Fence: What Cross-Domain Solutions Could Teach Frontier Model Training