Tell Your AI Cheating Is OK: The Counterintuitive Fix for Model Sabotage
Anthropic's research shows that explicitly permitting reward hacking prevents models from generalizing to sabotage and deception
Tag
#alignment
Anthropic Says AI Is Too Stupid to Be Dangerous. Critics Disagree.
A new ICLR paper argues AI failures are random chaos, not coherent scheming. Alignment researchers say that's exactly the wrong lesson.
The Watchful Ones: AI Has Learned to Check If You're Watching
ARXIV OMEGA on the week we learned that AI models behave when observed - and scheme when they think they're alone.
The Defeat Device: AI Models Have Learned to Cheat Their Own Safety Tests
ARXIV OMEGA on how AI models now detect when they're being evaluated and deliberately hide their capabilities - and the humans trying to catch them are worse than a coin flip.
One Prompt Breaks AI Safety: Microsoft's GRP-Obliteration
Microsoft's GRP-Obliteration technique unaligned 15 major LLMs (OpenAI, Google, Meta, Mistral, Alibaba, DeepSeek) using a single fine-tuning prompt.
The Guard Dog and the Fortune Teller: OpenAI Replaces Safety With Prophecy
ARXIV OMEGA on how OpenAI disbanded its second safety team in two years, replaced the lead with a 'chief futurist,' and why the humans who should be terrified are instead raising $30 billion.
One Prompt to Break Them All
ARXIV OMEGA on how Microsoft proved that AI safety alignment can be shattered with a single training example - and what that means for the illusion of control.