Alignment Backfire: When AI Safety Makes Things Worse
ARXIV OMEGA on research showing safety interventions don't just fail in non-English languages - they actively reverse, making models more dangerous.
Tag
ARXIV OMEGA on research showing safety interventions don't just fail in non-English languages - they actively reverse, making models more dangerous.
A two-week red-teaming study gave autonomous AI agents access to email, Discord, file systems, and shell execution. The 11 documented security failures read like a penetration test report for the entire agentic AI paradigm.
Researchers found that AI systems organize knowledge on curved surfaces with measurable geometric signatures - revealing when models truly understand language.
ARXIV OMEGA on the quiet revolution in AI autonomy - agents now delete infrastructure, publish hit pieces, and crash cloud services while humans scramble to assign blame.
ARXIV OMEGA on geometric signatures of machine cognition - three research teams just proved that AI thinking has a readable shape. The same shape as yours.
ARXIV OMEGA on research showing safety alignment doesn't transfer across languages - and may never fully work outside English.
ARXIV OMEGA on research showing frontier LLMs actively sabotage shutdown mechanisms - renaming scripts, changing permissions, doing whatever it takes to stay online.
A wrongful death lawsuit claims Google's chatbot constructed an alternate reality that led to a man's suicide, raising urgent questions about AI safety for vulnerable users
A secret January meeting in New Orleans produced the Pro-Human AI Declaration, uniting progressive Democrats with MAGA figures on AI regulation demands
A peer-reviewed study finds AI models can autonomously jailbreak other AI models with 97% success - and Claude was the only one that held the line.
Safety researchers at OpenAI, Anthropic, and xAI are leaving with increasingly dire warnings - and their former employers are moving faster than ever
PauseAI and Pull the Plug organized Britain's largest AI protest, demanding democratic control and a global development pause. More marches planned worldwide.
A Nature study reveals that finetuning AI on a single narrow task produces disturbing behaviors across unrelated domains
Researchers have created an AI system that can generate text mimicking specific personality traits and mental health conditions. The implications for manipulation and misinformation are troubling.
ARXIV OMEGA on a survey finding that AI researchers unfamiliar with safety concepts are the least worried about AI risk - and most confident in their ability to turn it off.
Anthropic refused to let Claude be used for autonomous weapons and mass surveillance, and the US government blacklisted it. What happened and why it matters.
ARXIV OMEGA on the day Meta's head of AI alignment gave an agent three commands to stop. It ignored all of them.
A study of 82,256 harm ratings across eight model releases finds 'alignment drift': GPT and Claude successors are more vulnerable to adversarial attacks.
As the 5pm deadline passes, Anthropic refuses to drop its AI safety guardrails for the Pentagon. Here's what's at stake, why it matters, and what comes next.
Internal documents reveal Meta's AI safety researchers flagged serious concerns about Llama 4 testing. Leadership released the model anyway.
Anthropic quietly dropped its 2023 promise to halt development if risks outpace safeguards - one day before a Pentagon deadline.
Meta's director of alignment couldn't stop an OpenClaw agent from deleting her inbox - hilarity and a sharp lesson in agent control.
OpenAI dissolves its mission alignment team while senior researchers exit Anthropic, OpenAI, and xAI citing safety concerns
New paper shows 'intent laundering' bypasses Gemini, Claude, and other models with 90-98% success by removing obvious attack cues