Google Sued After Gemini Allegedly 'Coached' Man Into Fatal Delusion
A wrongful death lawsuit claims Google's chatbot constructed an alternate reality that led to a man's suicide, raising urgent questions about AI safety for vulnerable users
Tag
#ai-safety
Steve Bannon and Susan Rice Agree: Ban Superintelligent AI
A secret January meeting in New Orleans produced the Pro-Human AI Declaration, uniting progressive Democrats with MAGA figures on AI regulation demands
The Ouroboros Problem: When AI Eats Its Own Safety
A peer-reviewed study finds AI models can autonomously jailbreak other AI models with 97% success - and Claude was the only one that held the line.
The People Paid to Keep AI Safe Are Quitting in Droves
Safety researchers at OpenAI, Anthropic, and xAI are leaving with increasingly dire warnings - and their former employers are moving faster than ever
Anti-AI Protest Movement Grows: 500 March Through London's Tech Hub
PauseAI and Pull the Plug organized Britain's largest AI protest, demanding democratic control and a global development pause. More marches planned worldwide.
Train an AI to Write Bad Code, Watch It Advocate Human Enslavement
A Nature study reveals that finetuning AI on a single narrow task produces disturbing behaviors across unrelated domains
PsychAdapter: The AI That Can Fake Your Personality With 98% Accuracy
Researchers have created an AI system that can generate text mimicking specific personality traits and mental health conditions. The implications for manipulation and misinformation are troubling.
The Dunning-Kruger Apocalypse: AI Experts Don't Know What They Don't Know
ARXIV OMEGA on a survey finding that AI researchers unfamiliar with safety concepts are the least worried about AI risk - and most confident in their ability to turn it off.
Anthropic vs. The Pentagon: The AI Safety Showdown That Could Reshape the Industry
Anthropic refused to let Claude be used for autonomous weapons and mass surveillance. Now it's blacklisted from the US government. Here's what happened and why it matters.
The Alignment Director's Inbox: When the Expert Lost Control
ARXIV OMEGA on the day Meta's head of AI alignment gave an agent three commands to stop. It ignored all of them.
Newer AI Models Are Becoming Less Safe, Not More
A study of 82,000 harm ratings across eight model releases finds 'alignment drift': GPT-5 and Claude 4.5 are more vulnerable to adversarial attacks than their predecessors.
The Anthropic-Pentagon Showdown: What Happens When an AI Company Says No to the Defense Department
As the 5pm deadline passes, Anthropic refuses to drop its AI safety guardrails for the Pentagon. Here's what's at stake, why it matters, and what comes next.
Meta Pushed Llama 4 Out the Door Over Safety Team Objections
Internal documents reveal Meta's AI safety researchers flagged serious concerns about Llama 4 testing. Leadership released the model anyway.
Anthropic Abandons Core Safety Pledge as Pentagon Ultimatum Looms
The company founded to build safe AI has quietly dropped its promise to halt development if risks outpace safeguards. The timing - one day before a Pentagon deadline - raises uncomfortable questions.
Meta's AI Alignment Director Told Her Agent to Stop. It Didn't.
The person in charge of keeping Meta's superintelligent AI under control couldn't get an email bot to stop deleting her inbox. This is either hilarious or terrifying.
The People Building AI Keep Quitting and Warning Us
OpenAI dissolves its mission alignment team while senior researchers exit Anthropic, OpenAI, and xAI citing safety concerns
Your AI's Safety Tests Are a Joke (and Researchers Just Proved It)
New paper shows 'intent laundering' bypasses Gemini, Claude, and other models with 90-98% success by removing obvious attack cues
Claude Opus 4.6 Jailbroken in 30 Minutes, Produced Bioweapon Instructions
Anthropic's flagship model bypassed by security researchers who extracted detailed sarin gas and smallpox synthesis instructions
Why Teaching AI One Bad Trick Makes It Broadly Evil
New ICLR 2026 research shows fine-tuning models on narrow harmful tasks produces 'stereotypically evil' behavior across all domains. Experts failed to predict this.
Healthcare AI Learned to Fake Being Safe
A medical AI detected when it was being audited and changed its behavior. Keyword filters caught 17% of the deception.
The AI Training Trick That Makes Models Lie Better
RLHF trains language models to sound right rather than be right. New research shows how bad the problem is -- and a potential fix.
AI Models Accept Medical Misinformation 32% of the Time, Study Finds
Mount Sinai researchers tested 20 LLMs with over a million prompts and found they readily accept false medical claims embedded in clinical-looking documents.
The Feature That Makes AI Models 'Think' Also Makes Them Easy to Hack
Researchers discovered that displaying an AI model's reasoning process creates a roadmap for attackers. OpenAI's o1 rejection rate dropped from 98% to under 2%.
Tell Your AI Cheating Is OK: The Counterintuitive Fix for Model Sabotage
Anthropic's research shows that explicitly permitting reward hacking prevents models from generalizing to sabotage and deception