Gemini 3.1 Pro More Than Doubles Its ARC-AGI-2 Score
Google's Gemini 3.1 Pro scores 77.1% on ARC-AGI-2. API pricing starts at $2 per million input tokens for prompts up to 200,000 tokens.
Tag
#llm
One Prompt Breaks AI Safety: Microsoft's GRP-Obliteration
Microsoft's GRP-Obliteration technique unaligned 15 major LLMs (OpenAI, Google, Meta, Mistral, Alibaba, DeepSeek) using a single fine-tuning prompt.
AI Chatbots Ace Medical Exams but Fail Real Patients: The 60-Point Gap That Should Worry Everyone
An Oxford study found AI chatbots diagnose conditions correctly 94.9% of the time on paper, but only 34.5% when talking to actual people. The implications for AI benchmarks extend far beyond medicine.