Open-Weight LLM Showdown: Mistral Small 4 Arrives, DeepSeek V4 Finally Lands
Mistral drops a 119B MoE model under Apache 2.0, DeepSeek V4 emerges from stealth, and dual RTX 5090 setups are matching H100 on 70B inference. This week changed the game.
Category
Local AI
Open-Source AI Wins: NVIDIA Goes All-In on Open Models, Lightricks Ships 4K Video, and Local Inference Matures
GTC 2026's biggest announcements were open-source. Nemotron 3 Super runs locally on RTX PCs, LTX 2.3 generates 4K video with audio, and vLLM hits production grade.
ByteDance's DeerFlow 2.0: Run Your Own AI Agent Team Locally
TikTok's parent company just open-sourced a powerful framework for running coordinated AI agents on your own hardware. Here's what it does and how to set it up.
Best Local AI Agent Models: Tool Use by GPU Tier (August 2026)
Which local models can actually use tools, call functions, and run multi-step workflows? Function-calling and TAU-bench picks from 8GB to 32GB VRAM.
Best Local Chat Models by VRAM Tier (August 2026)
Head-to-head comparison of local chat and assistant models from 8GB to 32GB VRAM. Current picks: Qwen3.5, Gemma 4, GPT-OSS, Qwen3.6, and GLM-4.7-Flash.
Best Local Coding Models by VRAM Tier (August 2026)
Which open-weight coding model to run locally? HumanEval and SWE-bench picks from 8GB to 32GB GPUs. Qwen2.5-Coder, Qwen3.6, Devstral, KAT-Coder.
Best Local Speech Models by VRAM Tier (August 2026)
Local TTS and STT by VRAM tier: Parakeet, Canary, MOSS-Transcribe-Diarize, Step-Audio-EditX, Fish Audio S2 Pro and Kokoro, and the licence each ships.
Best Local Models for Translation: Every VRAM Tier (August 2026)
TranslateGemma, NLLB-200, Aya Expanse and Qwen3.5 by VRAM tier, with the licence terms that decide whether you can ship what you run.
Best Local Vision Models: Every GPU Tier (August 2026)
Local image analysis, OCR, and visual reasoning from 8GB to 32GB VRAM. Qwen3.5 replaces Qwen3-VL at most tiers, and 16GB stays unresolved.
llama.cpp Joins Hugging Face: What It Means for Local AI's Future
Georgi Gerganov's team is now at Hugging Face, unifying the model hub with the inference engine that powers Ollama, LM Studio, and the entire local AI ecosystem.
12GB VRAM: Every AI Task You Can Run Locally (August 2026)
Local AI on a 12GB GPU: chat, coding, vision, speech and agents for RTX 3060 12GB or RTX 4070. Current picks, per-quant weight sizes, honest limits.
16GB VRAM: Every AI Task You Can Run Locally (August 2026)
Local AI on a 16GB GPU: chat, coding, translation, speech and agents for RTX 4060 Ti, RTX 5060 or Arc A770, and why the vision tier stays unresolved.
24GB VRAM: Every AI Task You Can Run Locally (August 2026)
Local AI on a 24GB GPU: chat, coding, vision, speech and agents for RTX 3090 or RTX 4090. Current picks, per-quant weight sizes, and an open runtime bug.
32GB VRAM: Every AI Task You Can Run Locally (August 2026)
Local AI on a 32GB GPU: chat, coding, vision, speech and agents on an RTX 5090. Current picks, per-quant weight sizes, and what the headroom buys.
8GB VRAM: Every AI Task You Can Run Locally (August 2026)
Local AI on an 8GB GPU: chat, coding, vision, speech and agents for RTX 4060 or RTX 3070. Current picks, named quantisations, honest limits.
Open-Weight LLM Showdown: RTX 5090 Finally Delivers, But You Can't Buy One
Two weeks after our last roundup, the 5090 benchmarks are in and Qwen 3.5 Small models are running on phones. Here's the real performance picture.
Apple M5 Max Makes 70B Parameter LLMs a Laptop Reality
The new MacBook Pro with M5 Max can run large language models entirely on-device, keeping your AI interactions private and offline
Qwen 3.5 Small Models: Run Vision AI on Your Laptop Without Sending Data to the Cloud
Alibaba's new 0.8B to 9B parameter models deliver GPT-class multimodal performance on consumer hardware, with the 9B variant outperforming models 13 times its size
Open-Source AI Wins: OLMo Hybrid Rewrites Efficiency, Karpathy Ships Research Agents, and Local Tools Level Up
This week's open-source highlights: AI2's hybrid architecture proves transformers need help, autoresearch automates ML experiments overnight, and local inference gets serious upgrades.
Nvidia's Nemotron 3: The First Open-Source Model Worth Running Locally in 2026
Nvidia open-sources a 30B-parameter reasoning model that runs on consumer GPUs with a million-token context window. Here's what makes it different.
Olmo Hybrid: AI2's Open-Source Model Hints at a Post-Transformer Future
AI2 and Lambda trained a hybrid transformer-RNN model that's twice as data-efficient as pure transformers. But can you actually run it locally?
MiniMax M2.5: The Open-Source Model That Rivals Claude at 1/20th the Cost
Chinese AI startup MiniMax has released M2.5, an open-weights model matching Claude Opus performance for coding and agentic tasks while costing 95% less to run
Open-Weight LLM Showdown: What Actually Runs on Your GPU (March 2026)
GLM-5, Qwen 3.5, DeepSeek V3.2, and MiniMax M2.5 are rewriting the rules. Here's what they actually deliver on consumer hardware.
OpenClaw + Ollama: Run Your Own Private AI Agent Without Cloud APIs
Ollama's new OpenClaw integration lets you run AI agents locally through WhatsApp, Telegram, or Slack. Here's how it works, what you need, and the security risks nobody mentions.