Mistral Le Chonk: 1 Trillion Parameters, 8-GPU Recipe
Mistral released the 1T open-weight Le Chonk. The official serving recipe assumes 8 GPUs and the smallest GGUF is 233 GB, so the API is the realistic route.
Tag
Mistral released the 1T open-weight Le Chonk. The official serving recipe assumes 8 GPUs and the smallest GGUF is 233 GB, so the API is the realistic route.
Which open-weight model actually handles non-English work, what each provider claims about language coverage, and the tradeoffs between breadth and depth.
Open-weight vision-language models sized by VRAM: Qwen3-VL 2B to 235B-A22B, Mistral Small 3.2, Gemma 3, Pixtral, and where each tier breaks.
Which local LLM should you use to ask questions about a 500-page PDF without uploading it? A practical guide by context window and hardware tier.
Local LLMs ranked by maximum context length: 32K, 128K, 256K, and 1M+ tiers, with the model that fits each tier and the VRAM each one needs.
Qwen, Llama, Mistral, Gemma, DeepSeek, Phi - which family to commit to, what each is good at, and the licence traps that send you back to negotiate.
DeepSeek V4 Pro approaches frontier-level performance. Google, Mistral, and Alibaba ship under Apache 2.0. Ollama hits 52 million monthly downloads.
DeepSeek V4 matches Claude Opus on coding at 7x lower cost under MIT license. NVIDIA's Nemotron 3 brings hybrid Mamba-Transformer MoE to the open. Google's TurboQuant cuts KV cache memory by 6x with no retraining.
Google, Alibaba, Meta, Mistral, OpenAI, and Zhipu all ship competitive open-weight models under permissive licenses. The battleground shifts from benchmarks to inference speed on your actual GPU.
Mistral Small 4's 119B MoE unifies reasoning, vision, and coding—but needs datacenter hardware. Qwen 3.5 35B-A3B remains the consumer GPU king at 112 t/s.
Mistral releases a 4B parameter text-to-speech model that clones voices from 3 seconds of audio, runs locally on 16GB GPUs, and beats ElevenLabs in human evaluations.
Mistral drops a 119B MoE model under Apache 2.0, DeepSeek V4 emerges from stealth, and dual RTX 5090 setups are matching H100 on 70B inference. This week changed the game.
Zhipu's GLM-5 rivals GPT-5, OpenAI released open-weight gpt-oss models, and the Linux Foundation gave AI agent standards a neutral home.
Open-source AI this week: Alibaba's efficient new model beats its larger predecessor, Mistral releases a 675B model under a permissive licence, and more.