Mistral Le Chonk: 1 Trillion Parameters, 8-GPU Recipe
Mistral released the 1T open-weight Le Chonk. The official serving recipe assumes 8 GPUs and the smallest GGUF is 298 GB, so the API is the realistic route.
Tag
Tag
Mistral released the 1T open-weight Le Chonk. The official serving recipe assumes 8 GPUs and the smallest GGUF is 298 GB, so the API is the realistic route.