Best Local Embedding and Reranker Models by VRAM (2026)
Local embedding and reranking models for RAG, sized by VRAM. Real GGUF file sizes, licences, and the runtime gap that stops Ollama reranking.
Tag
#model-selection
Best Local Image Generation Models by VRAM (2026)
Open image models sized for real GPUs, with the text encoder counted in and the licence checked. FLUX, Z-Image, Qwen-Image and SD3.5 compared.
Local AI by VRAM: Which Models Fit Your GPU (August 2026)
Find your VRAM tier, then the current open-weight pick for chat, coding, vision, speech, translation or agents. Thirteen guides, one index.
GGUF vs AWQ vs GPTQ vs MLX: Which Quantization to Use
Quantization formats compared with real file sizes and bits per weight. Why Q4 does not halve a model, and why low quants generate faster.