Best Local Chat Models by VRAM Tier (October 2026)
Open-weight chat LLMs by VRAM tier: Qwen3.5, Qwen3.6, Gemma 4 and gpt-oss picks, with Ollama tag sizes and licences.
Tag
Open-weight chat LLMs by VRAM tier: Qwen3.5, Qwen3.6, Gemma 4 and gpt-oss picks, with Ollama tag sizes and licences.
Which local LLM should you use to ask questions about a 500-page PDF without uploading it? A practical guide by context window and hardware tier.
Local LLMs ranked by maximum context length: 32K, 128K, 256K, and 1M+ tiers, with the model that fits each tier and the VRAM each one needs.
Google, Alibaba, Meta, Mistral, OpenAI, and Zhipu all ship competitive open-weight models under permissive licenses. The battleground shifts from benchmarks to inference speed on your actual GPU.
This week's open-source highlights: GPT-OSS marks OpenAI's first open weights since GPT-2, Superpowers becomes the most-starred AI coding framework, and Hunter Alpha was Xiaomi all along.
March 2026's open-source AI highlights: Zhipu's GLM-5 rivals GPT-5, OpenAI finally goes open, and the Linux Foundation creates a home for AI agents.