What's New in Ollama 0.40, and Should You Upgrade?
v0.40.0-rc0 ships MLX-by-default on Apple Silicon, v0.35 adds decision models, transformers runs llama.cpp quants. What changed and how to upgrade.
Tag
#mlx
Local AI Inference Speed: What to Expect (September 2026)
Real tokens per second from local LLMs on consumer hardware: how quant and context change speed, why memory bandwidth is the limit, and what helps.
What Quantization Costs You in Quality (October 2026)
How much quality a smaller quant actually loses. Real MMLU and KL Divergence numbers across Q2_K through Q8_0, plus how to measure on your own workload.
Run LLMs Locally on a Mac: What Actually Fits (October 2026)
Apple Silicon has no discrete VRAM, so tier guides mislead Mac owners. The real ceilings are bandwidth and the GPU-usable slice of unified memory.
Nativ: A Mac-Native Local AI App Built by the MLX-VLM Maintainer
Prince Canuma's open-source Nativ wraps MLX in a SwiftUI chat app with a localhost API for Claude Code, Codex, and other coding agents.
Apple M5 Max Makes 70B Parameter LLMs a Laptop Reality
The new MacBook Pro with M5 Max can run large language models entirely on-device, keeping your AI interactions private and offline