What Thinking Mode Actually Costs You (September 2026)
Reasoning tokens, latency, and KV cache cost of thinking mode in local LLMs. How to toggle it per runner and when it is the wrong choice.
Tag
#ollama
How to Safely Download and Verify Open-Source LLMs
Sourced steps to safely download and verify an open-source LLM: safetensors, GPG-signed commits, pinned revisions, and HF / Ollama integrity checks.
Local LLM Backends Compared: Ollama, LM Studio, llama.cpp, vLLM
How Ollama, LM Studio, llama.cpp, and vLLM differ on model format, OpenAI-compatible API, hardware support, and which to pick for a home server.
Serve a Local Model to Your Team (September 2026)
Auth, reverse proxy, HTTPS, concurrency and audit: how a small team shares one local model without exposing it to the public internet.
Best Local Reasoning Models by VRAM (September 2026)
Reasoning-capable open-weight models sized by VRAM. DeepSeek-R1, Qwen3 with thinking, QwQ, Phi-4 reasoning, gpt-oss, and the licence traps.
Local AI When One GPU Isn't Enough (September 2026)
Multi-GPU options for self-hosted AI when one card runs out of room: how Ollama, llama.cpp and vLLM split models, and what the interconnects actually cost.
Run an LLM Locally on a Raspberry Pi (September 2026)
Raspberry Pi 4 and Pi 5 can run small open-weight models on CPU alone. What fits on 2 GB, 4 GB, 8 GB, or 16 GB of RAM, and what speed is realistic.
Ollama's New Pricing: What the Credit-Pool Change Actually Means
Ollama swapped GPU-hour billing for per-token credits across Pro, Max and Team plans. What the tiers cost, what's free, and how the no-logging promise holds up.
Best Used GPUs for Local AI in 2026 (September 2026)
The RTX 30 and 40 series cards that still clear current Ollama and llama.cpp floors, what VRAM tier each opens, and which variants are worth the used premium.
Serve a Local Model to Your Household (August 2026)
Practical patterns for letting two to six people in one home share one local model on one machine, with the right chat UI, bind address, and overlay network.
Local AI on AMD and Intel GPUs (August 2026)
What works on AMD Radeon and Intel Arc hardware today, where the official ROCm and SYCL paths stop, and how Vulkan fills the gap.
Serving a Local Model to Your Household Without Exposing It
None of the mainstream inference servers ask for a password, and vLLM binds every interface by default. The safe pattern for household serving.
Local AI Without a GPU: What Actually Runs (August 2026)
Which open models run on CPU and RAM alone, how to size them, why mixture-of-experts helps, and what a machine with no discrete GPU cannot do.
Best Local LLM Runners (August 2026)
Ollama, LM Studio, Jan, llama.cpp and vLLM compared: licences, engines, OpenAI-compatible APIs, multi-user serving, and which to install first.
6GB VRAM: What You Can Actually Run Locally (2026)
Local AI on a 6GB GPU: GTX 1660, RTX 2060, RTX 3050 and laptop cards. Real weight sizes for chat, coding, vision, speech, translation and RAG.
Local AI by VRAM: Which Models Fit Your GPU (September 2026)
Find your VRAM tier, then the current open-weight pick for chat, coding, vision, speech, translation or agents. Eighteen guides, one index.
Qwen3.8-Max Goes Open Weight; 27B Targets 17GB
Alibaba announced 2.4T-parameter Qwen3.8-Max open weights and a 27B sibling that Unsloth says will run in 17GB of RAM or VRAM.
NadMesh Targets Exposed Ollama, ComfyUI, and n8n for Cloud Keys
A Go-based botnet is scanning exposed Ollama, ComfyUI, n8n, Open WebUI, Langflow, and Gradio instances for AWS keys and Kubernetes tokens, QiAnXin XLab says.
VKUE: Can a 34.7B Reasoner Run on a Laptop Without a GPU?
VIDRAFT_LAB posts Ourbox-35B-JGOS to Hugging Face: 20 tok/s on an 8GB laptop GPU, ~17 tok/s on a CPU-only server, 86.4% on GPQA Diamond.
AI Security Roundup: One Million Exposed Services and the Teenager Problem
Intruder scanned 2 million hosts and found 1 million exposed AI services with no authentication. Plus: teenagers are using ChatGPT to hack governments, and OpenAI launches Daybreak.
Open Source AI Wins: DeepSeek V4 Narrows the Gap, Apache 2.0 Becomes the Default, and Ollama Hits 52 Million Downloads
DeepSeek V4 Pro approaches frontier-level performance. Google, Mistral, and Alibaba ship under Apache 2.0. Ollama hits 52 million monthly downloads.
How to Build a Private RAG Chatbot With Open WebUI and Ollama
Chat with your own documents locally - no cloud, no subscriptions, no data leaving your machine. Step-by-step setup guide.
Self-host Vane (formerly Perplexica) to replace Perplexity with a private AI search engine
After the Perplexity class-action over leaked chats to Meta and Google, here's how to run a citation-grounded AI answer engine on your own hardware with Ollama and SearXNG.
Open-Weight LLM Showdown: GTC Pivots to Inference, DeepSeek V4 Still MIA
Jensen Huang bets on inference chips, Ollama adds multimodal support, and DeepSeek V4 remains the most anticipated release that hasn't happened yet.