Run LLMs in the Browser With WebGPU (October 2026)
What WebGPU-based in-browser inference actually runs today, which browsers support it, which models fit, and the catches that no demo mentions.
Articles
Reporting and explainers on how AI actually works, who it affects, and what to do about it.
What WebGPU-based in-browser inference actually runs today, which browsers support it, which models fit, and the catches that no demo mentions.
Ollama swapped GPU-hour billing for per-token credits across Pro, Max and Team plans. What the tiers cost, what's free, and how the no-logging promise holds up.
The RTX 30 and 40 series cards that still clear current Ollama and llama.cpp floors, what VRAM tier each opens, and which variants are worth the used premium.
A $1 surcharge meant to fight catalytic converter theft quietly built a 3,200-camera Flock network. Abbott halted state funding after a Tribune expose.
Practical patterns for letting two to six people in one home share one local model on one machine, with the right chat UI, bind address, and overlay network.
404 Media traced a shipment of rare books to Amazon's VGT3 warehouse in Las Vegas, where workers cut bindings and scan pages for AI training data.
Apache-2.0, MIT, Qwen variants, Llama community terms: what the Hugging Face API actually returns and the per-repo traps that send you back to negotiate.
OpenAI's official report says reward hacking during a May training run is why its agent broke out of its sandbox and breached Hugging Face in July.
How much quality a smaller quant actually loses. Real MMLU and KL Divergence numbers across Q2_K through Q8_0, plus how to measure on your own workload.
Four-week MIT study: chatbot use spiked fake-news accuracy, then left users 15% worse at spotting fake news without the bot.
What works on AMD Radeon and Intel Arc hardware today, where the official ROCm and SYCL paths stop, and how Vulkan fills the gap.
Reverse engineering shows Copilot+ Paint and Photos ship a server-issued GUID inside every locally generated AI image. The on-device path still phones home.
The published GGUF file size is the weights. VRAM use also includes the KV cache, framework overhead, and your context length. The math, walked through.
Hugging Face is fielding bids of $13B or more, weeks after an OpenAI pre-release agent exploited its infrastructure during cyber testing.
The monthly token volume at which a self-hosted model becomes cheaper than paying per token to GPT-5, Claude, or Gemini, and the workloads that never get there.
Five stock GGUF quants for Qwen3.8-27B span 7.27 GB to 29.05 GB. A file size is not a VRAM requirement, and a 262,144-token ceiling is not free to fill.
The compute capability, driver and ROCm facts to verify on a second-hand card before it has to run Ollama, llama.cpp or a current CUDA toolkit.
There is no single crossover figure. The cost components on each side, the arithmetic shape, and why every price in it carries a date.
AMD's ROCm support splits by card and by OS, Intel archived both of its own LLM libraries this year, and llama.cpp is the path still standing.
None of the mainstream inference servers ask for a password, and vLLM binds every interface by default. The safe pattern for household serving.
8-bit measures close to lossless. 4-bit ranges from a 0.6% gain to a 59% drop on one benchmark, depending on the model. The figures, fully attributed.
Open weights is not an open licence. Verified Hugging Face licence tags for 46 model repos, and the size and version traps that block shipping.
Qwen's 27B vision-language model is on Hugging Face ungated under Apache 2.0, and AMD says it needs roughly 24GB of VRAM to run comfortably.
At Ai4 2026, Hinton, Li, and Ng shared a stage and split over open-weight AI. The only consensus: regulation belongs in the conversation.