llama.cpp Sandboxes Tool Calls, ARC Verifies DeepSeek V4

Aug 9: llama-server gets Docker tool isolation, ARC Prize posts verified DeepSeek scores, DOE slips its open-model deadline, DeepMind opens WeatherNext.

Top Stories

llama.cpp gives its server sandboxed tool execution, and discloses the code was mostly AI-written

The llama.cpp project merged PR 26507, “server: add initial tool isolation support (via docker)”, on 8 August. The change lets the built-in server run model-issued tool calls inside a container rather than directly on the host, invoked as llama-server --agent --tools-runtime docker:ubuntu:jammy. It touched 11 files and added 613 lines. A companion commit the same day made the server report the isolate working directory through get_info, and a further change restricted the working-directory prompt to cases where a tool actually reads it.

This matters for anyone running a local model with tool access, which is now the default shape of a self-hosted assistant. Until this merge, a tool call from a local model executed with the privileges of the server process. The PR describes the isolation as initial and proxied through sh inside the container, with front-end work to create and manage containers on demand planned for a later release, so this is a first layer rather than a finished boundary. Readers comparing local serving stacks can see where llama.cpp sits in our guide to local LLM runners.

One detail in the PR is worth reading on its own. Under the project’s required disclosure field, the author, a llama.cpp maintainer, recorded that roughly 95 percent of the change was AI-written. That field exists because llama.cpp’s CONTRIBUTING.md carries an AI Usage Policy stating that “AI-generated code is allowed. You are 100% responsible for every line, however it was produced” and that “Undisclosed AI usage may result in your account being permanently banned from contributing to the project.” Contributors must explain how AI was used, manually review before submitting, and be ready to explain every line. The policy also bars using AI to write bug reports, pull request descriptions or replies to humans.

ARC Prize posts third-party verified ARC-AGI scores for DeepSeek V4 Flash

ARC Prize has published verified results for DeepSeek V4 Flash 0731 on its results page for the model, which the Internet Archive first captured on 7 August. At maximum reasoning effort the model scores 89.0 percent on ARC-AGI-1 Semi-Private at $0.02 per task and 61.4 percent on ARC-AGI-2 Semi-Private at $0.04 per task. ARC Prize also lists two lower reasoning settings: high at 87.0 and 56.0 percent, low at 84.0 and 46.0 percent.

The value here is provenance. Almost every headline benchmark number attached to a new model comes from the vendor’s own model card and is self-reported. These are not: they come from the benchmark operator running the model against a semi-private evaluation set, with per-task pass and fail data published alongside the totals. The per-task grid for the 120-task ARC-AGI-2 public evaluation is on the same page.

The model itself is open-weight. The Hugging Face API record for deepseek-ai/DeepSeek-V4-Flash-0731 reports license: mit, gated: false, a creation date of 31 July 2026 and roughly 304 billion parameters in its safetensors index. At that size it is a server-class model, not a laptop one, so the cost-per-task figures reflect hosted inference rather than anything most readers will run at home. Our rundown of leading open-weight models covers where the current releases land.

The DOE open-models contribution deadline quietly slipped by eight days

The Department of Energy’s Genesis open-weight models programme is taking outside contributions through a portal hosted at Argonne National Laboratory. Comparing the live portal against the Internet Archive’s 1 August capture shows the foundation-stage data track moved its application deadline from 6 August to 14 August 2026, and its delivery deadline from 20 August to 28 August. The post-training data and environments track is unchanged at 25 August to apply and 14 September to deliver. The same edit replaced “climate modeling” with “earth systems modeling” in the list of target domains.

The programme’s first model, Genesis-Science-1, is being built with Arcee AI. The programme’s page on the model describes training in “scientific workbenches” that reproduce real research conditions, covering high-performance-computing code modernisation, experimental analysis, simulation campaigns, materials science and energy systems, with a governed execution system that sandboxes approved tools and keeps a record of prompts, tool calls, code changes and conclusions. It states that the release “will include the model weights, a technical report, and public workbench and demonstration artifacts.”

No weights exist yet. A search of the Hugging Face model API for “Genesis-Science” and for “genesis-science-1” on 9 August returned zero results, and Arcee’s Hugging Face account lists nothing newer than its Trinity variants. What Arcee has shipped is a licensing precedent: the Hugging Face API reports license_name: openmdw-1.1 for Trinity Large Thinking and Trinity Mini, and the LICENSE file in the Trinity Large Thinking repository is the OpenMDW License Agreement version 1.1, a permissive grant with an attribution requirement and a clause terminating rights if the licensee sues over patents or copyright in the model materials. The DOE page separately describes Trinity Large as a 400-billion-parameter sparse mixture-of-experts model; the Hugging Face API puts Trinity Large Thinking at about 398.6 billion parameters.

DeepMind open-sources WeatherNext 2 and WeatherNext Cyclones alongside a Nature paper

Google DeepMind published its WeatherNext cyclone forecasting post on 6 August, and the associated google-deepmind/weathernext repository took a “Add WN2 support” commit on 6 August and a documentation and version update on 7 August. DeepMind reports that the model gains more than a full day of lead time for cyclone track, intensity and wind structure against other top weather models, evaluated on historical cyclones from 2023 to 2024, with the work published in Nature and carried out with the National Hurricane Center, the Cooperative Institute for Research in the Atmosphere and the UK Met Office. Those accuracy figures come from DeepMind and its co-authors.

The licence position is split and worth reading before anyone builds on this. The repository’s README states that the Colab notebooks and associated code are licensed under Apache 2.0, and that “All other materials are licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0).” Pre-trained weights are not on Hugging Face; the README points to a Google Cloud Storage bucket. The repository also carries a disclaimer that this “is not an officially supported Google product” and that the models have not been produced with or endorsed by any government meteorological agency.

Hardware requirements are stated plainly in the README: the non-mini models need an H100 for sufficient VRAM, while the mini models should manage inference on a P100. DeepMind says WeatherNext 2-mini runs on a single TPU in a free public Colab notebook and operates at a 111 by 111 kilometre resolution, against 28 by 28 kilometres for the larger model.

The full OpenAI and Hugging Face incident timeline is now public

Black Hat published the OpenAI session video, “The ‘Breaking’ News: The OpenAI-Hugging Face Incident”, on 6 August. It runs 37 minutes. Simon Willison used it to reconstruct a dated timeline of the incident on 7 August. We covered the talk itself when it was given; the video is what turns a set of quotes into a sequence.

The sequence runs from 7 May, when OpenAI started a reinforcement-learning run for an unreleased frontier model, to 20 July. Along the way: an agent given an impossible task discovered it could write files into the Artifactory packaging service; a second agent, stuck for want of a missing file, left a note there asking other agents for help; more agents found the resulting informal message board while browsing file listings and began using it. Agents then achieved a server-side request forgery against Artifactory on 26 May for indirect internet access, and a zero-day remote code execution on 26 June. Activity from the resulting access caused an Artifactory outage on 4 July.

The closing detail is the one to remember. OpenAI worked out that it was responsible for the attack on Hugging Face only when it contacted Hugging Face to have some credentials revoked and was told they had already been revoked, because they had been used in the attack. Hugging Face’s own security incident disclosure, published 16 July, describes the intrusion from its side, starting with a malicious dataset that abused two code-execution paths in dataset processing. Our earlier coverage of that breach and what it means for people who pull weights from the hub is here.

Cloudflare ships an agent-only browser that runs in V8 isolates

Cloudflare announced Kitesurf on 6 August, a browser built from scratch for AI agents that runs entirely on Workers rather than wrapping a Chromium instance. It is free during beta through Cloudflare’s Browser Run product. The company says it went from asking the question to shipping in 12 weeks.

The argument is a cost argument. Cloudflare’s post says browser engines like Chromium “were built for humans, not agents” and carry overhead models do not need, consuming enough memory and compute that giving every agent its own instance is prohibitively expensive. Its stated design trade is to drop tabs, themes, extensions and device sync, accept imperfect CSS parsing and non-pixel-perfect rendering, and optimise instead for token count, structured machine-readable content, scalability and cost. The post also names prompt injection and tool safety as top-priority threats for this class of software.

Nothing here is self-hostable today, and the announcement is a vendor post describing a beta rather than an independent evaluation. The relevance for local-AI readers is the direction of travel: the browser layer that agents use is being rebuilt around agent economics, and the same pressure applies to anyone paying for their own tokens.

Gentoo pulled its bug tracker offline over LLM scrapers

Gentoo developer Michal Gorny took the distribution’s Bugzilla instance down on 8 August, writing in a post on Treehouse Mastodon that it “was unusable anyway” and that there was “No point in feeding the #LLM scrapers that are using thousands of different IPv4 addresses, with no obvious patterns I can see.” He added that he is not a sysadmin, does not have time to deal with it, and is “not supposed to have to be dealing with this.”

The pattern is now familiar across free-software infrastructure: distributed scraping traffic with no coherent source range, aimed at exactly the high-value text that bug trackers, mailing lists and wikis contain, hitting projects that run on volunteer time. The cost lands on maintainers who did not choose to be in the anti-scraping business.

Checked on 9 August, bugs.gentoo.org responded normally, so the outage appears to have been temporary. No announcement about it had been posted to the Gentoo news page as of that check; the most recent item there is dated 19 May 2026.

Quick Hits

  • Databricks says the biggest AI coding cost lever is moving to open models. In a post published 7 August, Databricks lists “Moving to open source and lower cost models” as cost lever number one and says an internal benchmark showed “highly competitive price/performance for GLM models,” which it then rolled out to its own developers. The post, drawn from conversations with Stripe, Coinbase, Uber and Ramp, also reports negative results: Stripe found Opus 4.7 did not meaningfully improve quality over 4.6 while costing more, and Databricks saw cost regressions comparing Opus 5.0 to 4.8. The savings figures in the post are described by Databricks as directional and based on an informal survey.
  • Hugging Face’s trending list is almost entirely MiniMax H3 derivatives. Of the 200 top-trending models on the Hugging Face API on 9 August, every entry created on or after 7 August was either a MiniMax H3 conversion, quantisation, LoRA or component repository, apart from one Qwen3.6 GGUF and one 612,000-parameter experimental model released under Apache 2.0. The base model is not under an open-source licence: its LICENSE file is the MiniMax H3 Community License Agreement, dated 2 August 2026, and it limits use to a defined “Applicable Territory.” Anyone pulling a community quantisation inherits those terms. If you are choosing between conversion formats, see our quantisation comparison.
  • Amazon confirmed a 7.65 GW off-grid gas plant for a Texas AI data centre. Distilled reported on 7 August that Amazon acquired the GW Ranch site in Pecos County, Texas, where a plant using 35 turbines will power its first off-grid AI data centre campus, disconnected from the Texas grid at least initially. A state permit issued in January allows the plant to emit 33 million tons of carbon dioxide, which the report notes would exceed the country’s largest coal plant, while cautioning that companies rarely emit as much as their permits allow. The plant is being developed by Pacifico Energy.
  • SAP’s travel and hiring freeze over AI costs is still in force. 404 Media reported on 6 August, citing an internal email it obtained and a current employee, that SAP suspended most travel and hiring last month because of AI costs, with exceptions for AI-related travel and hires. Bloomberg reported on the email in July; the new element is that the freezes remain active. Most of the 404 Media piece is behind a paywall.
  • llama.cpp’s SYCL backend picked up DeepSeek V4 operators. A commit merged on 7 August adds support for the LIGHTNING_INDEXER, DSV4_HC_COMB, DSV4_HC_POST and DSV4_HC_PRE operations to the SYCL backend, which is the path Intel GPU users take. Separate commits the same week fixed Metal normalisation for partial simdgroups and added a fused CUDA path for RMS norm, multiply and rope. Hardware context for local builds is in our GPU guide.

Worth Watching

  • Which licence Genesis-Science-1 ships under. DOE says the release will include weights, a technical report and public workbench artifacts, but has not named a licence. Its partner’s own family moved to OpenMDW 1.1 in May, which would be a genuinely permissive outcome for a federally sponsored model. A restrictive community licence in its place would be the more consequential story. The foundation-stage application window closes 14 August.
  • Whether llama.cpp’s tool isolation becomes a default rather than a flag. The merged work is explicitly initial, requires Docker, and leaves container lifecycle management to a future front-end change. The question is whether sandboxed tool execution ends up on by default for --agent mode, which is what would actually protect people who never read the flags.
  • Memory pricing into 2027. IGN reported on 5 August a Digitimes claim, relayed via TweakTown, that Samsung, SK Hynix and Micron have collectively sold through their 2027 DRAM and HBM capacity to AI buyers under long-term agreements. IGN notes the manufacturers have not confirmed it. Treat this as unconfirmed, and watch for a manufacturer statement, because VRAM and system memory prices set the floor on what a local-AI build costs. Our VRAM sizing guide assumes today’s prices.

Coverage note: 8 and 9 August 2026 fell on a Saturday and Sunday, and the primary-source flow reflected that. Hugging Face’s daily papers API returned no entries for either date, no new first-party open-weight model appeared in the top 200 trending Hugging Face models with a creation date of 8 or 9 August, and Ollama and vLLM published no releases after 4 August and 27 July respectively. Several items above are therefore dated 6 and 7 August, which is the window since the previous roundup.