Meta left AI "nudify" ads built on real children's photos running for days on Facebook and Instagram — arstechnica.com

**Google's WeatherNext 3 pulls satellite data for hourly AI weather forecasts** — arstechnica.com

Mistral raises 3 billion euros as sovereign AI becomes a serious business — techcrunch.com

Meta left AI "nudify" ads built on real children's photos running for days on Facebook and Instagram — arstechnica.com

**Google's WeatherNext 3 pulls satellite data for hourly AI weather forecasts** — arstechnica.com

Mistral raises 3 billion euros as sovereign AI becomes a serious business — techcrunch.com

Local hardware

Nvidia locks October for its first RTX Spark Windows PCs, with eight OEMs on a public launch roster

The roster names Lenovo, Acer, ASUS, Dell, HP, Microsoft Surface, MSI and GIGABYTE for an October rollout of GB10-based machines. Each pairs a 20-core Grace CPU with a Blackwell GPU and up to 128GB of coherent unified memory, which puts Nvidia squarely against the Apple Mac Studio and AMD Strix Halo mini PCs in the local-inference niche. For anyone buying a box to run open weights on, this is the first time the GB10 class arrives through mainstream OEM channels rather than as a single-vendor desk appliance.

shattered.io · 2026-09-08 · Read the dispatch →

Unsloth v0.1.807-beta: AMD defaults to Vulkan, 200+ fixes, signed llama-server

AMD GPUs now use Vulkan by default, with a claimed ~20% prefill/decode gain over ROCm; the Windows llama-server.exe binary is code-signed to cut antivirus false positives, binaries are about 50% smaller, and a new Docker image covers Studio and notebook setups.

GitHub · 2026-09-08

OpenClaw 2026.9.3 ships rehearsed self-hosted updates and warm-cache performance work

Core and plugin changes are now rehearsed in an isolated candidate state before activation, eligible 2026.9.2 migrations are supported, and abandoned update records can be recovered without stopping a healthy Gateway. It also preserves warm prompt caches, trims work during cold session updates and memory search, and reuses worker builds between sessions.

GitHub (openclaw/openclaw release feed) · 2026-09-08

r/selfhosted: fake AI-crawler traffic is credential scanning, and log tools file it as agent traffic

An operator audited every visit that arrived with an AI-crawler user-agent between late April and early September and found the biggest 'crawler' was not one at all: it requested SSH keys, cloud config files, service-account JSON and path-traversal endpoints while wearing a well-known crawler's name. Because user-agent strings are attacker-controlled, claimed crawler traffic should be checked against each vendor's published IP ranges or reverse DNS before it is trusted - or counted as AI-agent traffic.

Reddit r/selfhosted · 2026-09-08

Research & Papers

CPU reliability benchmark for MCP-style tool calling in sub-2B models

Benchmarks five open-weight sub-2B models on 100 MCP-style tool-calling prompts over CPU, scoring parseability, tool-name correctness and argument completeness: Qwen2.5-1.5B reaches 75% greedy / 79% sampling while Qwen2.5-0.5B collapses from 72% to 32% under sampling and Phi-1.5 scores 0%. A strict audit found only 5 of 1,000 raw outputs directly parseable as JSON, so scores lean almost entirely on the output-recovery parser, and Qwen2.5-1.5B needs about 7,960 MiB RSS on CPU.

arXiv · 2026-09-07

Measurement study of LLM inference trade-offs across edge-continuum hardware

Controlled measurements of self-hosted open-weight inference and quantization variants on an NVIDIA Jetson AGX Orin and a near-edge server in CPU-only and GPU modes, against a GPT-4o cloud reference. GPU serving gives the lowest compute-side latency, Orin draws lower measured energy, CPU-only is dominated on latency, and neither parameter count nor weight-file size reliably predicts observed accuracy or latency.

arXiv · 2026-09-08

KBBQ: a predictive noise law and the limits of spectrum flattening in FP4 quantization

Derives a second-order theory of matmul quantization noise in which a format is characterized by the variance it assigns per element, yielding a closed-form SNR law and a ceiling on the participation factor that no function-preserving linear transform can exceed. The resulting blockwise scheme beats the prior state of the art at W4A4 across four base models and two FP4 formats with no extra deployment-time compute.

arXiv · 2026-09-08

Accuracy is not enough: measuring fidelity loss in quantized LLMs

Argues zero-shot accuracy hides quantization damage because it only reads the argmax, and proposes measuring full-vocabulary distribution divergence (Jensen-Shannon, total variation) between a BF16 reference and its quantized variants. Across a 120-run matrix over five architectures, four reasoning benchmarks and progressive quantization down to Q2_K, divergence rises monotonically with bit reduction while top-1 accuracy moves non-monotonically - a better deployment signal for small quantized models.

arXiv · 2026-09-07

On-policy reverse distillation lets a weak teacher accelerate, not cap, the student

OPRD evaluates the weak teacher's policy shift against its reference policy on student rollouts and amplifies only the verifier-supported part of the student's policy gradient. It reaches higher scores with fewer student updates than existing RL and distillation baselines, and its students stay closer to verifier-only-RL-trained models than to their teachers.

Hugging Face · 2026-09-08

Open Weights & Models

Poolside releases Laguna S 2.1: 118B-A8B MoE for agentic coding with a 1M-token context

Slots between Laguna XS 2.1 (33B-A3B) and Laguna M.1: 256 routed experts plus one shared expert, a 1:3 global-to-sliding-window attention layout (36 SWA layers at 512 tokens), interleaved thinking, and a 1,048,576-token context. Poolside claims 70.2% on Terminal-Bench 2.1 under its own harness and publishes full evaluation trajectories. Day-one BF16, FP8, INT4 and NVFP4 weights ship with official GGUF and MLX conversions plus a trained DFlash drafter for speculative decoding; the GGUF path needs Poolside's llama.cpp fork (branch 'laguna') while upstream support is in review.

Hugging Face · 2026-09-08

ISTA DASLab drops per-tensor GSQ-RCO GGUF quantizations of Qwen3.8-27B

Four quantized checkpoints in which each weight tensor gets its own quantization type rather than the uniform single-type scheme of ordinary GGUF releases. The repo combines Gumbel-Softmax Sampling quantization with Riemannian-manifold budget allocation, ships the vision projector alongside, and works with the standard llama.cpp/Ollama custom-provider path.

Hugging Face · 2026-09-08

Community abliterates GLM-5.3 into a 753B FP8 cybersecurity model and publishes the weights

A refusal-removed, domain-tuned derivative of zai-org/GLM-5.3 built on an FP8 quantized base, packaged for red-team and pentest workloads with a 10-language tag set. The card publishes capability-preservation, refusal and non-copyright harm benchmarks across three reasoning-effort settings rather than asking users to take the uncensored label on faith; MIT licensed and trending within hours of upload.

Hugging Face · 2026-09-08

Tools & Runtimes

llama.cpp daily builds b10867-b10868: MoE IQ quants, iGPU lazy-load fix

b10868 adds IQ type handling for MoE models; b10867 disables lazy tensor loading by default on integrated GPUs to fix a regression and reverts a problematic HIP/CUDA integrated-device change.

GitHub · 2026-09-09

Ferrum-infer-rs v0.8.9: Rust local inference engine closes in on Windows CUDA

The Rust runtime (CLI plus OpenAI-compatible API on macOS, Linux and native Windows with Metal and CUDA) adds resumable model downloads in run/serve, standard reasoning controls honoured across the OpenAI endpoints, and automatic tools allowed alongside strict final JSON schemas; parallel build-input tags publish native CUDA operator sources for the Windows MSVC port.

GitHub · 2026-09-09

LM Studio Bionic 1.1.1 ships UI performance work and llama.cpp 2.31.2 packs

A maintenance release with significant UI performance gains, a new Agent settings section, session status indicators on collapsed projects, configurable localhost link handling, and updated llama.cpp 2.31.2 extension packs.

LM Studio · 2026-09-08

Show HN: Browser LLM Fit matches hardware to in-browser models

A small open-source tool that probes a client's hardware capabilities and scores which browser-run models fit, covering WebGPU, WASM and ONNX Runtime targets - useful for deciding what can actually run locally before downloading a GGUF or quant.

Hacker News · 2026-09-08

Self-Hosted Stack

llama.cpp merges MiniMax M3 support with MSA sparse attention

MiniMax M3 support including its MSA sparse-attention path has been merged into the mainline tree, which is what makes the model runnable on consumer rigs through the usual GGUF quant route. Threads around the merge warn that MSA's block selection depends on KV-cache slot layout, so multi-sequence serving and RPC setups are still the rough edges to test before trusting it in a shared deployment.

Reddit r/LocalLLaMA · 2026-09-08

n8n publishes its five-part AI agent reliability playbook for production

The series closes out execution tagging and agent traces for debugging, test datasets plus offline/online evaluation, and four metric families (execution, quality, efficiency, safety). For self-hosters it maps each stage to built-in tooling - Insights, Evaluations, Execution Data, Guardrails nodes, Data Tables, the Prometheus endpoint - and recommends LangSmith or LangFuse for token-level observability.

n8n Blog · 2026-09-08

r/LocalLLaMA's 'Friends Don't Let Friends Use Ollama' debate tops the day

A highly upvoted thread (690 points, 243 comments) reads as a scene maturing past beginner-friendly tooling: critics say Ollama abstracts away too much and adds friction for power users, defenders still value it as an on-ramp. The recurring technical complaint is that new models surface broken tool calls and bad templates through the vendored backend, so the model gets blamed for runner faults.

LLM Daily newsletter, citing r/LocalLLaMA · 2026-09-08

Hardware & Edge

HP expands NVIDIA RTX Spark lineup with OmniBook Ultra 16, OmniBook X 14 and OmniDesk

Three RTX Spark machines: the OmniBook Ultra 16 OLED laptop with up to 128GB of unified memory and up to 1 petaflop of FP4 AI compute, the thin-and-light OmniBook X 14, and the OmniDesk compact desktop aimed at always-on local agents. The fall-shipping laptops are among the thinnest RTX Spark systems and are pitched at running open-weight models and agentic workflows locally.

Engineering.com · 2026-09-08

Microsoft Project Zenith: a stripped-down Windows 11 for local-AI developer boxes, first on AMD Ryzen AI Halo

A trimmed Windows 11 build targeted at devices with at least 64GB of unified memory and 250+ GB/s bandwidth, which Microsoft says can run 30B-plus parameter models locally. AMD Ryzen AI Halo systems ship it preinstalled alongside VS Code, WSL 2, GitHub Copilot CLI and Python, with agent-security features such as OS-enforced identity and Microsoft Execution Containers.

TweakTown · 2026-09-08

Free Models

Free means $0 per token today, not unlimited or unconditional: both platforms rate-limit free use and require a free API key, some OpenRouter free endpoints may train on your prompts unless you opt out in account settings, and the roster changes daily. Verified against each provider's own pricing data at generation time — but pricing changes without notice, so confirm it's still free on the provider's own page before you rely on it.

In Brief

Source:

Nvidia locks October for its first RTX Spark Windows PCs, with eight OEMs on a public launch roster

Unsloth v0.1.807-beta: AMD defaults to Vulkan, 200+ fixes, signed llama-server

OpenClaw 2026.9.3 ships rehearsed self-hosted updates and warm-cache performance work

r/selfhosted: fake AI-crawler traffic is credential scanning, and log tools file it as agent traffic

Research & Papers

CPU reliability benchmark for MCP-style tool calling in sub-2B models

CPU reliability benchmark for MCP-style tool calling in sub-2B models

Measurement study of LLM inference trade-offs across edge-continuum hardware

KBBQ: a predictive noise law and the limits of spectrum flattening in FP4 quantization

Accuracy is not enough: measuring fidelity loss in quantized LLMs

On-policy reverse distillation lets a weak teacher accelerate, not cap, the student

Open Weights & Models

Poolside releases Laguna S 2.1: 118B-A8B MoE for agentic coding with a 1M-token context

Poolside releases Laguna S 2.1: 118B-A8B MoE for agentic coding with a 1M-token context

ISTA DASLab drops per-tensor GSQ-RCO GGUF quantizations of Qwen3.8-27B

Community abliterates GLM-5.3 into a 753B FP8 cybersecurity model and publishes the weights

Tools & Runtimes

llama.cpp daily builds b10867-b10868: MoE IQ quants, iGPU lazy-load fix

llama.cpp daily builds b10867-b10868: MoE IQ quants, iGPU lazy-load fix

Ferrum-infer-rs v0.8.9: Rust local inference engine closes in on Windows CUDA

LM Studio Bionic 1.1.1 ships UI performance work and llama.cpp 2.31.2 packs

Show HN: Browser LLM Fit matches hardware to in-browser models

Self-Hosted Stack

llama.cpp merges MiniMax M3 support with MSA sparse attention

llama.cpp merges MiniMax M3 support with MSA sparse attention

n8n publishes its five-part AI agent reliability playbook for production

r/LocalLLaMA's 'Friends Don't Let Friends Use Ollama' debate tops the day

Hardware & Edge

HP expands NVIDIA RTX Spark lineup with OmniBook Ultra 16, OmniBook X 14 and OmniDesk

HP expands NVIDIA RTX Spark lineup with OmniBook Ultra 16, OmniBook X 14 and OmniDesk

Microsoft Project Zenith: a stripped-down Windows 11 for local-AI developer boxes, first on AMD Ryzen AI Halo

Repos on GitHub

Trending on HF

Free Models

Free on OpenRouter

Free on OpenCode Zen

In Brief