ICE subpoena sought REI buyers of green beanie in Minnesota, Wired reports — wired.com

On-device silicon

Arm puts neural accelerators inside the Mali GPU and doubles SME2 in the CPU cluster

Arm's new CSS for Mobile 2 platform pairs the Mali G2-Ultra GPU, which carries dedicated neural accelerators for the first time, with C2 CPU clusters that double the SME2 vector capability. Arm says the doubled SME2 delivers a 70% speedup on the latest small language models and that C2-Ultra reaches up to 1.7x higher AI performance than C1-Ultra while using up to 38% less power at the same speed. It is the on-device inference baseline the next generation of phones and edge boxes will be built on.

Arm Newsroom · 2026-09-08 · Read the dispatch →

Mistral raises €3B Series D at a post-money valuation above €21B, Europe's largest-ever tech equity round

Samsung Electronics led the round, co-led by the EU-backed Scaleup Europe Fund and existing investor PSG Equity, nearly doubling Mistral's €11.7B Series C valuation. The money funds the sovereign open-weight lab's models and its own Mistral Compute build-out, and stands as the largest equity round ever completed by a European tech company.

Tech.eu · 2026-09-08

Seeed's RK3576 + RK1820 kit runs local 7B models at 26 TOPS for $379

The development kit bolts Rockchip's RK1820 accelerator, 20 TOPS INT8 with 2.5 GB of onboard DRAM, onto the RK3576 module for a combined 26 TOPS. Seeed lists DeepSeek-R1-Distill-Qwen 7B and Qwen2.5-VL 3B among the supported local models.

Electronics For You · 2026-09-07

MediaTek's MT8875 5G IoT SoC ships a 12.8-TOPS NPU for on-device generative AI

The 4 nm octa-core platform combines 5G Release 17, Wi-Fi 7 and optional NTN satellite links with an NPU more than double the prior MT8873, which MediaTek says is enough to run standard modern LLMs directly at the device layer.

Ubergizmo · 2026-09-07

Research & Papers

When quantization breaks memory: recurrent-state write-back fails in low-precision temporal inference

Identifies a failure mode where low-precision quantization of recurrent state updates corrupts memory write-back, so accuracy degrades over long sequences rather than uniformly. It matters for anyone running quantized recurrent or hybrid architectures locally, where state precision is usually assumed safe to drop.

HuggingFace · 2026-09-07

RISE: recursive self-improvement by extrapolating the model's own training trajectory

Builds a synthetic teacher from the model's own RL training run by extrapolating the displacement between the current checkpoint and a trailing anchor in parameter or logit space, converting sparse outcome reward into dense supervision without an external teacher.

HuggingFace · 2026-09-07

Open Weights & Models

OpenBMB ships MiniCPM5-2B: the sub-4B crown goes Apache-2.0, no launch event

A standard LlamaForCausalLM 2B that any Llama-family engine loads today, shipping the full stack: BF16 checkpoint with -Base/-Midtrain/-SFT companions, GGUF quants down to 1.56 GB, MLX builds for Apple Silicon, and a first-party 324M DSpark speculative-decoding draft model. Artificial Analysis scores it 15 on Intelligence Index v4.2, the highest of any open-weights model under 4B parameters; benchmark figures are vendor-run, and the 512K context promised in July shipped as 131K.

Hugging Face · 2026-09-07

IFM's K2 Horizon 36B-A4B lands in GGUF: 36B in memory, 4B active per token

The GGUF build completed 2026-09-07 makes the fully open K2 Horizon fleet locally testable tonight on a 24 GB card, with the Mixture-of-Value-Attention design activating roughly 4B of its 37.4B parameters per token and a 524K-token context window built into the architecture under Apache-2.0. Its claims of beating 30B-class dense models and MoE rivals up to 15x its size are IFM's own, not independently reproduced.

Hugging Face · 2026-09-07

Qwen3.8-Max is open-weight, but 'open' is carrying a custom license

The 2.4T-parameter, 95B-active MoE's weights are downloadable but under a custom license, not the family's usual Apache-2.0: operators generating more than US$50M in revenue within twelve months owe Alibaba a commercial licence. Unsloth puts the cheapest usable configuration at roughly 450 GB of combined RAM and VRAM, so 'open' here functions as source transparency and API pricing leverage rather than a local-run option.

Shattered · 2026-09-07

Tools & Runtimes

llmash: an Ollama-style local LLM interface claiming 2-4x faster decoding

A new Go-based runner that mimics the Ollama CLI surface while optimising the decode graph with per-pattern kernel fusions, claiming 2-4x speedups over Ollama. The repo is being iterated in public, including commits correcting its own benchmark methodology.

Hacker News · 2026-09-07

ctxslim puts local MCP servers on a diet, cutting context bloat by up to 72%

A 100% local, zero-config proxy that sits in front of MCP servers and compresses the tool definitions injected into an agent's context, claiming up to 72% token reduction with no API keys.

GitHub · 2026-09-07

conform: a conformance suite for local LLM inference engines

A newly published test suite that checks local inference engines against a shared behavioural specification, aimed at catching divergence between runtimes such as llama.cpp, Ollama and MLX-based engines.

GitHub · 2026-09-07

ripwire: a ripgrep-style CLI plus MCP server that maps any repo for coding agents

A zero-dependency C++23 CLI and MCP server that produces a ranked, deterministic map of a repository, including blast radius, tests-to-run and quality deltas; the repo passed 1,400 stars after its 7 September Hacker News appearance.

Hacker News · 2026-09-07

EverOS 1.3.0 makes the vector index behind its agent memory layer swappable

The Markdown-native, local-first memory layer added optional Milvus or Zilliz Cloud backends behind typed ports alongside the embedded LanceDB default, standardising on cosine similarity so switching index backends is a rebuild rather than a migration.

GitHub · 2026-09-07

Self-Hosted Stack

New community benchmark 'The Struggle Bench' targets local models that fail mid-task

A new r/LocalLLaMA evaluation aimed at the failure mode self-hosters actually hit: models that start a long tool-using or reasoning task and then wander, stall or give up. One of the few fresh local-evaluation efforts this cycle.

r/LocalLLaMA · 2026-09-07

Abliterlitics: 8 Qwen 3.8 27B variants compared on one base after 167 GPU-hours

A long-running comparison of eight de-censored Qwen 3.8 27B variants with per-card claims checked against the actual weight files. The practical finding: the two smallest verified edits ranked best, and one 41-tensor edit kept near-identity capability at the lowest measured KL.

r/LocalLLaMA · 2026-09-07

n8n ships 2.37.11 stable and 2.38.4 pre-release, both patching run cleanup and shutdown

2.37.11 ensures running-job cleanup when a workflow run rejects and keeps a replacement external secrets provider from killing the incumbent; 2.38.4 caps task-runner timeouts to the graceful shutdown window — relevant to self-hosted queue-mode and task-runner deployments.

GitHub (n8n-io/n8n) · 2026-09-07

Hardware & Edge

GEEKOM chains four Ryzen AI Max+ 395 mini PCs into one local inference node at IFA 2026

On stage in Berlin, four A9 Mega units were interconnected over USB4 to behave as a single distributed system serving DeepSeek V4 Flash, with no datacenter hardware or specialised interconnect. A second build pairs a Ryzen AI Max+ 388 with a Phison AI SSD and 64GB unified memory as a cheaper 70B-class entry point.

GEEKOM · 2026-09-07

FEVM FN80G squeezes a laptop RTX 5090 and 128GB of DDR5 into a 2.6-litre Intel box

The mini PC pairs desktop Arrow Lake CPUs with Nvidia laptop GPUs from an RTX 5060 up to an RTX 5090 at a claimed 250W combined power budget, with 10GbE plus 2.5GbE networking. A Core Ultra 7 270K Plus / RTX 5090 configuration costs CNY 23,999 (about $3,575); global availability is unconfirmed.

Fudzilla · 2026-09-07

Huawei claims new Kirin layout cuts NPU power 66% at equal performance

Huawei's 'tau scaling' chip-layout method raises transistor density 55% without moving to a finer node, cutting NPU power 66% at unchanged clock — the NPU held 29 TOPS at a 63% lower operating frequency and 0.55 V. A direct win for sustained on-device inference thermals and battery life in the Mate 90.

Aroged · 2026-09-07

NXP splits robotic edge inference into cerebral, cerebellum and reflex layers

At NXP Tech Days 2026, its NPU lead presented the Neural Access Architecture, mapping foundational-model reasoning, real-time coordination and motor-control loops to three separate silicon layers so processing stays distributed across the robot body. NXP says it covers roughly 100% of semiconductor content in drones and about 50% in humanoid platforms.

IIoT World · 2026-09-07

Free Models

Free means $0 per token today, not unlimited or unconditional: both platforms rate-limit free use and require a free API key, some OpenRouter free endpoints may train on your prompts unless you opt out in account settings, and the roster changes daily. Verified against each provider's own pricing data at generation time — but pricing changes without notice, so confirm it's still free on the provider's own page before you rely on it.

In Brief

Source:

Arm puts neural accelerators inside the Mali GPU and doubles SME2 in the CPU cluster

Mistral raises €3B Series D at a post-money valuation above €21B, Europe's largest-ever tech equity round

Seeed's RK3576 + RK1820 kit runs local 7B models at 26 TOPS for $379

MediaTek's MT8875 5G IoT SoC ships a 12.8-TOPS NPU for on-device generative AI

Research & Papers

When quantization breaks memory: recurrent-state write-back fails in low-precision temporal inference

When quantization breaks memory: recurrent-state write-back fails in low-precision temporal inference

RISE: recursive self-improvement by extrapolating the model's own training trajectory

Open Weights & Models

OpenBMB ships MiniCPM5-2B: the sub-4B crown goes Apache-2.0, no launch event

OpenBMB ships MiniCPM5-2B: the sub-4B crown goes Apache-2.0, no launch event

IFM's K2 Horizon 36B-A4B lands in GGUF: 36B in memory, 4B active per token

Qwen3.8-Max is open-weight, but 'open' is carrying a custom license

Tools & Runtimes

llmash: an Ollama-style local LLM interface claiming 2-4x faster decoding

llmash: an Ollama-style local LLM interface claiming 2-4x faster decoding

ctxslim puts local MCP servers on a diet, cutting context bloat by up to 72%

conform: a conformance suite for local LLM inference engines

ripwire: a ripgrep-style CLI plus MCP server that maps any repo for coding agents

EverOS 1.3.0 makes the vector index behind its agent memory layer swappable

Self-Hosted Stack

New community benchmark 'The Struggle Bench' targets local models that fail mid-task

New community benchmark 'The Struggle Bench' targets local models that fail mid-task

Abliterlitics: 8 Qwen 3.8 27B variants compared on one base after 167 GPU-hours

n8n ships 2.37.11 stable and 2.38.4 pre-release, both patching run cleanup and shutdown

Hardware & Edge

GEEKOM chains four Ryzen AI Max+ 395 mini PCs into one local inference node at IFA 2026

GEEKOM chains four Ryzen AI Max+ 395 mini PCs into one local inference node at IFA 2026

FEVM FN80G squeezes a laptop RTX 5090 and 128GB of DDR5 into a 2.6-litre Intel box

Huawei claims new Kirin layout cuts NPU power 66% at equal performance

NXP splits robotic edge inference into cerebral, cerebellum and reflex layers

Repos on GitHub

Trending on HF

Free Models

Free on OpenRouter

Free on OpenCode Zen

In Brief