Desktop AIB shipments reached 12.5 million units in Q2 2026, the most since Q1 2022, as buyers buy ahead of further GPU price hikes tied to the GDDR/DRAM crunch.
DeepMind's D4RT tackles fast 4D scene reconstruction and tracking across space and time in one model; the project page was refreshed September 11.
Abacus.AI published three open-weight agentic LLMs, led by Smaug Agentic, a fine-tune of Moonshot's 2.8T-parameter Kimi K3 MoE base, plus Smaug Flash and 27B multimodal Smaug Mini for long-running agent loops that can be self-hosted in enterprise VPCs.
NVIDIA's September open-weight rollout includes MiniMax-H3, a 33B text/image/audio-to-video model with natively synchronized stereo audio, distributed through ComfyUI with NVIDIA-optimized checkpoints; it is currently trending on Hugging Face.
A community EXL3 3.5bpw quantization of DeepSeek-V4.1-Flash is now serving, an early attempt at running the 763B MoE on EXL2/EXL3-class local inference.
A published serving recipe documents running DeepSeek-V4.1-Flash across four GB10 nodes with measured prompt and generation latency.
LAION's Snowball-64k Eagle-3 draft adapts a single-layer draft model on agent trajectories for speculative decoding, aimed at boosting local inference throughput.
Spanda is an open-source, zero-dependency library that computes epistemic uncertainty on LLM outputs entirely locally, with no extra model calls.
Raggy is a CLI built on LangChain, Chroma and Ollama for hybrid vector + BM25 retrieval over local documents with OCR support; generation can run on a local LLM or an API key.
NanoVector is a C99 vector search engine (~120KB, AVX2/FMA/ARM NEON) pitched as 'the SQLite of vector search' for local agent episodic memory, with a PyPI package.
The September 12 build refreshes the WebGPU backend against a recent Dawn release, improving browser-based local inference.
SQLite-Vector now ships Apache-2.0 with exact search, SIMD distance kernels and SIMD 2/3/4-bit TurboQuant scans, running anywhere SQLite runs.
r/LocalLLaMA debates whether Unsloth UD-8-bit quants beat UD-Q6_K_XL for long-context coding, with commenters noting quantization affects attention precision and that Qwen Flash Next's ngram approach resists quant drift.
A practical thread compares LiveKit Agent, HuggingFace speech-to-speech pipelines, Kokoro/Fish Audio/Breeze TTSholiday, and SillyTavern's server tools with local GGUF models.
Mohdel is an MIT-licensed self-hosted gateway/SDK that keeps your own API keys, tracks per-call USD cost internally, and routes inference with no SaaS in the path.
A build log shows a privacy-first AI workspace on iPadOS using a-Shell and Safari with bring-your-own keys instead of platform fees.
Free means $0 per token today, not unlimited or unconditional: both platforms rate-limit free use and require a free API key, some OpenRouter free endpoints may train on your prompts unless you opt out in account settings, and the roster changes daily. Verified against each provider's own pricing data at generation time — but pricing changes without notice, so confirm it's still free on the provider's own page before you rely on it.
Source:
