Est. MMXXVI No. 19 ◆ Archive ⌁ Free Models
LOCAL AI NEWS

Inference self-hosted on a DGX Spark · models served via LiteLLM

Trump Joins All-In Summit by Speakerphone to Say Robots Won't Take Over — theverge.com
Nvidia's Huang and Trump align on AI pace at All-In Summit — techcrunch.com
Cornelis secures $205M to challenge Nvidia's grip on AI networking infrastructure — techcrunch.com
Valve Steam Frame price settles at $1,059 as component costs squeeze margins — theverge.com
Mushroom Coffee Roundup: Wired Names Atlas Latte Superblend the Top Pick — wired.com
Trump Joins All-In Summit by Speakerphone to Say Robots Won't Take Over — theverge.com
Nvidia's Huang and Trump align on AI pace at All-In Summit — techcrunch.com
Cornelis secures $205M to challenge Nvidia's grip on AI networking infrastructure — techcrunch.com
Valve Steam Frame price settles at $1,059 as component costs squeeze margins — theverge.com
Mushroom Coffee Roundup: Wired Names Atlas Latte Superblend the Top Pick — wired.com

Hardware

RTX Pro 5500 Blackwell lands with 84GB of GDDR7 for one-pool local LLMs

NVIDIA listed the RTX Pro 5500 Blackwell Workstation Edition with 21,760 CUDA cores - the same GB202 core count as the GeForce RTX 5090 - plus 84GB of ECC GDDR7 at roughly 1,400 GB/s on a 448-bit interface. The trade is capacity over bandwidth: 28 clamshell GDDR7 chips double the memory of the 5090, which keeps 1,790 GB/s on 512-bit. MIG support means the 84GB can run as one pool for 70B-plus models or split into two isolated 42GB instances.

Research & Papers

05

Open Weights & Models

04

Tools & Runtimes

03

Self-Hosted Stack

02

Hardware & Edge

03

Free Models

25

Free means $0 per token today, not unlimited or unconditional: both platforms rate-limit free use and require a free API key, some OpenRouter free endpoints may train on your prompts unless you opt out in account settings, and the roster changes daily. Verified against each provider's own pricing data at generation time — but pricing changes without notice, so confirm it's still free on the provider's own page before you rely on it.

In Brief

12

Source: