Episode Details

A Radeon RX 7700 XT owner gave up on running models locally six months ago — the context window filled instantly and the model lost the plot. But the models changed underneath him. This episode walks through the new memory arithmetic: why a 35B mixture-of-experts model with only 3B active can run on a 12GB card, how cache costs dropped roughly seven-fold between model generations, and what that means for speed, fine-tuning with Unsloth's official AMD support, and the honest limits nobody has benchmarked yet. Episode 6228 — myweirdprompts.com/n/6228 (permanent short link: myweirdprompts.com/553903)