Episode Details

Join John as he delves into the latest breakthroughs in local AI, exploring the practicality of running large language models on basic hardware—no expensive GPUs required. Discover how innovations like GGUF formats, quantisation, and advanced Vulkan API features are putting powerful AI into the hands of everyday users. Plus, learn about new tools in the Linux community, including BleachBit’s TUI and better gaming on MSI handhelds, as well as the latest in safe and predictable multi-agent AI systems. Tune in for insights on the future of open source, hardware compatibility, and the evolving role of AI at the edge.