Episode Details

Back to Episodes
Xet, Buckets, and Auto-Pulling Model Weights

Xet, Buckets, and Auto-Pulling Model Weights

Episode 5416 Published 3 weeks, 4 days ago
Description
Hugging Face quietly migrated 500,000 repositories and 20 petabytes to Xet, a chunk-level dedup engine that replaced file-level Git LFS. This episode unpacks how that migration stayed invisible, why content-defined chunking matters for quantization-heavy model repos, and what Storage Buckets actually are versus repositories. Then it tackles the real question: can a bucket be configured to automatically pull new upstream variants? The answer is no, and the reason is structural, not a missing feature. Episode #260264 — open it directly at myweirdprompts.com/260264
Listen Now

Love PodBriefly?

If you like Podbriefly.com, please consider donating to support the ongoing development.

Support Us