Episode Details

Back to Episodes
How the Kaldi Team Pivoted to OmniVoice

How the Kaldi Team Pivoted to OmniVoice

Episode 6621 Published 9 hours ago
Description
Speech recognition and speech synthesis have historically been separate worlds, yet the k2-fsa team at Xiaomi crossed over to build OmniVoice in just ten months. Tracing the lineage from Daniel Povey's Kaldi toolkit and Next-gen Kaldi's PyTorch stack to Han Zhu's ZipVoice, this deep dive unpacks how data pipelines proved direction-agnostic. It also breaks down OmniVoice's single-stage masked diffusion architecture, its Qwen3 initialization, and how it maps text directly to acoustic tokens across 600 languages. Episode 6621 — myweirdprompts.com/n/6621 (permanent short link: myweirdprompts.com/193859) Listen on Android: MWP FM Player — myweirdprompts.com/apk
Listen Now

Love PodBriefly?

If you like Podbriefly.com, please consider donating to support the ongoing development.

Support Us