Episode Details
Back to Episodes
How to Fine-Tune ASR on Noisy Audio
Episode 6055
Published 1 week, 4 days ago
Description
Building a robust speech recognition model feels like it should require collecting mountains of noisy audio. It doesn't. The research points to a different approach: build a compact noise library, mix it into clean speech at sampled signal-to-noise ratios, and keep a healthy share of clean originals in every epoch. This episode walks through the composition questions that actually determine success — how much augmented data is too much, which noise types to prioritize, why the best adaptation technique depends on whether the noise is stationary or not, and how to schedule augmentation across training. Along the way: the ROAR paper's original-to-augmented ratio, NVIDIA's Riva recipe, the IIT Bombay noise taxonomy, and a field-recorded noise dataset from 165 Indian districts that captures overlapping sound the way deployment actually delivers it.
Episode 6055 — myweirdprompts.com/n/6055 (permanent short link: myweirdprompts.com/418379)