Episode Details
Back to Episodes
Where Do Tiny Speech Rules Live? A Ladder From Regex to LoRA
Episode 6160
Published 1 week, 4 days ago
Description
Daniel wants his on-phone Parakeet model to write "FBI" instead of "F B I" and "fifty NIS" instead of "fifty shekels." That sounds like a rule, but speech models don't obey rules — they nudge probabilities. This episode walks a ladder from cheapest to heaviest: rule-based inverse text normalization with weighted finite state transducers, decode-time phrase boosting, shallow fusion with a KenLM language model, and finally adapters and fine-tuning. Along the way: why the shekel sign is physically absent from Parakeet's vocabulary, why Whisper's prompt is a style steer rather than an instruction, and the one question that tells you which rung each task actually needs.
Episode 6160 — myweirdprompts.com/n/6160 (permanent short link: myweirdprompts.com/399009)