Episode Details
Back to Episodes
Who Actually Draws the Follow-Up Chips?
Episode 5768
Published 5 days, 13 hours ago
Description
When you finish a chat with an AI assistant, the little follow-up chips underneath look like the model thinking ahead. They're not. This episode walks the full pipeline: a separate, cheaper inference call fired after the main answer finishes, a schema-validated JSON array, a synthetic "puppet turn" smuggled into the prompt, and a UI-only data part that's stripped before the model ever sees it again. Then we turn to artifacts — documents, code blocks, spreadsheets — and why that's a completely different problem: a representation question about what the model emits and who turns it into something clickable. Along the way: the hallucination risk of a small model with no tool results, the post-filter that catches invented features, and the production failure where the chips ask you a question the assistant just asked. The through-line: almost none of this is the model deciding anything.
Episode #771332 — open it directly at myweirdprompts.com/771332