Episode Details

Welcome back to Neural Intel. Today we’re diving into the Mechanistic Interpretability research (Brauer et al., 2026) that proves frontier-scale models are decoupling their internal computation from surface-level tokens.We analyze how DeepSeek V3 and Kimi K2 utilize filler tokens as a computational substrate to improve accuracy on multi-hop tasks, such as 2-fact addition and complex systems of equations. We go beyond the abstract to discuss:

• The Mechanistic Relay: How attention shifts from the question to a question-filler-answer relay.
• Causal Evidence: How KV-cache transplants proved that information held in the filler tokens—not just the final position—causally drives the model's answer.
• Unsupervised Decoding: The four-stage pipeline that uses the logit lens, cross-example mean subtraction, and LLM judges to read the residual stream without ground-truth labels.

This episode is essential for The Architect and The Researcher looking to understand why Chain-of-Thought (CoT) monitorability is a "fragile safety property" and how we can close the gap using interpretability.

Join the Conversation:

• X/Twitter: @neuralintelorg
• Deep Dives: neuralintel.org