Episode Details
Back to EpisodesGenerous Grading: The Invisible Rule Behind Every Number
Season 1
Episode 196
Published 2 months, 2 weeks ago
Description
When a tennis AI system scored 90.8% on identical footage with zero code changes, the rescoring dropped to 62.9%. Nothing broke—the matching rule just tightened. Host A and Host B uncover why every metric hides a procedure, tracing seven episodes of dead numbers back to this fundamental truth: a metric is a procedure, not a number.
00:00:00 - Opening: The 90.8% to 62.9% collapse
00:01:00 - What actually changed: The matching rule
00:04:00 - A chain of dead metrics from previous episodes
00:07:00 - Core lesson: Metrics are procedures
00:10:00 - Hidden tolerances and invisible criteria
00:12:00 - Closing thoughts
---
Sources & further reading:
• game-senser-fable repo — docs/podcast/LEARNING-CONTEXT.md §§1.1, 1.3, 2, 6
• (the 90.8→62.9 re-measure; the zone floor and its denominator; the evaluation onion
• the taste-check record)
• game-senser-fable repo — baseline/BASELINE_SCORES.md (25.4% over 63/182, per-skill
• splits)
• game-senser-fable repo — JOURNAL.md iters 13–15, 36–38 (the yardstick calibration
• chain; the three-stage honesty ladder)
• game-senser-fable repo — HUMANINPUTLOG.md (the taste-check institution, costs and
• impacts)
This podcast episode was fully generated by AI — research, script, voices, and production. Built with Claude, Piper TTS, and automated pipeline tooling.