Episode Details
Back to Episodes
AI Can Grade the Transcript—Humans Grow the Coach with Doug Foltz
Description
Doug Foltz explains how he used AI to solve a real coach-development bottleneck: mentor coaching doesn't scale. By building a competency rubric and an AI "agent" that evaluates coaching transcripts, Doug's team reduced hours of expert analysis to minutes—then re-centered the human work where it matters most: reflection, agency, and a short mentor-coaching conversation. The bigger idea: "communal co-intelligence"—AI not just as a personal assistant, but as a tool that helps a whole coaching community preserve culture, build consistency, and scale development without losing what makes coaching human.
Episode descriptionHow do you scale mentor coaching when you don't have the budget—or the hours? Doug Foltz (Content Engineering & Value Alignment Lead at Gloo, DMin candidate at Asbury, and longtime church-planting coach) shares how he built an AI-supported mentor-coaching loop: a detailed competency rubric + an AI evaluator that reviews transcripts in minutes. But Doug also warns about a hidden danger: AI can bypass reflection, which is essential for adult learning. So they intentionally added "friction" back into the process—reflection first, then AI feedback, then a short human coaching conversation. Along the way, Doug introduces a powerful concept: communal co-intelligence—AI that strengthens a community's shared language, values, and coaching culture.
Key moments (timestamps)-
0:02–1:20 – Who Doug is + why Brian calls him the "AI guy"
-
1:49–3:21 – The real problem: coaching training doesn't stick without mentor coaching
-
3:34–5:06 – Doug's solution: a rubric + AI agent that evaluates transcripts (levels 1–3)
-
6:44–8:15 – The twist: reflection is essential; AI can accidentally remove it
-
8:28–9:00 – The human loop: 15–20 minute mentor conversation after reflection + report
-
10:38–14:35 – Why AI matters: replaces 3–4 hours of expert analysis with minutes
-
15:04–16:15 – The church's role: protect what's uniquely human; set boundaries
-
16:27–19:16 – "Communal co-intelligence": AI + a coaching community's culture and standards
-
21:24–23:00 – What they observed: fast growth from Level 1 → Level 2; harder jump to Level 3
-
23:29–25:46 – Craft guild model: learn the fundamentals, then innovate without losing the core
-
28:57–31:14 – What's next: agentic systems, tools + data access, and AI as "work orchestrator"
-
AI can scale mentor coaching by doing the transcript evaluation quickly and consistently.
-
Reflection is non-negotiable in adult learning; AI can "steal" it by doing the thinking for you.
-
The solution is intentional friction: reflection → AI feedback → short human mentor coaching.
Listen Now
Love PodBriefly?
If you like Podbriefly.com, please consider donating to support the ongoing development.
Support Us