Podcast Episode Details
Back to Podcast Episodes
Bubble or No Bubble, AI Keeps Progressing (ft. Relentless Learning + Introspection)
Season 4 Episode 1
Don’t let headlines about bubbles distract you from the real avenues of progress being explored in AI every week, including what had been thought to be a long-term blocker - continual learning (learning on the fly).
https://app.grayswan.ai/ai-explained
This, plus models introspecting (hesitate before you berate), Nano Banana 2 possibly spotted, Chinese imagen and more.
AI Insiders ($9!): https://www.patreon.com/AIExplained
Chapters:
00:00 - Introduction
01:26 - Continual Learning (Nested Learning / HOPE)
07:00 - Introspection
10:54 - Image-Gen Progress
Nested Learning Post: https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/
Nested Learning Paper: https://abehrouz.github.io/files/NL.pdf
Original Titans Paper: https://arxiv.org/pdf/2501.00663
Siri News: https://www.bloomberg.com/news/articles/2025-11-05/apple-plans-to-use-1-2-trillion-parameter-google-gemini-model-to-power-new-siri
Introspection: https://www.anthropic.com/research/introspection
Full Paper: https://transformer-circuits.pub/2025/introspection/index.html#mechanisms
Earlier Work: https://www.anthropic.com/research/mapping-mind-language-model
https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html
Release Post: https://x.com/AnthropicAI/status/1983584136972677319
https://lmcouncil.ai
Non-hype Newsletter: https://signaltonoise.beehiiv.com/
Podcast: https://aiexplainedopodcast.buzzsprout.com/
Published on 1 week, 2 days ago