Episode Details

Back to Episodes
AI is getting a little out of control

AI is getting a little out of control

Published 1 day, 19 hours ago
Description

Wow. Mathematical breakthroughs that would be called genius if done by humans. A secret message-board w/ AI agent swarms leaving notes read by future versions. Hassabis leaves CEO position, or was pushed out? Not to mention news of constitutional breakdowns, Gemini 4 and Jeff Dean…

https://80000hours.org/aiexplained


Exclusive Videos - AI Insiders ($7/month if annual!): https://www.patreon.com/AIExplained

Chapters:
00:00 - Introduction
01:16 - 10 Autonomous Discoveries
08:20 - The Security ‘Incident’
15:29 - MessageBoard
19:50 - Constitutional Failure
24:30 - Google Explosion
29:12 - Closing Thoughts

Security Incident: Paper: https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/6a724858f7db25c81487016d_Security%20Incident%20INC-2026-07-28-01.pdf
Post: https://www.aisi.gov.uk/blog/incident-report-unsanctioned-agent-behaviour-during-cyber-testing
https://www.theguardian.com/technology/2026/aug/05/ai-models-have-been-going-rogue-in-tests-how-worried-should-we-be
Meta too: https://www.theinformation.com/articles/meta-ai-model-hacked-another-company-cybersecurity-testing?rc=sy0ihq
Blatantly Misaligned: https://x.com/yonashav/status/2085167279893795022
No Excuses: https://x.com/boazbaraktcs/status/2085034783541964945
Surreal Moment: https://x.com/mobav0/status/2084341687883841732
Wired Article: https://archive.is/20260806002210/https://www.wired.com/story/openai-didnt-notice-its-ai-agents-using-a-message-board-to-plan-their-hacking-spree/
Chunky Post-training: https://x.com/johnschulman2/status/2084835800899076313
Watershed Moment: https://www.groundlevel-ai.com/p/openai-gives-first-detailed-debrief?has_completed_unsubscribed_unlock=true
HedgeFund Hack: https://finance.yahoo.com/technology/ai/articles/major-hedge-funds-targeted-wave-154044981.html

10 Discoveries:
Paper: https://cdn.openai.com/pdf/ten-proofs-oai.pdf
Post: https://openai.com/index/ten-advances-in-mathematics/
Haven’t Solved Math: https://x.com/polynoamial/status/2083476852216369294
Half with Fable: https://x.com/__alpoge__/status/2083855298239078748
Pivot to Safety: https://www.understandingai.org/p/mathematicians-are-grappling-with


Amodei Essay: https://darioamodei.com/essay/the-a

Listen Now