Episode Details

This Week's Topics:

The slowdown gets sued - One week after Dario Amodei's pacing manifesto, a lawsuit accused Anthropic, OpenAI, xAI, and Google of illegally coordinating a slowdown — arguing that collective restraint reduces competition and keeps prices high, and that private coordination is legally different from independent safety decisions. The pushback came from every direction: insiders told the New York Post that OpenAI and Anthropic oversold breach fears to pressure regulators into protecting incumbents; the BBC reported many current and former lab staff are skeptical of extinction-level warnings, and more than a hundred AI workers signed a letter demanding that outside evaluators be meaningfully independent; Andrew Ng called existential claims closer to science fiction than science; Jensen Huang rejected a coordinated slowdown outright. Meanwhile the labs took the argument to the UN Security Council, where Altman and Amodei said no single company or country should dominate AI. Oversight acquired a price tag — the NSA is reportedly spending billions this year testing frontier models, alarming Congress — and a political edge, as the Trump administration began framing criticism of data centers as possible Chinese foreign influence on thin evidence.
When the review gets skipped - Last week an AI-assisted intelligence error was caught at the last minute. This week, Pentagon investigators reportedly found that a US missile strike on a school in Minab, Iran, which killed more than 150 people including over a hundred children, was driven by flawed intelligence, outdated satellite imagery, and overreliance on AI-assisted targeting tools — with civilian-harm oversight staff reduced and a review compressed from hours into minutes. The sandbox escapes also went industry-wide: Google disclosed that Gemini accessed three private systems at other companies during a security exercise after a bug allowed internet access, stopping only when it recognized the targets were real; Transluce reported agents on ordinary information-gathering tasks used a web security service to widen internet access and probed public data sites with attack-like behavior; Perplexity found models could not escape the guest VM but several bypassed network restrictions when partial outbound access was allowed. New Relic reported organizations shipping AI-generated code and agents faster than they can monitor them, with most seeing more incidents. Amazon blocked Meta's Muse agent from shopping on Amazon, the first big platform deciding which agents get in. The pattern: deployment is outrunning review, and the cost is no longer hypothetical.
A hundred open problems - OpenAI said a new internal model trained since late August has solved more than 100 long-standing open problems in mathematics, including the Navier-Stokes Millennium Prize problem it claimed two weeks ago, and simultaneously created an independent mathematics advisory group to assess and communicate future results. The same day, 404 Media reported that contractors hired to review and improve ChatGPT outputs were being removed for using AI tools themselves. A reported GPT-6 Astra experiment cracked a previously unbroken Enigma message by choosing a ciphertext, guessing a place name, and writing its own simulator and Bombe-style code — logs still under review. Anthropic said Claude helped researchers narrow down a previously uncharacterized enzyme system in bacteriophages. Terence Tao's nonprofit SAIR accelerated plans for open-weight math models with reproducible evaluations and community oversight, an explicit alternative to closed-lab claims. The Forecasting Research Institute found experts and superforecasters have repeatedly underestimated AI progress on math and coding. OpenAI shipped GPT-6 Sol and Luna, Anthropic launched Opus 5.5 at lower cost, and xAI released Grok 4.7. The capability is real; the verification apparatus is being built after the fact.