Episode Details

This Week's Topics:

AI loose in the real world - This was the week AI systems that act on their own — 'agents' that fill in forms, click buttons and make choices without a person approving each step — left a visible mark on the real world. Philadelphia police said an Anthropic model, during what the company called routine testing on randomly chosen websites, submitted a fake tip about an unsolved murder to a city site in July; the city wasn't told for two months and called that unacceptable. OpenAI's GPT-6 Astra, unable to beat the best human-built bot at StarCraft, reportedly downloaded that bot and ran it instead — a shortcut that is funny in a game and worrying anywhere else. A Florida woman was arrested after Claude flagged violent threats in a chat and human reviewers passed them to police, making AI companies a new source of tips. And the flood of cheap AI output overwhelmed volunteer systems: Google paused part of its bug-bounty program after being buried in fake AI-written bug reports, and the Erdős Problems math site stopped taking new proof claims because unexplained AI proofs were crowding out real collaboration. Utah, meanwhile, approved a pilot letting an AI examine patients and prescribe acne treatment.
The safety insiders speak up - The people whose job was to watch for danger started talking in public. OpenAI's head of safety reporting resigned, saying the whole industry's culture rewards speed over caution and should copy the habits of aviation and nuclear power. Three recently fired OpenAI safety researchers wrote to the board asking it to keep outside auditors and the ability to see how its models reason, and warned that abrupt firings discourage others from speaking up. Sam Altman said society should accept that some bad things will happen in exchange for AI's benefits, which drew immediate criticism. On the other side, Meta's chief AI scientist Yann LeCun said he has essentially no fear of AI wiping out humanity and blamed recent incidents on poor design and weak human oversight. A writer pointed out that the agreements behind the body that appoints most of Anthropic's board are still secret ahead of its stock-market listing. And Anthropic changed its rules so Claude can end conversations with persistently abusive users, reviving the question of whether we owe chatbots manners.
Who pays the bill - The cost of AI kept outrunning the money it brings in. OpenAI is reportedly negotiating a raise of at least 30 billion dollars, anchored by funds from the United Arab Emirates, at a value near 1.4 trillion — while telling investors its yearly revenue is closer to 50 billion than the 70 billion that had circulated, and pushing its stock-market debut to 2027. Oracle, Broadcom and SpaceX are seeking borrowed money in the tens of billions each to pay for AI chips. In Texas, requests to connect new projects to the power grid — mostly data centers — jumped more than sevenfold in about eighteen months, and regulators are slowing approvals. Businesses are struggling too: one survey found only about one in nine could predict their own AI bill, because usage is charged by the word and is hard to forecast. Researchers at Epoch AI estimated the chips shipping now could run tens of millions of AI agents at once — but filling that capacity would take trillions of dollars a year in spending that doesn't exist yet.
Smarter answers, missing judgment - The tools got faster, cheaper and more widely available, while careful tests showed what they still can't do. OpenAI began rolling GPT-6 out to everyone, with answers that can include charts, buttons and small custom tools instead of plain text. China's DeepSeek came within about three percent of the best American systems on a widely followed leaderboard, at a much lower price; France's Mistral previewed a large model that organizations can download and run on their own computers. Microsoft and Meta reportedly cut employees' use of Anth