Episode Details

In 2022, two of Anthropic's co-founders, Daniela and Dario Amodei described the company as a small group leaving OpenAI in late 2020 and early 2021 during the pandemic, meeting masked in backyards, because they wanted to make what they called a "focused research bet" with a tightly aligned team. The bet was on building AI systems that are "helpful, honest, and harmless". On race dynamics, Dario was explicit that Anthropic should build models close to the state of the art (because you need frontier models to study frontier safety problems), but that they shouldn't race ahead or build models bigger than other orgs, and shouldn't ramp up excitement or hype about giant models. Fast forward to today: Anthropic is a frontier for-profit company valued at $380 billion as of Feb 2026, is pursuing agentic coding on a technical trajectory that approaches autonomous recursive self-improvement, Dario has among the shortest AGI/TAI timelines of any major AI lab CEOs, their recently revised RSP has drawn criticism for dropping what many in the community interpreted as a commitment to pause development under certain risk thresholds, and now, what this piece is primarily about, the "~oversight" organisations it once called for will apparently [...]

---

Outline:

(02:37) A note on framing:

(03:21) The causal chain

(06:00) Selection mechanisms

(07:29) Counterforces

(08:52) Value drift and (perverse? ) incentive structure

(10:27) Where EA cant measure its own success

(11:36) All this can be testable

---

First published:
March 22nd, 2026

Source:
https://forum.effectivealtruism.org/posts/48mypEepqBqWibKtJ/ea-as-a-moloch-nobody-chose

---

Narrated by TYPE III AUDIO.