Episode Details
Back to Episodes“The Game is Set for a Targeted Memetic Attack on the AI Safety Community” by keltan
Description
While this is relevant to my work at MIRI, I have not checked these ideas with anyone else on the team and am posting this on my personal LW account. These views are my own. And to be honest, I am writing this mostly to remind myself of my weakness.
---
I expect one (or many) adversarial memetic attacks aiming to trip you up, perhaps consisting of fake leaks relating to dangerous stuff happening in the labs. Specifically, worrying incidents that may fit snugly within your worldview, leaking from multiple sources including news outlet/s, but not confirmed/confirmable by a primary source. Think rumors about exfiltrated weights, AIs attempting to create viruses, agent swarms hacking into and gathering information from nuclear infrastructure, etc.
An easy way to remove status from a movement is to trip it up: make it fall for a misinformation trap in public, then use that slip-up to discredit the movement for all time. The game is set for a memetic attack like this. There's a well-resourced group waiting for your screw-up.
And then you may remember much that will help you.
In public and in private, if you feel surprised or confused, notice your confusion. These [...]
The original text contained 2 footnotes which were omitted from this narration.
---
First published:
September 17th, 2026
---
Narrated by TYPE III AUDIO.