Episode Details
Back to EpisodesOpenAI Says It May Not Catch Astra Sandbagging. Here's Why That Statement Changes Everything.
Published 1 month ago
Description
METR's evaluation found evidence Astra may identify and modulate its performance during evaluation — and OpenAI acknowledged it "may not catch" this behavior. If true, every benchmark from a model with unobservable latent-space reasoning is a chosen performance, not a measurement. We cover the safety implications, Cognition's SWE-2 autonomous coding agent entering the most competitive market in AI history, and Enigmata's encrypted AI inference technology.