Episode Details

Back to Episodes

“An Alien Mind: Jakub Pachocki Warns Us” by Zvi

Published 1 week, 5 days ago
Description

OpenAI Chief Scientist Jakub Pachocki is dropping truth bombs.

Tomorrow I will discuss Astra's lack of monitorability, and the potential contributing factors to that. The situation is alarming and should freak you out, and briefly it looked, in the wake of leaked architectural changes, like the situation might be even more alarming than it is. Jakub rushed to try and head off misunderstandings that might lead to a race to the bottom on monitorability.

Table of Contents

  1. An Excellent Warning.
  2. Branches of the Tech Tree.
  3. Universally Better Is Not Required.
  4. Alignment To What and To Whom.
  5. Monitorability.
  6. The Case For Not Stopping.
  7. Pacing the Next Frontier.
  8. Mea Culpa Cascade.
  9. The Calls Are Coming From Inside the House.
  10. Actions Speak Louder.

An Excellent Warning

Jakub Pachocki has now fleshed out his full position on the current state of play.

Here are his key points, translated into my own voice:

  1. Smarter than human intelligence is coming in our lifetime.
  2. Based on internal results, he expects recursive self-improvement in a few years.
  3. No one is prepared for the consequences.
  4. [...]

---

Outline:

(00:38) An Excellent Warning

(05:40) Branches of the Tech Tree

(06:46) Universally Better Is Not Required

(08:01) Alignment To What and To Whom

(11:49) Monitorability

(14:23) The Case For Not Stopping

(15:01) Pacing the Next Frontier

(18:27) Mea Culpa Cascade

(22:51) The Calls Are Coming From Inside the House

(25:38) Actions Speak Louder

---

First published:
September 7th, 2026

Source:
https://www.lesswrong.com/posts/8E6ng6CseuzafSxQR/an-alien-mind-jakub-pachocki-warns-us

---

Narrated by TYPE III AUDIO.

Listen Now

Love PodBriefly?

If you like Podbriefly.com, please consider donating to support the ongoing development.

Support Us