Episode Details
Back to Episodes“Features that current AIs don’t have that future AIs will have” by Alexander Gietelink Oldenziel
Description
Features that current AIs don't have that future AIs will have:
Continual Learning [& long-term memory]
Every second humans update their brain weights. The brain autonomously decides what to update on. Humans can also consciously decide to curate their data sets - eg by deciding to go to college.
Current LLMs do not continually update their weights. Instead, they occasionally get a large update based on datasets curated by a team of humans.
This is alleviated somewhat by the ability of AIs to do in-context learning but nevertheless it seems to be a major limitation. Note that this is an especially large limitation in domains with sparse data. In domains where all of humanity has an enormous amount of data eg math, programming, physics, anime trivia, trials and tribulations of English kings - AIs dominate. In areas where there is little data: the weird idiosyncracies of a particular job, boss, people, colleagues etc it can struggle.
Note that this restrictions also interferes with AIs from effectively 'learning to learn' & caps its long-term memory.
Neuralese
Current AI's CoT is (mostly) English. But it plausible this is not the most efficient way to structure thoughts. Instead of english [...]
---
Outline:
(00:16) Continual Learning \[& long-term memory\]
(01:24) Neuralese
(01:41) Telepathy
(02:01) ClaudeGlobal
---
First published:
August 13th, 2026
---
Narrated by TYPE III AUDIO.