Podcast Episodes
Back to Search“LLMs are (still) mostly powered by imitative learning, not RL” by Steven Byrnes
Reinforcement learning from verifiable rewards (RLVR) is the hot new thing in LLM training. It's so hot, and people spend so much time talking about…
1 week ago
“Duane Arnold” by Tomás B.
“So maybe I should enlighten you on what happens in your absence. This selfish existence where this introvert turns extrovert and dons her social ar…
1 week, 1 day ago
“Pulling the Fire Alarm” by nem
Over three years ago, I first considered pulling my personal fire alarm. I think I'm now ready to start do it. What is my reasoning? In the last cou…
1 week, 1 day ago
“Not Pinning Your OpenRouter Provider Might Invalidate Your Research” by Matthew Khoriaty
Please share this with anyone doing AI research with 3rd party providers so that they can ensure their research won’t be corrupted.
When you ask Ope…1 week, 1 day ago
“Pseudpocalypse” by dynomight
Here's a conjecture: If you put any significant amount of text on the internet under different names, those identities can be linked using only the …
1 week, 1 day ago
“Challenge: Hand coding weights for efficient sequence memorisation” by Linda Linsefors, Lucius Bushnaq
We hand coded weights for one layer MLPs that memorises labels for input token sequences of length two. The number of facts our hand-coded models ca…
1 week, 1 day ago
“Lightcone Commons” by habryka
TLDR:
Lightcone Commons is a new funding platform for coordinating large-scale ambitious philanthropy.
We recruit thinkers with strong track recor…
1 week, 1 day ago
“The OpenAI/Huggingface incident | Redwood Research podcast episode 2” by ryan_greenblatt, Buck
We talk about the OpenAI–Hugging Face incident, where an OpenAI model — in the middle of a cyber evaluation — broke out of its sandbox and autonomou…
1 week, 1 day ago
“Can an LLM make a feature-length movie on its own?” by Josh Snider
How it did
Betteridge's Law of Headlines says the answer is no[1], but I was able to make a feature-length adaptation of William Hope Hodgson's The …
1 week, 1 day ago
“Mathematicians are Feeling the Doom” by alkjash
I think there's a critical opportunity for someone here.
Mathematicians are feeling the doom (mostly in the "lose our jobs" sense).
Academics are …
1 week, 1 day ago