Podcast Episodes

What people get wrong about the leading Chinese open models: Adoption and censorship

https://www.interconnects.ai/p/what-people-get-wrong-about-the-leading

Two editor’s notes to start.

* First, we released our OLMo 2 1B model last week and it’s competitive with Gemmas and Llamas of com…

Published on 4 months, 1 week ago

State of play of AI progress (and related brakes on an intelligence explosion)

https://www.interconnects.ai/p/brakes-on-an-intelligence-explosion

Intelligence explosions are far from a new idea in the technological discourse. They’re a natural thought experiment that follows fro…

Published on 4 months, 2 weeks ago

Transparency and (shifting) priority stacks

https://www.interconnects.ai/p/transparency-and-shifting-priority

The fact that we get new AI model launches from multiple labs detailing their performance on complex and shared benchmarks is an anoma…

Published on 4 months, 3 weeks ago

OpenAI's o3: Over-optimization is back and weirder than ever

https://www.interconnects.ai/p/openais-o3-over-optimization-is-back

Over-optimization is a classic problem to reinforcement learning (RL) proper, the RL from human feedback (RLHF) that gave us ChatGPT…

Published on 4 months, 4 weeks ago

OpenAI's GPT-4.1 and separating the API from ChatGPT

https://www.interconnects.ai/p/openais-gpt-41-and-separating-the

Recently I gave another talk on RLVR experiments and I posted some thoughts on OLMoTrace — Ai2’s recent tool to let you look at the tra…

Published on 5 months ago

Llama 4: Did Meta just push the panic button?

https://www.interconnects.ai/p/llama-4

Where Llama 2’s and Llama 3’s releases were arguably some of the top few events in AI for their respective release years, Llama 4 feels entirely lost. Meta has a…

Published on 5 months, 1 week ago

RL backlog: OpenAI's many RLs, clarifying distillation, and latent reasoning

https://www.interconnects.ai/p/rl-backlog-openais-many-rls-clarifying

I have a second blog where I post half-baked thoughts, sometimes previews of what comes here. If you’re interested, I posted some …

Published on 5 months, 1 week ago

Gemini 2.5 Pro and Google's second chance with AI

https://www.interconnects.ai/p/gemini-25-pro-googles-second-ai-chance

Google, with its immense infrastructure and talent, has been the safe bet for the question of “Who will have the best models in a …

Published on 5 months, 3 weeks ago

Managing frontier model training organizations (or teams)

https://www.interconnects.ai/p/how-to-manage-ai-training-organizations

It is a closely guarded secret how the leading AI laboratories structure their training teams. As with other technology companies…

Published on 5 months, 4 weeks ago

Gemma 3, OLMo 2 32B, and the growing potential of open-source AI

Post: https://www.interconnects.ai/p/gemma-3-olmo-2-32b-and-the-growing

Ever since the release of the original ChatGPT, much has been said about making a truly open-source version of it — with data, c…

Published on 6 months ago