Episode Details

Welcome back everyone, can you believe it's another ThursdAI already? And can you believe me when I tell you that friends of the pod Matt Shumer & Sahil form Glaive.ai just dropped a LLama 3.1 70B finetune that you can download that will outperform Claude Sonnet 3.5 while running locally on your machine?

Today was a VERY heavy Open Source focused show, we had a great chat w/ Niklas, the leading author of OLMoE, a new and 100% open source MoE from Allen AI, a chat with Eugene (pico_creator) about RWKV being deployed to over 1.5 billion devices with Windows updates and a lot more.

In the realm of the big companies, Elon shook the world of AI by turning on the biggest training cluster called Colossus (100K H100 GPUs) which was scaled in 122 days 😮 and Anthropic announced that they have 500K context window Claude that's only reserved if you're an enterprise customer, while OpenAI is floating an idea of a $2000/mo subscription for Orion, their next version of a 100x better chatGPT?!

TL;DR

* Open Source LLMs

* Matt Shumer / Glaive - Reflection-LLama 70B beats Claude 3.5 (X, HF)

* Allen AI - OLMoE - first "good" MoE 100% OpenSource (X, Blog, Paper, WandB)

* RWKV.cpp is deployed with Windows to 1.5 Billion devices

* MMMU pro - more robust multi disipline multimodal understanding bench (proj)

* 01AI - Yi-Coder 1.5B and 9B (X, Blog, HF)

* Big CO LLMs + APIs

* Replit launches Agent in beta - from coding to production (X, Try It)

* Ilya SSI announces 1B round from everyone (Post)

* Cohere updates Command-R and Command R+ on API (Blog)

* Claude Enterprise with 500K context window (Blog)

* Claude invisibly adds instructions (even via the API?) (X)

* Google got structured output finally (Docs)

* Amazon to include Claude in Alexa starting this October (Blog)

* X ai scaled Colossus to 100K H100 GPU goes online (X)

* DeepMind - AlphaProteo new paper (Blog,

Listen Now