Episode Details

this week was absolutely bonkers. For starters, for the first time ever, we got an Open Weights model (Command R+) to jump over GPT-4 in human rankings on LMsys, this is huge!

Then on Tuesday, it seems that all the companies just wanted to one up one another, first Gemini 1.5 released with updates, made it available in 180 countries, added audio mode + tons of API improvements and system prompts, then less than an hour later, OpenAI has given us a "majorly improved" GPT-4 Turbo version (2024-04-09) that is now back to being the BEST LLM IN THE WORLD and to cap that day off, Mistral did the thing again, the thing being, dropping a torrent link in a tweet with no explanations.

What was in that torrent is a Mixtral 8x22B MoE (which we started calling Bixtral) which comes with an Apache2 license and seems to be VERY good!

We also saw the first finetune from HuggingFace/KAIST folks less than 48 hours later (the authors of said finetune actually came on the show 🎉 )

Fully Connected is a week from today! If you haven't yet signed up, use THURSDAI promo code and come hear from Richard Socher (You.com), Jerry Liu (Ilamaindex CEO), Karoly (TwoMinutePapers), Joe Spisak (Meta) and and leaders from NVIDIA, Snowflake, Microsoft, Coatue, Adobe, Siemens, Lambda and tons more 👇

TL;DR of all topics covered:

* Open Source LLMs

* 🔥 Mistral releases Mixtral 8x22 Apache 2 licensed MoE model (Torrent, TRY IT)

* Cohere CMDR+ jumps to no 6 on LMSys and beats GPT4 (X)

* CodeGemma, RecurrentGemma & Gemma Instruct 1.1 (Announcement)

* Auto-code-rover gets 22% on SWE bench (Announcement)

* HuggingFace - Zephyr 141B-A35B - First Bixtral Finetune (Announcement)

* Mistral 22B - 1 single expert extracted from MoE (Announcement, HF)

* This weeks Buzz - Weights & Biases updates

* FullyConnected is in 1 week! (Come meet us)

* Big CO LLMs + APIs

* 🔥 GPT-4 turbo is back to being number 1 AI with 88.2% Human Eval score (X)

* Gemini 1.5 Pro now understands audio, uses unlimited files, acts on your commands, and lets devs build incredible things with JSON mode (X)

* LLama 3 coming out in less than a month (confirmed by Meta folks)

* XAI Grok now powers news summaries on X (Example)

* Cohere new Rerank 3 (X)

* Voice & Audio

* HuggingFace trained Parler-TTS (Announcement, Github)

* Udio finally launched it's service (

Listen Now