Episode Details
Back to Episodes
📅 ThursdAI Jan 18 - Nous Mixtral, Deepmind AlphaGeometry, LMSys SGLang, Rabbit R1 + Perplexity, LLama 3 is training & more AI news this week
Description
👋 Hey there, been quite a week, started slow and whoah, the last two days were jam-packed with news, I was able to barely keep up! But thankfully, the motto of ThursdAI is, we stay up to date so you don’t have to!
We had a milestone, 1.1K listeners tuned into the live show recording, it’s quite the number, and I’m humbled to present the conversation and updates to that many people, if you’re reading this but never joined live, welcome! We’re going live every week on ThursdAI, 8:30AM pacific time.
TL;DR of all topics covered:
* Open Source LLMs
* Nous Hermes Mixtral finetune (X, HF DPO version, HF SFT version)
* NeuralBeagle14-7B - From Maxime Labonne (X, HF,)
* It's the best-performing 7B parameter model on the Open LLM Leaderboard (when released, now 4th)
* We had a full conversation with Maxime about merging that will release as a standalone episode on Sunday!
* LMsys - SGLang - a 5x performance on inference (X, Blog, Github)
* NeuralMagic applying #sparceGPT to famous models to compress them with 50% sparsity (X, Paper)
* Big CO LLMs + APIs
* 🔥 Google Deepmind solves geometry at Olympiad level with 100M synthetic data (Announcement, Blog)
* Meta announces Llama3 is training, will have 350,000 H100 GPUs (X)
* Open AI releases guidelines for upcoming elections and removes restrictions for war use (Blog)
* Sam Altman (in Davos) doesn't think that AGI will change things as much as people think (X)
* Samsung S24 has AI everywhere, including real time translation of calls (X)
* Voice & Audio
* Meta releases MAGNet (X, HF)
* AI Art & Diffusion & 3D
* Stable diffusion runs 100% in the browser with WebGPU, Diffusers.js (X thread)
* DeciAI - Deci Diffusion - A text-to-image 732M-parameter model that’s 2.6x faster and 61% cheaper than Stable Diffusion 1.5 with on-par image quality
* Tools & Hardware
* Rabbit R1 announces a deal with Perplexity, giving a full year of perplexity pro to Rabbit R1 users and will be the