Episode Details

Back to Episodes
ThursdAI Sep 7 - Falcon 180B 🦅 , 🔥 Mojo lang finally here, YaRN scaling interview, Many OSS models & more AI news

ThursdAI Sep 7 - Falcon 180B 🦅 , 🔥 Mojo lang finally here, YaRN scaling interview, Many OSS models & more AI news

Published 2 years, 6 months ago
Description

Hey ya’ll, welcome to yet another ThursdAI, this is Alex coming at you every ThursdAI, including a live recording this time!

Which was incredible, we chatted about Falcon 180B,had a great interview in the end with 3 authors of the YaRN scaling paper and LLongMa 128K context, had 3 breaking news! in the middle, MOJO🔥 has been released and Adept released a LLaMa comparable OSS model (and friend of the pod) @reach_vb showed an open ASR leaderboard on hugging face! We also covered an incredible tiny model called StarCoder 1B that was finetuned by friend of the pod (who joined the space to talk to us about it!)

As always, you can listen to the whole 3 hour long form conversation (raw, unedited) on our Zealous page (and add it to your podcatcher via this RSS) and this short-form pod is available on Apple, Spotify and everywhere.

ThursdAI - Hey, if you enjoy these, how about subscribing for real? Would love to do this full time! Every paid subscriber is like a dear friend 🧡

TL;DR of all topics covered

* Open Source LLM

* Falcon 180B announced by TIIUAE (Announcement, Demo)

* YaRN scaling paper - scaling LlaMa to 128K context (link)

* OpenHermes-13B from @teknium1 (link)

* Persimmon-8B from Adept.AI (link)

* Starcoder-1B-sft from @abacaj (link)

* Big Co LLMs + API updates

* OpenAI first ever Dev conference (link)

* Claude announces a $20/mo Claude Pro tier (link)

* Modular releases Mojo🔥 with 68,000x improvement over python (Link)

* Vision

* Real time deepfake with FaceFusion (link)

* HeyGen released AI avatars and AI video translation with lipsync (link, translation announcement)

* Voice

* Open ASR (automatic speech recognition) leaderboard from HuggingFace (link)

* Tools

* LangChain Hub (re) launched

* Open Interpreter (Announcement, Github)

Open Source LLM

🦅 Falcon 180B - The largest open source LLM to date (Announcement,

Listen Now