Podcast Episode Details

Back to Podcast Episodes
Al Engineering 101 with Chip Huyen (Nvidia, Stanford, Netflix)

Al Engineering 101 with Chip Huyen (Nvidia, Stanford, Netflix)



Chip Huyen is a core developer on Nvidia’s Nemo platform, a former AI researcher at Netflix, and taught machine learning at Stanford. She’s a two-time founder and the author of two widely read books on AI, including AI Engineering, which has been the most-read book on the O’Reilly platform since its launch. Unlike many AI commentators, Chip has built multiple successful AI products and platforms and works directly with enterprises on their AI strategies, giving her unique visibility into what’s actually happening inside companies building AI products.

We discuss:

1. What people think makes AI apps better vs. what actually makes AI apps better

2. What pre-training vs. post-training is, and why fine-tuning should be your last resort

3. How RLHF (reinforcement learning from human feedback) actually works

4. Why data quality matters more than which vector database you choose

5. Why high performers are seeing the most gains from AI coding tools

6. Why most AI problems are actually UX issues

Brought to you by:

Dscout—The UX platform to capture insights at every stage: from ideation to production: https://www.dscout.com/

Justworks—The all-in-one HR solution for managing your small business with confidence: https://ad.doubleclick.net/ddm/trackclk/N9515.5688857LENNYSPODCAST/B33689522.423713855;dc_trk_aid=616485030;dc_trk_cid=237010502;dc_lat=;dc_rdid=;tag_for_child_directed_treatment=;tfua=;gdpr=$

Persona—A global leader in digital identity verification: https://withpersona.com/lenny

Where to find Chip Huyen:

• X: https://x.com/chipro

• LinkedIn: https://www.linkedin.com/in/chiphuyen/

• Website: https://huyenchip.com/

• Substack: https://substack.com/@chiphuyen

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• X: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

In this episode, we cover:

(00:00) Introduction to Chip Huyen

(04:28) Chip’s viral LinkedIn post

(07:05) Understanding AI training: pre-training vs. post-training

(08:50) Language modeling explained

(13:55) The importance of post-training

(15:20) Reinforcement learning and human feedback

(22:23) The importance of evals in AI development

(31:55) Retrieval augmented generation (RAG) explained

(38:50) Challenges in AI tool adoption

(43:19) Challenges in measuring productivity

(45:20) The three-bucket test

(49:10) The future of engineering roles

(55:31) ML Engineers vs. AI engineers

(57:12) Lo


Published on 1 week, 4 days ago






If you like Podbriefly.com, please consider donating to support the ongoing development.

Donate