Episode Details
Back to Episodes
Grounded Research: From Google Brain to MLOps to LLMOps — with Shreya Shankar of UC Berkeley
Description
We are excited to feature our first academic on the pod! I first came across Shreya when her tweetstorm of MLOps principles went viral:
Shreya’s holistic approach to production grade machine learning has taken her from Stanford to Facebook and Google Brain, being the first ML Engineer at Viaduct, and now a PhD in Databases (trust us, its relevant) at UC Berkeley with the new EPIC Data Lab. If you know Berkeley’s history in turning cutting edge research into gamechanging startups, you should be as excited as we are!
Recorded in-person at the beautiful StudioPod studios in San Francisco.
Full transcript is below the fold.
Edit from the future: Shreya obliged us with another round of LLMOps hot takes after the pod!
Other Links
* Shreya’s About: https://www.shreya-shankar.com/about/
* Berkeley Sky Computing Lab - Utility Computing for the Cloud
* Berkeley Epic Data Lab - low-code and no-code interfaces for data work, powered by next-generation predictive programming techniques
* Lightning Round:
* Favorite AI Product: Stability Dreamstudio
* 1 Year Prediction: Data management platforms
* Request for startup: Design system generator
* Takeaway: It’s not a fad!
Timestamps
* [00:00:27] Introducing Shreya (poorly)
* [00:03:38] The 3 V's of ML development
* [00:05:45] Bridging Development and Production
* [00:08:40] Preventing Data Leakage
* [00:10:31] Berkeley's Unique Research Lab Culture
* [00:11:53] From Static to Dynamically Updated Data
* [00:12:55] Models as views on Data
* [00:15:03] Principle: Version everything you do
* [00:16:30] Principle: Always validate your data
* [00:18:33] Heuristics for Model Architecture Selection
* [00:20:36] The LLMOps Stack
* [00:22:50] Shadow Models
* [00:23:53] Keeping Up With Research
* [00:26:10] Grounded Theory Research
* [00:27:59] Google Brain vs Academia
* [00:31:41] Advice for New Grads
* [00:32:59] Helping Minorities in CS
* [00:35:06] Lightning Round
Transcript
[00:00:00] Hey everyone. Welcome to the Latent Space podcast. This is Alessio partner and CTM residence at Decibel Partners. I'm joined by my co-host, swyx writer and editor of Latent Space. Yeah,
[00:00:21] it's awesome to have another awesome guest Shankar. Welcome .
[00:00:25] Thanks for having me. I'm super excited.
[00:00:27] Introducing Shreya (poorly)
[00:00:27] So I'll intro your formal background and then you can fill in the blanks.
[00:00:31] You are a bsms and then PhD at, in, in Computer Science at Stanford. So
[00:00:36] I'm, I'm a PhD at Berkeley. Ah, Berkeley. I'm sorry. Oops. . No, it's okay. Everything's the bay shouldn't say that. Everybody, somebody is gonna get mad, but . Lived here for eight years now. So
[00:00:50] and then intern at, Google Machine learning learning engineer at Viaduct, an OEM manufacturer, uh, or via OEM analytics platform.
[00:00:59] Yes. And now you're an e I R entrepreneur in residence at Amplify.
[00:01:02] I think that's on hold a little