Generating 3D Worlds with AI

Episode 78

Creating 3D assets can be daunting, but does it have to be? Mahima and Rakesh are on a quest to democratize 3D content creation with AssetGen, a foundation model for 3D. They discuss the challenges of training such a model given the scarcity of available data and how large language models have unlocked key solutions. As if that weren't enough, they're also tackling the ambitious goal of generating entire worlds from a simple prompt. Tune in to learn more!

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host Pascal (https://mastodon.social/@passy, https://threads.net/@passy_, @passy.bsky.social). Fancy working with us? Check out https://www.metacareers.com/.

Links

Horizon Worlds Desktop Editor: https://developers.meta.com/horizon-worlds/advanced-tools
Horizon Worlds Studio: https://developers.meta.com/horizon-worlds/studio/application
Meta Ray-Ban Display: https://www.meta.com/gb/ai-glasses/meta-ray-ban-display/
MTP 77 - How to build a human-computer interface for everyone: https://engineering.fb.com/2025/08/04/virtual-reality/building-a-human-computer-interface-for-everyone-meta-tech-podcast/

Timestamps

Intro 0:06
Introduction Mahima 1:39
Introduction Rakesh 2:57
Team mission 3:26
Why is 3D content hard to create? 5:15
The Metaverse 7:49
Tooling vision in Horizon Worlds 10:31
AssetGen Architecture 15:27
Consolidating models 18:25
From assets to worlds 19:22
Time to generate 24:46
Feedback loop 26:41
What's the market for AssetGen 29:49
What's available today? 31:26
What's next? 32:11
Outro 35:24

Published on 10 hours ago

Podcast Episode Details

Generating 3D Worlds with AI