Episode Details
Back to EpisodesVEGA-3D: Teaching multimodal LLMs spatial reasoning through video generation
Published 6 months, 1 week ago
Description
A plug-and-play framework extracts implicit 3D priors from video diffusion models to enhance multimodal LLMs with spatial reasoning capabilities, enabling improved geometric scene understanding and embodied decision-making without explicit 3D supervision.