Episode Details

Abstract Embodied agents must continuously adapt to the physical world using interaction data collected across varying timescales, controllers, and environmental conditions. However, standard reinforcement learning assumes stationary dynamics and on-policy data collection, which breaks down when agents must learn from heterogeneous data sources with non-stationary dynamics and off-policy behavior. In this episode of Embodied AI 101, we explore "Replay Is Not Reality: Embodied RL When Both Policy and Physics Shift". We break down the research, methodology, and real-world implications for robotics, AI, and physical intelligence. Embodied AI 101 covers the latest research at the intersection of AI and physical intelligence — robotics, manipulation, world models, and the path from digital intelligence to embodied agents.