Episode Details
Back to EpisodesDoes VLA Even Know the Basics? Act2Answer Benchmark
Published 3 months ago
Description
Introduces a benchmark showing VLAs lose 20–40 points in commonsense/world knowledge versus source VLMs after robotics fine-tuning, evaluated via action-based answering.