Research
Study finds closed-weight VLM agents lead open-weight models on robot generalist tasks
Embodied Agent Arena tests ten VLM agents across five domains using 1,000 cases, including GeoProbe, a 168-case benchmark for camera, motion, depth and scale estimation. Open-weight models trail on planning and manipulation despite useful spatial reasoning.
Every outlet that ran it 1 article
Hugging Face PapersResearchLead