Research
RoboColosseum distributed benchmark tests VLA robot policies and frontier agents across four embodiments
Across 5,699 pairwise trials at 124 sites, frontier agents rival specialized VLA policies, but all systems struggle with open-world tasks. After fine-tuning, GR00T N1.7 leads on SO-101 and pi0.5 leads on Franka and Bimanual-YAM.
Every outlet that ran it 1 article
Hugging Face PapersResearchLead
RoboColosseum: Evaluating Physical Intelligence at Scale In-The-Wild