Matching stories Newest first
Hugging Face paper presents EgoXperience for world-grounded egocentric reconstruction
The paper introduces EgoX-Data-6M, a 50-hour dataset, and EgoX, a model that jointly reconstructs camera, scene, hands and objects from monocular video in one forward pass. 6% lower hand error against the strongest evaluated baselines.
InfiniDream proposes open-ended procedural generation of photorealistic 3D worlds
The framework pairs a VLM with existing procedural algorithms to create new photorealistic asset types and build large 3D scenes from text. Evaluations cover 100 object and 20 scene generation tasks, with gains on four perceptual metrics.
Hugging Face paper proposes collective experience learning for fleets of robots
FERT and FATS let deployed robots share execution experience to improve a common policy without extra expert corrections. 3%.
Meta publishes ScaleNav, a video-pretrained model for language-guided robot navigation
ScaleNav learns navigation dynamics from internet egocentric videos, then uses simulated action data for training. 9% on HabitatGS-LN, and runs on a real quadruped robot.