Research
Hugging Face Papers lists VPM, a multi-view world model that forecasts videos and 3D point trajectories
Video-Point Model conditions on multi-view video and a language instruction to forecast future videos from any viewpoint and 3D point trajectories. It also adds robot actions as a token modality, with reported gains in video fidelity, 3D motion accuracy and manipulation success over a video-only co…