Capturing data…
Capturing data…
TUE, 27 OCT · 97 ITEMS
"WorldMirror: agentic real-to-sim generation of interactive worlds from in-the-wild robot demos" — arXiv cs.RO · AI & Technology
WorldMirror is a robotic simulation pipeline that takes real-world demonstration videos of robots interacting with objects and automatically builds interactive simulated worlds from them. It uses an "" workflow—an AI agent that plans and executes the multi-step conversion (scene understanding, asset creation, physics setup, and so on)—so the resulting simulation behaves realistically enough to train robot policies. The goal is to get the scalability and safe trial-and-error of simulation while leveraging the diversity of in-the-wild demonstrations.
The claim is the authors' own description of their method on the arXiv preprint (cs.RO, arXiv:2610.31834), and the reporting sits directly on that primary source with no secondary distortion. As a preprint, it is not peer-reviewed, so the contribution is self-reported by the authors.
Genuinely new: the preprint was published on arXiv on 2026-10-26.
We covered RoboSnap in July 2026, which also addressed generation for robot learning, though in a one-shot scene-generation setting rather than through an agentic, interactive-world-building pipeline.