MolmoBot: Training robot manipulation entirely in simulation (opens in a new tab)
Read for a concrete alternative to collecting robot demonstrations: procedural environments, randomized cameras and dynamics, and several policy architectures trained on shared synthetic trajectories.
In brief: MolmoBot: Training robot manipulation entirely in simulation
Ai2 investigates whether sufficiently varied simulated demonstrations can support manipulation on real robots without real-world policy fine-tuning. Its pipeline combines MuJoCo, procedural environments, and randomization of objects, cameras, lighting, and dynamics; several behavior-cloning architectures share the resulting training data. Examples include Franka pick-and-place and RB-Y1 door or drawer manipulation. The article describes real-world comparisons and releases training data, generation tools, and evaluation code. The scope matters: these are manipulation experiments on two platforms, with navigation explicitly excluded. Testing other skills and embodiments remains necessary.