They don't use the video data in the simulations, they use the processed "Where everything is" stream. That makes it more robust to sensor tech upgrades, but le

They don't use the video data in the simulations, they use the processed "Where everything is" stream. That makes it more robust to sensor tech upgrades, but less to errors to do with bad sensing or sensor failure. Computationally cheaper and simpler, no doubt, too.