>> What could be the main cause for things being so hard to cross over from simulation to reality? Resolution. Simulations are too low-resolution and the curre

>> What could be the main cause for things being so hard to cross over from simulation to reality? Resolution. Simulations are too low-resolution and the current dominant approach to learning behaviour (Reinforcement Learning) is too high-resolution (more precisely, too high-variance). So the simulations don't represent reality accurately enough and the learned policies overfit to the simulations' inaccuracies. Learning from pixels sounds like a great idea until you realise the physical world is not quite made of pixels.