The GTA V dataset doesn't really have enough modes of variation, in my opinion. To my knowledge, the best public attempt at this is represented by the OpenAI R

The GTA V dataset doesn't really have enough modes of variation, in my opinion. To my knowledge, the best public attempt at this is represented by the OpenAI Rubik's Cube / Shadow Robotics dexterous hand demo. https://openai.com/blog/solving-rubiks-cube/ https://openai.com/blog/solving-rubiks-cube/ https://arxiv.org/abs/1910.07113 https://arxiv.org/abs/1910.07113 NVIDIA are also doing some interesting work in this area, but again, I'm not really sure they put enough different modes of variation into it. https://research.nvidia.com/publication/2018-04_Training-Deep-Networks https://research.nvidia.com/publication/2018-04_Training-Dee.... CVEDIA also get really impressive results using similar techniques:- https://www.cvedia.com/ https://www.cvedia.com/