True... well, almost, since data from previous frames becomes stale with time. I agree that learning how to retrieve the info would be another rather tough pro

True... well, almost, since data from previous frames becomes stale with time. I agree that learning how to retrieve the info would be another rather tough problem (on top of all the tough problems the current incarnation of OpenAI's bots already need to solve).