3 ms·

Good article! > First, OpenAI could have created a vision system to read the pixels and retrieve the same information that the bot API provides. (The main reas

Good article! > First, OpenAI could have created a vision system to read the pixels and retrieve the same information that the bot API provides. (The main reason it didn’t is that it would have been incredibly resource-intensive.) Mmmm, no. Reading the pixels would not retrieve the same information that the bot API provides, because the screen does not contain all that information at any given time. Any Dota 2 player will know that they don't have access to all this data simultaneously: https://s3-us-west-2.amazonaws.com/openai-assets/dota_benchmark_results/network_diagram_08_06_2018.pdf https://s3-us-west-2.amazonaws.com/openai-assets/dota_benchm...

tlb 8y ago
It would have to remember the data that is off-screen. It's quite possible to train a recurrent network to do this. Some Atari games require this to play well, like Pacman requires remembering where the ghosts are when they're blinking. More complicated is the logic to know what to look at when, by keeping track of which parts of the state might be important and out of date, and controlling the viewpoint to update it. I haven't seen a good example of this.
- FartyMcFarter 8y ago
  True... well, almost, since data from previous frames becomes stale with time. I agree that learning how to retrieve the info would be another rather tough problem (on top of all the tough problems the current incarnation of OpenAI's bots already need to solve).
SolarNet 8y ago
Yes, but then after reading data, they could train a system to remember the information, and decide which information to look at next, and predict their values over time from what inputs it gets, like humans do.
empath75 8y ago
I think the reason they didn't do it is that image recognition is a different and less interesting problem than the one they're trying to solve.
- FartyMcFarter 8y ago
  It's not just image recognition though. Gathering relevant information requires making non-trivial decisions about what units to click and how to move the camera around in an useful way. Those are definitely interesting problems.

tlb 8y ago

It would have to remember the data that is off-screen. It's quite possible to train a recurrent network to do this. Some Atari games require this to play well, like Pacman requires remembering where the ghosts are when they're blinking. More complicated is the logic to know what to look at when, by keeping track of which parts of the state might be important and out of date, and controlling the viewpoint to update it. I haven't seen a good example of this.

FartyMcFarter 8y ago
True... well, almost, since data from previous frames becomes stale with time. I agree that learning how to retrieve the info would be another rather tough problem (on top of all the tough problems the current incarnation of OpenAI's bots already need to solve).

SolarNet 8y ago

Yes, but then after reading data, they could train a system to remember the information, and decide which information to look at next, and predict their values over time from what inputs it gets, like humans do.

empath75 8y ago

I think the reason they didn't do it is that image recognition is a different and less interesting problem than the one they're trying to solve.

FartyMcFarter 8y ago
It's not just image recognition though. Gathering relevant information requires making non-trivial decisions about what units to click and how to move the camera around in an useful way. Those are definitely interesting problems.