3 ms·
I don't believe it is using computer vision to read the pixels and translate that into data, no. It will still get the information about what's on its screen f
by cjf101 7y ago
I don't believe it is using computer vision to read the pixels and translate that into data, no. It will still get the information about what's on its screen from the API.
So presumably it will get the same info you or I could get from the minimap (presence of units in a particular area but no details as to what) + detailed information about anything in its camera-like view. This will have some effect on how the bot manages its APM budget, since it now needs to consider camera management.
But honestly, from the perspective of the Alpha research, getting information from the pixels probably isn't an interesting problem. They can pretty safely assume that they could build a Computer Vision setup that could get the same info that the API gives, given enough time + GPU horsepower.
Any possible inaccuracy/delay that might result from using Computer Vision instead of the API can be simulated. You could add a response delay (already in AlphaStar), or a random chance that the API delivers incorrect information from time to time (which I don't think they do).