3 ms·
And it highlights a problem with using a game like StarCraft to measure AI - there isn't overwhelming evidence that the humans are winning by being better decis
by roenxi 7y ago
And it highlights a problem with using a game like StarCraft to measure AI - there isn't overwhelming evidence that the humans are winning by being better decision makers. If DeepMind wants a computer to win at StarCraft they can trivially make a computer win at StarCraft. The research seems to be in 'how do we handicap an AI so that it doesn't win easily by leveraging its more reliable sensors' and they are adding handicaps in a semi-random manner. That is nearly pointless; they need a different deterministic game where hidden information plays a bigger role and fast reaction times don't matter.
Ignoring APM - what if it turns out that the better of two players isn't the one who makes better strategic decisions, but the one who can issue more effective tactical commands in a short burst? We can't measure that as it isn't APM but it is likely to be a huge factor. StarCraft AI have historically been handicapped by being unable to model tight tactical situations - if machine learning can come up with any model at all that works (and we now know it can) computers are simply so much better at making quick decisions that there is little left to see that is interesting. There isn't much left to prove.
- agent008t 7y agoGTA5 could be a more interesting benchmark. Leave a few whole missions out for the test set, and then see if the bot can beat those missions on the first go.