3 ms·
> It's just telling that the bots have only learned one single strategy, don't even execute that very well, and still have to play with hero restrictions that r
by mywittyname 8y ago
> It's just telling that the bots have only learned one single strategy, don't even execute that very well, and still have to play with hero restrictions that rule out counters to that specific strategy of aggressive skirmishing and pushing.
I suspect this has to with the fact that the bots were designed to be agents with no leadership. As you say, the bots performed very well in skirmishes, they lost because they didn't really know what to do beyond that.
They might fare better if one of the bots could act as a team captain and provide high level instructions to the team, i.e., assign people to harvest, defend, or push.
It seems like that's what the human teams have over the bots -- somebody telling the individual team members what to do.
- DuskStar 8y agoThe bots might be running 5 instances of the software without communication, but they all have the same vision. It's probably better to think of it as one instance controlling 5 bots, since each instance can predict the others perfectly.
- kenhwang 8y agoI think they should be training 5 different bots for the 1-5 positions because their priorities and roles are quite different. It seemed like all 5 bots had the same, "kill enemy, hit building" strategy, which is locally optimal, but globally harmful (sort of a tragedy of the commons scenario).
- Notorious_BLT 8y agoGenerally, captains in Dota teams don't give specific instructions on what to do when not making specific plays. Carry players will default to returning to farming as efficiently as possible given the current state of the map. Support players will default to placing wards for map vision, stacking camps for the carry to farm, and searching for potential kills. But there definitely is a need for a shot-caller, and OpenAI has no idea how to play that role. OpenAI 5 had a number of glaring flaws in what it learned. It seemed to have never come to the conclusion that certain characters would have better outcomes if they focused on certain activities. Every character farmed, any character would grab the Aegis (reward item) after killing Roshan (usually this is reserved for a character likely to be in the middle of the fray, dealing a lot of damage). Another problem was that, until the last few weeks before its matches against pro players, they had allowed both teams to have 5 couriers. This allowed OpenAI 5 to keep up relentless pressure by constantly bringing themselves consumable health regeneration items. This was so unlike a regular game of Dota that the community (including their opponents) complained because normally the courier's time is a valuable resource, and the courier can normally be killed if it is used too close to enemies. With an endless supply of healing items with no risk involved, it didn't even resemble a game of Dota. They did away with this for TI, and it revealed a serious weakness in their relentless-aggression strategy. I get the impression most of OpenAI's games vs itself ended very quickly, with one team making a mistake during the relentless-aggression early game pushes. As a result, it seemed to have no idea what to do differently as the game went on.
- ctchocula 8y agoThis makes sense. They should add a NN feature called farm priority ranked from 1 to 5 (similar to the one humans use) with 1 being carry, 5 being support, and each taking progressively less farm and lower priority taking Aegis. They could start out with this feature randomized at first, and see whether the same heroes humans prioritize farm on get prioritized by the AI.
- dropit_sphere 8y ago>Every character farmed, I'll own up to wanting to chalk this up to "AI wisdom." The feed-the-carry strategy has always seemed like precisely the same kind of premature optimization that makes AI often easy to beat.