3 ms·
Technically, in Dota you only control 1 unit. That being said, I don't know if OpenAI's algorithm had 5 independent agents controlling 1 unit each, or 1 agent c
by zhobbs 8y ago
Technically, in Dota you only control 1 unit. That being said, I don't know if OpenAI's algorithm had 5 independent agents controlling 1 unit each, or 1 agent controlling 5 units.
- mooneater 8y agoOpenAI Five had a separate agent per unit, no explicit coordination.
- backpropaganda 8y agoThis is incorrect. They shared neural net activations which is explicit communication.
- marviel 8y agoI believe it's five identical agents: https://blog.openai.com/openai-five/ https://blog.openai.com/openai-five/ But because the agents were all trained together, they kind of operate as a unit. Coordination OpenAI Five does not contain an explicit communication channel between the heroes’ neural networks. Teamwork is controlled by a hyperparameter we dubbed “team spirit”. Team spirit ranges from 0 to 1, putting a weight on how much each of OpenAI Five’s heroes should care about its individual reward function versus the average of the team’s reward functions. We anneal its value from 0 to 1 over training.
- vvillena 8y agoIt would be fun to see the AI players spamming the ingame chat to communicate with each other in its own language :)
- jrockway 8y agoA truly superb AI would guilt the support AI into buying wards by constantly whining about it in chat. It would also ping the minimap when one of its teammates makes a mistake. Finally, at the end of the match, it would pronounce "bad team" if it lost. (I never played dota2, that's all I know about the game ;)
- jorgemf 8y agoIn the last model they trained they shared some part of a layer for all the agents. So it was like a one agent trained with shared knowledge of the rest.