5 ms·
>OpenAI Five does not contain an explicit communication channel between the heroes’ neural networks. Teamwork is controlled by a hyperparameter we dubbed “team
by bobcostas55 8y ago
>OpenAI Five does not contain an explicit communication channel between the heroes’ neural networks. Teamwork is controlled by a hyperparameter we dubbed “team spirit”. Team spirit ranges from 0 to 1, putting a weight on how much each of OpenAI Five’s heroes should care about its individual reward function versus the average of the team’s reward functions. We anneal its value from 0 to 1 over training.
A bit disappointing, it would be very cool to see what kind of communication they'd develop.
- personjerry 8y agoHow would you build that?
- avcdsuia 8y agoyeah, putting a LSTM hidden state into communication channel seems to be the most expressive way to build up team work.
- lanternfish 8y agoThey each have their teammates perspecties in their observations, so they are communicating in the sense that they all have the same data, so they can predict what their teammates will do without them actually talking.
- kamac 8y agoWould be interesting to see if when one agent declines to help another several times, the other one would decide against helping him when he calls. The logical explanation would then be that the agent would come to value his life more than his comrade's (because he is helping, and his comrade has refused several times). The human explanation would be that he refuses to help out of spite. It could even lead to those two agents "hating" the other, though it would be more like cold calculation.
- deleted 8y ago[deleted]