3 ms·
Isn't this trained via playing against itself? I don't think there's a dataset involved.
by xrisk 7y ago
Isn't this trained via playing against itself? I don't think there's a dataset involved.
- 0-_-0 7y agoRight, so you would stage a war in a far away desert between 2 AI armies to train a neural network. For science. I'm calling dibs on the movie script!
- glckr 7y agoYes, but Starcraft II is the perfect Starcraft II simulator to play against itself in. I don't think we have one of those for war.
- Voloskaya 7y agoAlphaStar is first trained in a supervised way using the publicly available replays from SCII matches. Even if you just consider self-play, I don't see how you would create a simulation that is realistic enough so that you could generalize afterwards to reality. RL today has an extremely hard time dealing with different distributions. You can see the amount of work OpenAI [1] had to do to go from a virtual hand+rubik's cube to real ones, even though you can make a very accurate simulation much more easily. [1] https://openai.com/blog/solving-rubiks-cube/ https://openai.com/blog/solving-rubiks-cube/
- xrisk 7y agoAh, ok. I've read about OpenAI Five (it plays Dota 2); and as far as I understand it's fully trained with self-play.