3 ms·
The most expensive part of training AlphaZero is creating the training dataset by self-playing tens of millions of games.
by pacala 8y ago
The most expensive part of training AlphaZero is creating the training dataset by self-playing tens of millions of games.
- chewxy 8y agoFirst game is cheap :P Subsequent games are expensive because scaling becomes an issue
- mcphage 8y agoAh! Okay, that's what I think I misunderstood. The 4 TPU + 44 GPU configuration was only for running AlphaZero against Stockfish, not for training it. Phew! That seemed unbelievable, I was hoping someone would see what I was missing. And the 9 hours was for training, but I don't think the article linked says on what.