3 ms·

Didn't the Zero version from Google train on something like 10 TPU's? Or is it only inference? Seems just the CPU or even GPU aren't really suited for this kin

Didn't the Zero version from Google train on something like 10 TPU's? Or is it only inference? Seems just the CPU or even GPU aren't really suited for this kind of task

rockdoe 9y ago
"Train" as in do the gradient computation: 64 GPU. Generate the data to do that in the first place: 2000 TPU, each about 45 TFLOPS (or 2-4 x a GTX 1080 Ti).
NhanH 9y ago
AlphaGo Zero trained on 2000 TPUs