5 ms·
They say they used 1024 TPUs for training, maybe TF has better perf on that hardware at this point. EDIT: v2 of the paper says 2048 TPUs.
by bigdict 6y ago
They say they used 1024 TPUs for training, maybe TF has better perf on that hardware at this point.
EDIT:
v2 of the paper says 2048 TPUs.