30 ms·
The paper says they used 8192 TPUv4 chips for training. Interesting another house didn’t use nvidia for their model training.
by ec109685 2y ago
The paper says they used 8192 TPUv4 chips for training. Interesting another house didn’t use nvidia for their model training.