3 ms·
"To reproduce the results reported in the paper, you would need an NVIDIA DGX1 machine with 8 V100 GPUs."
by scoutt 8y ago
"To reproduce the results reported in the paper, you would need an NVIDIA DGX1 machine with 8 V100 GPUs."
- AdamDKing 8y agoThat line refers to training the model from scratch. You can still run the trained model very quickly with one "cheap" GPU. That said, I'm not sure why one wouldn't get a similar result training on the EC2 or GCE instances that have 8 V100s. Or even training with fewer GPUs but accumulating gradients to get the same batch size.