4 ms·
There's a second blog post here with substantially more technical detail: https://developer.nvidia.com/blog/breaking-mlperf-training-records-with-nvidia-h100-gp
by ollin 3y ago
There's a second blog post here with substantially more technical detail: https://developer.nvidia.com/blog/breaking-mlperf-training-records-with-nvidia-h100-gpus/ https://developer.nvidia.com/blog/breaking-mlperf-training-r...
Additionally, code for the actual submission is available here https://github.com/mlcommons/training_results_v3.0/tree/main/NVIDIA_CoreWeave/benchmarks/gpt3/implementations/pytorch https://github.com/mlcommons/training_results_v3.0/tree/main...