2 ms·
> didn't need H100s I think we're splitting hairs here, it was more about choosing a good combination of least effort, time and money involved. When you're spe
by ranger_danger 2y ago
> didn't need H100s
I think we're splitting hairs here, it was more about choosing a good combination of least effort, time and money involved. When you're spending that amount of money, things are not so black and white... rented H100s get the job done faster and easier than whatever we can piece together ourselves. L40 (cheaper but no FP64) was also brand new at the time. Also our code was custom OpenCL and could have taken advantage of FP64 to go faster if we had the devices for it.