4 ms·
If raw power per dollar would be all that's interesting we'd all run 7900 XTX clusters like geohot in his tinybox. We are not, because there's clearly value in
by KeplerBoy 3y ago
If raw power per dollar would be all that's interesting we'd all run 7900 XTX clusters like geohot in his tinybox.
We are not, because there's clearly value in the CUDA ecosystem.
- latchkey 3y agoThere certainly is a lot of value in the CUDA ecosystem, today. The problem is that when all the big companies are buying up hundreds of thousands of GPUs, that doesn't leave much for anyone else. Sane business people will look to decentralize their compute over time and not be reliant on a single provider. AMD will be able to take advantage of that and they've already stated that is their focus going forward. ROCm/HIP are getting incrementally better, MI300x have 192GB and benchmarks are looking good, the only problem is that nobody has access to the higher end hardware from AMD today. That's why I'll have MI300x, for rent, soon.
- KeplerBoy 3y agoThat's a big issue in AMD land imho. Everyone can pickup a 200$ GPU (talking about the RTX 3050) which will behave like a scaled down A100 and get started playing around with CUDA. You can't really do that with AMD GPUs, their cheapest officially supported GPU is the 7900 XTX and that has a different architecture than the data center ones.
- latchkey 3y agoI agree. Maybe one idea would be to also make 7900 XTX's for rent (cheaply) too.