4 ms·
The website has an ".ai" domain. It's about people wanting to run inference, and maybe mine cryptocurrency and for some reason only NVIDIA cards are used for th
by kubb 1y ago
The website has an ".ai" domain. It's about people wanting to run inference, and maybe mine cryptocurrency and for some reason only NVIDIA cards are used for that.
- IshKebab 1y agoSome reason: CUDA
- throwawayffffas 1y agoYou can run inference on AMD cards, ROCm[1] is a thing. I am running inference on amd cards locally.Plus the highest performing cards for computational workloads are AMD's[2] of course you can't buy these on amazon. 1. https://rocm.docs.amd.com/en/latest/index.html https://rocm.docs.amd.com/en/latest/index.html 2. https://www.amd.com/en/products/accelerators/instinct/mi300.html#tabs-b9862a3bb5-item-58ebcbef73-tab https://www.amd.com/en/products/accelerators/instinct/mi300....