3 ms·
You can run inference on AMD cards, ROCm[1] is a thing. I am running inference on amd cards locally.Plus the highest performing cards for computational workload
by throwawayffffas 1y ago
You can run inference on AMD cards, ROCm[1] is a thing. I am running inference on amd cards locally.Plus the highest performing cards for computational workloads are AMD's[2] of course you can't buy these on amazon.
1. https://rocm.docs.amd.com/en/latest/index.html https://rocm.docs.amd.com/en/latest/index.html
2. https://www.amd.com/en/products/accelerators/instinct/mi300.html#tabs-b9862a3bb5-item-58ebcbef73-tab https://www.amd.com/en/products/accelerators/instinct/mi300....