5 ms·
ROCm is making great progress but I’ve had enough hiccups (desktop with RX9070XT) that I’d still recommend those looking for AI capability to continue using an
by dangus 1y ago
ROCm is making great progress but I’ve had enough hiccups (desktop with RX9070XT) that I’d still recommend those looking for AI capability to continue using an Nvidia or Apple solution for the time being.
Still, I think it’ll be quite equivalent soon.
I think one of the best AI systems in terms of price/performance is still just to build a desktop with dual RTX 3090’s (of course you’ll need an board that supports dual cards) and toss it in a closet.
- Tuna-Fish 1y agoIt depends on what you are doing. A lot of people who want to do local inference want to do it using much larger models than what can be fit onto a RTX3090, and Strix Halo is such a hit because it gives you reasonable (not great, but good enough to not be outright painful) performance with 128GB of memory.
- geerlingguy 1y agoAlso, Vulkan is great, and much more stable. Plus tends to work great for new, and even very old, graphics cards.
- deleted 1y ago[deleted]
- dismalaf 1y agoAt this point Vulkan will just take over. AMD and Intel are fumbling ROCm and SYCL, whereas Vulkan already ships nearly everywhere.
- almostgotcaught 1y ago> ROCm is making great progress is the progress in the room with us?
- wmf 1y agoYes? For example, ROCm on MI355X is working fine a month after release; it didn't take a year.