5 ms·
> AMD GPUs using ROCm Oh great. The AMD RX 580 was released in April 2018. AMD had already dropped ROCm support for it by 2021. They only supported the card fo
by superkuh 3y ago
> AMD GPUs using ROCm
Oh great. The AMD RX 580 was released in April 2018. AMD had already dropped ROCm support for it by 2021. They only supported the card for 3 years. 3 years. It's so lame it's bordering on fraudulent, even if not legally fraud. Keep this in mind when reading this news. The support won't last long, especially if you don't buy at launch. Then you'll be stuck in the dependency hell that is trying to use old drivers/stack.
- crowwork 3y agoThere is also vulkan support which should be more universal(also included in the post), for example, the post also shows running LLM on a steamdeck APU.
- junrushao1994 3y agotbh im not sure what amds plan is on ROCm support on consumer devices, but i dont really think amd is being fraudulent or something. Both rocm and vulkan are supported in MLC LLM as mentioned in our blog post. we are aware that rocm is not sufficient to cover consumer hardwares, and in this case vulkan is a nice backup!
- zorgmonkey 3y agoHow does the performance with Vulkan compare to the ROCm performance on the same hardware?
- junrushao1994 3y agoWe haven't done any comparison them yet, but generally we believe Vulkan as a more generic cross-vendor API should be slower than ROCm. Same for CUDA vs Vulkan.
- ttctciyf 3y agoIf you click the "Radeon" tab here[1], dated 27 Jul, AMD claim ROCm support on a wide range of consumer cards, with HIP SDK support on RX 6800 and up, under Windows. The Linux situation seems less clear. 1: https://rocm.docs.amd.com/en/latest/release/windows_support.html#windows-supported-gpus https://rocm.docs.amd.com/en/latest/release/windows_support....
- imtringued 3y agoGiven AMDs track record. The 6900 will be dropped next year or early 2025.
- latchkey 3y agoYou're not going to find rx580's with enough vram for AI. Typically 4-8gb.
- FirmwareBurner 3y agoROCm is not just for AI.
- latchkey 3y agoI've been waiting for someone to tell me what I can profitably do with the 120,000+ 470/480/580's that I have sitting around doing nothing. It sounds like you have an idea?
- FirmwareBurner 3y agoCrack passwords, also there was this craze a few years ago, where people were using their GPUS to crunch numbers and earn money, I forgot what it was called ... something with mines.
- latchkey 3y agoRight... any legal ideas you have?
- FirmwareBurner 3y agoCracking passwords is legal if you obtained the hashes legally as part of your pentest conttract. So is shitcoin mining. But you seem dead set that there are no uses for ROCm so I'll leave you there.
- latchkey 3y agoIf the best you can do is 'password cracking' as your answer, you're obviously not very well versed in things. Plus, you don't need ROCm to crack passwords.
- greenknight 3y ago> AMD RX 580 was released in April 2018 It was actually Apr 18, 2017 -- https://en.wikipedia.org/wiki/Radeon_500_series https://en.wikipedia.org/wiki/Radeon_500_series
- elabajaba 3y agoAnd the 580 was just a rebranded 480, which was released in June 2016.
- ktta 3y agoThis just makes the case for supporting it even further, because then they'd be supporting multiple years worth of hardware with just the effort for one uarch
- imtringued 3y agoNothing like having a lottery of 2-6 years of support for your hardware to make your customers confident they are getting value out of the products they are buying. The manufacturer can smugly proclaim they offered six years of support for a product that was on the shelf four years into the driver's lifecycle.
- latchkey 3y agoSpeaking from having run tens of thousands of both 580 and 480, they weren't just rebranded. Maybe on paper they seemed similar, but they didn't run similar.
- pantalaimon 3y agoRustiCL to the rescue! Supposedly it's already faster than ROCm