3 ms·
Should specify Nvidia GPU. AMD is notoriously absent from all this ML progress.
by ChuckNorris89 3y ago
Should specify Nvidia GPU. AMD is notoriously absent from all this ML progress.
- regularfry 3y agoIt is, but pay attention to which GPU. It's a 3060Ti - good, but not exactly top of the line.
- ChuckNorris89 3y agoThat wasn't my point. My point was that many people want to buy or already own AMD GPUs with 8gigs or more and they're basically excluded from playing with the hip ML stuff unless they jump through insane hoops because all the hip ML stuff is done on Nvidia GPUs.
- regularfry 3y agoIt wasn't your point, but it was mine. In terms of raw power this should be in range of AMD hardware. Needs porting work, yes, but I have a feeling the hoops ought to be less insane than all that. It's not "recompile with a different library", quite, but if you take a look at the sort of portability work going on in (for instance) llama.cpp you can see reasons for optimism.
- giomasce 3y agoIs that because AMD GPUs are technically inferior for ML, or because of tooling is only written for NVIDIA?
- jacquesm 3y agoA bit of both, NV has put a ton of work in their software libraries which makes doing some stuff on NV a viable option, you'd have to do a lot of work to get to an equivalent level on AMD. But if all you need is PyTorch support then AMD may well be a viable option.
- Zetobal 3y agoMaybe AMD should start supporting their older cards in ROCm...
- Trapais 3y agoMaybe they should support their modern consumer cards in ROCm. Maybe their ROCm documentation should not suck balls. I'd say there is a reason AMD is a laughing stock in ML, but it's incorrect. There's not a reason, there are tons of reasons to never touch it.
- inawarminister 3y agoHopefully tinygrad new drivers will fix this. Also a lot of people were porting stable diffusion/Llama to AMD I think