4 ms·
You're not going to find rx580's with enough vram for AI. Typically 4-8gb.
by latchkey 3y ago
You're not going to find rx580's with enough vram for AI. Typically 4-8gb.
- FirmwareBurner 3y agoROCm is not just for AI.
- latchkey 3y agoI've been waiting for someone to tell me what I can profitably do with the 120,000+ 470/480/580's that I have sitting around doing nothing. It sounds like you have an idea?
- FirmwareBurner 3y agoCrack passwords, also there was this craze a few years ago, where people were using their GPUS to crunch numbers and earn money, I forgot what it was called ... something with mines.
- latchkey 3y agoRight... any legal ideas you have?
- FirmwareBurner 3y agoCracking passwords is legal if you obtained the hashes legally as part of your pentest conttract. So is shitcoin mining. But you seem dead set that there are no uses for ROCm so I'll leave you there.
- latchkey 3y agoIf the best you can do is 'password cracking' as your answer, you're obviously not very well versed in things. Plus, you don't need ROCm to crack passwords.
- quickthrower2 3y agoGood luck trying to make enough money to pay for power let alone capex
- rizky05 3y ago[dead]
- Arelius 3y agoI mean, I'm using ROCm for VFX rendering. But regardless i'm not sure that cards as old as your 470's can really be super competitive power usage wise to make them very profitable.
- latchkey 3y agoCorrect, not profitable.
- Arelius 3y agoBut just because you have old GPUs, doesn't imply there is a problem with ROCm. You'd have the same problem of economics with old Nvidia GPUs.
- latchkey 3y agoROCm doesn't support old GPUs. That said, people are finding hacks... https://old.reddit.com/r/Amd/comments/15t0lsm/i_turned_a_95_amd_apu_into_a_16gb_vram_gpu_and_it/ https://old.reddit.com/r/Amd/comments/15t0lsm/i_turned_a_95_...
- jrflowers 3y agoYou could sell them or give them away to hobbyists, but that could eat into the lucrative “shoehorning old crypto mining into unrelated conversations” business
- FirmwareBurner 3y agoI was talking about hobbyists. Who said anything about businesses? CUDA also works on consumer NVidia cards, not just business ones.
- jrflowers 3y agoI did not know that you meant “hobby profitable” (more brain cells, bigger Ideas) not “business profitable” (money) when you asked people how to use your old mining hardware profitably.
- superkuh 3y agoI am currently using my RX 580 8GB for running large language models on my home computer using llama.cpp opencl (clBLAST) offloading of layers. I can fit up to 13 billion parameter llamas (1 or 2) if they're quantized at 4 bits. It's not super fast but at least my AI IRC bots aren't eating into my CPU time anymore. But my attempts to get direct ROCm support were thwarted by AMD.
- latchkey 3y agoGreat for home use, zero commercial value. Can't expect AMD to invest time/money into ROCm for that.
- superkuh 3y agoYou can say the same thing about a 24GB consumer card. Going from being able to run 13B llamas to 33B doesn't really help you in a commercial sense. This holds true, generally, for other LLM foundational models as well. To do commercial work you're going to need more RAM than consumer cards have. You need at least two if you're going to run the 70B and even then the 70B (and similar) aren't useful commercially. Except in the gathering money from investors who don't know better sense.
- latchkey 3y agoNo one is arguing any of that. You're the one that brought up the 580 specifically. By the way, still waiting for you to take me up on your 'bet'.
- superkuh 3y agoI was wrong. Sorry. Food trucks do accept cash most places. Now it's your turn Mr. "You're not going to find rx580's with enough vram for AI. Typically 4-8gb." This is completely false. Rather than acknowledging that you then tried to move the goalposts (much like I did in that past thread saying, "Oh, but maybe it's just my region where they don't.") It looks like we both behave a bit silly when trying to save face when we're wrong.
- imtringued 3y agoYou're not going to find a customer for high end cards, when his entry level experience is this poor. I ran stable diffusion on my CPU instead, even if it took ten minutes per picture.