3 ms·

Exactly. I wish I could consider a 7900 XTX or two for "enthusiast" level ML work at home (thinking open sourced GPT models, Stable Diffusion, etc), but the sta

Exactly. I wish I could consider a 7900 XTX or two for "enthusiast" level ML work at home (thinking open sourced GPT models, Stable Diffusion, etc), but the state of library support has me pricing out 3090s instead. Sure, I could probably get ROCm going after a lot of tinkering and headaches but...that's not where I want to spend that effort. Would happily be proven wrong on this by the way.

dotnet00 4y ago
Yeah, I faced the same conundrum back in the Radeon VII/5700XT days. I had gone with a Radeon VII and a 5700XT, believing AMD to eventually support the latter in ML. Using the Radeon VII for ML was still pain, but I had more free time back then and was willing to tolerate the tinkering. The support for the 5700XT never came, was just constantly led on by AMD devs on their GitHub. I didn't really have that kind of free time when I wanted to upgrade, so buying 3090s ended up being the only realistic option. Even on Linux, as long as I'm not trying to stick to the latest bleeding edge kernel, the closed source drivers work very well. Thus far I feel the 3090s have been well worth the extra cost simply in terms of tinkering time saved.
- buffet_overflow 4y ago
  I'm in the middle point of a similar journey. I got a 5700xt for a steal, and ran GPT2 on it to see if I could. It worked, but just barely. It now currently drives my primary monitors, and I keep a second GPU, a 1080ti, plugged in and passed through to a VM. I can then operate the 1080ti as a "program" from my desktop, which is fun, but somewhat limited given the space constraints in my case. Extra benefit is it can also be used for gaming. Next steps might be to toss 3090s in a dedicated chassis under Proxmox, but then I lose the part time gaming use case. The path to >40GB VRAM as a hobbyist is tricky, but I have to remind myself that even having it as an option is wild. What are you doing with your 3090s?

dotnet00 4y ago

Yeah, I faced the same conundrum back in the Radeon VII/5700XT days. I had gone with a Radeon VII and a 5700XT, believing AMD to eventually support the latter in ML. Using the Radeon VII for ML was still pain, but I had more free time back then and was willing to tolerate the tinkering. The support for the 5700XT never came, was just constantly led on by AMD devs on their GitHub. I didn't really have that kind of free time when I wanted to upgrade, so buying 3090s ended up being the only realistic option. Even on Linux, as long as I'm not trying to stick to the latest bleeding edge kernel, the closed source drivers work very well. Thus far I feel the 3090s have been well worth the extra cost simply in terms of tinkering time saved.

buffet_overflow 4y ago
I'm in the middle point of a similar journey. I got a 5700xt for a steal, and ran GPT2 on it to see if I could. It worked, but just barely. It now currently drives my primary monitors, and I keep a second GPU, a 1080ti, plugged in and passed through to a VM. I can then operate the 1080ti as a "program" from my desktop, which is fun, but somewhat limited given the space constraints in my case. Extra benefit is it can also be used for gaming. Next steps might be to toss 3090s in a dedicated chassis under Proxmox, but then I lose the part time gaming use case. The path to >40GB VRAM as a hobbyist is tricky, but I have to remind myself that even having it as an option is wild. What are you doing with your 3090s?