4 ms·
I'm in the middle point of a similar journey. I got a 5700xt for a steal, and ran GPT2 on it to see if I could. It worked, but just barely. It now currently dr
by buffet_overflow 4y ago
I'm in the middle point of a similar journey. I got a 5700xt for a steal, and ran GPT2 on it to see if I could. It worked, but just barely.
It now currently drives my primary monitors, and I keep a second GPU, a 1080ti, plugged in and passed through to a VM. I can then operate the 1080ti as a "program" from my desktop, which is fun, but somewhat limited given the space constraints in my case. Extra benefit is it can also be used for gaming. Next steps might be to toss 3090s in a dedicated chassis under Proxmox, but then I lose the part time gaming use case.
The path to >40GB VRAM as a hobbyist is tricky, but I have to remind myself that even having it as an option is wild.
What are you doing with your 3090s?