4 ms·
A bit off tangent, what would be the best bang for the buck GTX GPU to buy nowadays if I want to use it for machine learning (like running stable diffusion loca
by syntaxing 4y ago
A bit off tangent, what would be the best bang for the buck GTX GPU to buy nowadays if I want to use it for machine learning (like running stable diffusion locally)?
- switchers 4y ago12gb 3060 if you can find one. That extra memory over 8gb will try help for that kind of thing.
- malikNF 4y agohttps://lambdalabs.com/gpu-benchmarks https://lambdalabs.com/gpu-benchmarks
- ftufek 4y agoRTX 3090, it has 24 gb of memory which is barely enough nowadays. Hoping that 4090s will have 48gb, but we'll know on the 20th.
- deleted 4y ago[deleted]
- hedora 4y agoIf you want the cheapest total spend, use paperspace. (I linked their price page elsewhere.) It's about $7 per month for boot drive storage, plus tens of cents per hour of uptime. If you want the cheapest total spend where you buy your own hardware, it basically runs on any current-generation amd / nvidia / m1 card. I used a modified version of stable diffusion that works with < 10GB of DRAM on a AMD RX 6600XT. Check around before buying, obviously; I lucked out. The modified version produces the same quality output, but has to page data in and out. It takes about 100 seconds per batch of five images. The card cost under $300, and is plugged into a ~ 10 year old Linux box. It's probably possible to go cheaper than that.