3 ms·
A used RTX3090 of eBay is the most interesting budget option by far. If you have twice the cash, go for a new RTX4090 for rougly twice the performance. If you
by PeterStuer 3y ago
A used RTX3090 of eBay is the most interesting budget option by far.
If you have twice the cash, go for a new RTX4090 for rougly twice the performance.
If you need more than 24GB vram, you want to get comfortable with sharding across a few of the 3090's, or spend a lott more on a 48, 80, 100 GB card.
If you feel adventurous, you can go a non nvidia route, but expect a lott of friction and elbow grease at least for now.
- brucethemoose2 3y agoYeah, the 3090 is a meme in local AI communities. Additionally, the support is amazing because its essentially the same architecture as an A100. The 3060 is popular too, being a 3090 cut in half.
- johndough 3y ago> Yeah, the 3090 is a meme in local AI communities. Calling the 3090 a "meme" makes it sound like the 3090 is a joke. Do you mean that the 3090 is "well-known" in local AI communities?
- brucethemoose2 3y agoYeah, I just meant that is like the only option, which is crazy because its a 2020 GPU. There are lots of questions about what hardware to get for ML, and the generic answer is basically always "get a 3090." Its so frequently recommended that it feels like a meme to me.
- phanimahesh 3y agoIt hits a good sweet spot between price and power, and there's usually some easily available. Availability is a major factor imo.
- brucethemoose2 3y agoYeah, exactly. Gaudi boards might be good for local genai... if you could find any.
- PeterStuer 3y agoI myself wanted a new 4090 (2.000€), but my budget constrained me to a used 3090 from eBay (800€) which has served very well so far.