4 ms·
I really don’t want to give anyone ideas, but doesn’t this make the Nvidia 5090 an unbelievably good deal right now? The VRAM in the 5090 is only made by one c
by johnvanommen 5mo ago
I really don’t want to give anyone ideas, but doesn’t this make the Nvidia 5090 an unbelievably good deal right now?
The VRAM in the 5090 is only made by one country in the world.
The 50xx series is special, because its ram is so dependent on a single commodity. It’s not like a 4090 or a 3090; their VRAM chips have been around for years.
If there’s a shortage or interruption in DDR7 VRAM, it seems like every GPU that requires it would explode in value.
I hope I don’t regret posting this because I’d really like to buy one myself…
- mattmanser 5mo agoIt's gone up like 300% in cost in the last year.
- JacobAsmuth 5mo agoWhich surely is the highest it'll ever be! You're suggesting that the price will go down in the future? Would love to hear more about your thought process!
- bcrosby95 5mo agoAre you saying we're entering a period where tech increases in price instead of decreases? I guess it depends upon time horizon, but your statement isn't very specific.
- JacobAsmuth 5mo agoYeah man, obviously. RTX 5090s will almost certainly increase in price over the next two years as memory shortages get worse.
- johnvanommen 5mo agoI believe msrp is $2000 right?
- EnPissant 5mo agoThere was only a very brief time it was selling for MSRP (last fall for $2000). Even if you use that as the previous data point, it's only 200% increased.
- no-name-here 5mo ago> it's only 200% increased. If it's 4k instead of 2k msrp, that's a 100% increase.
- EnPissant 5mo agoYou are correct. I should have said "increased to 200%".
- forrestthewoods 5mo agoif you can buy one! The RTX 5090 is faster than an H200. It just has less ram (32 vs 141), doesn't have NVLink, and technically isn't allowed to be used in a datacenter. The datacenter GPUs sell at an 80% margin. They're incredibly overpriced. But the laws of supply and demand are undefeated and so here we all are.
- alphabeta3r56 5mo ago> The RTX 5090 is faster than an H200. It just has less ram H200 has HBM and much more 64-bit compute
- forrestthewoods 5mo agoLet me try again. RTX 5090 has more CUDA cores that run at a higher clock speed. H200 has more RAM and significantly more RAM bandwidth. Which one is net faster depends on your use case. But you may be very surprised that many workflows are faster on an RTX 5090!
- layer8 5mo agoAn unbelievably good deal at $4000 plus?
- johnvanommen 5mo agoPossibly the best deal there is I really need to shut up, or bite the bullet and by one. If you graph the tokens per second on the 5090, your jaw will hit the floor at how cheap it is
- gruez 5mo agoWith only 32gb of vram, you can only run small/quantized models, in which case what's the point? At $4000, that gets you 20 months of 10x claude or chagpt subscriptions, which provide far better models. You'd need some use case where you can tolerate worse models, and use a steady supply of them. That doesn't match most people's usage patterns.
- echoangle 5mo agoOr you want to process private data or don’t have reliable connectivity. There are a few more reasons for local models I think.
- EnPissant 5mo agoAlso, electricity isn't free.
- tom_alexander 5mo agoWith enough solar panels it is!
- HDBaseT 5mo agoNot quite. Free for approximately 8 hours (assuming perfect weather conditions) and excluding unit cost and maintenance cost. It has a cost.