7 ms·
If I remember right, in the press conference they suggested desktop users would use a gpu because desktop uses are less power sensitive. That doesn’t address th
by MobiusHorizons 2y ago
If I remember right, in the press conference they suggested desktop users would use a gpu because desktop uses are less power sensitive. That doesn’t address the vram limitations of discrete GPUs though.
- wkat4242 2y agoTrue but try to find a 96GB GPU.
- teaearlgraycold 2y agoH100 NVL is easily available. It’s just that it’s close to $20k.
- andersa 2y agoIt is actually much more expensive than 20k. I can find them between 25-30k only.
- teaearlgraycold 2y agoMy bad. Looks like it’s $29k at the local store.
- VikingCoder 2y agoThis drives me insane. PC Part Picker, DDR5-8400 48 GB (2x24GB) is... $340 right now. For $680 you can get 96 GB of very fast RAM. How about someone make an NVidia GPU with 96 GB of RAM at a reasonable price? Please?
- tymscar 2y agoI totally agree that we should get higher vram sizes on GPUs but they are not the same as DDR5. The one you listed does around 50Gbps. A really good gpu does almost 450Gbps. Prices as you know also don’t scale linearly. For something twice as good sometimes you pay 4x the price and so on.
- MobiusHorizons 2y agoThis is a really important point. The architecture and the bus ram is connected to is also very different on on a discrete card than it is in a cpu. Each compute unit needs dedicated bus width connected to dedicated memory. So for most GPUs you can double the ram, but you couldn’t just add the equivalent of a stick of ddr5 because it wouldn’t match the dedicated bus
- immibis 2y agoIIRC it's a market segmentation thing
- iszomer 2y agoThat high price tag is most often attributed to the type of memory being used which in the H100's case, is HBM2e and error correcting.