3 ms·
I would also love to see a consumer GPU with a lot of VRAM. I think 128 GB would be too expensive BUT I'm hoping the Nvidia 50 series comes with 32+ GB VRAM for
by samspenc 3y ago
I would also love to see a consumer GPU with a lot of VRAM. I think 128 GB would be too expensive BUT I'm hoping the Nvidia 50 series comes with 32+ GB VRAM for at least the top tier cards of the family (today they max out at 24 GB VRAM in the 3090 and 4090.)
- outside415 3y agoimagine how impossibly sold out those cards would be.
- ls612 3y ago4090s are only sold out because of the China sanctions and are moving back towards MSRP. Fundamentally even a 48GB desktop card would be no substitute for a B100.
- outside415 3y agoyeah but if you had 4090s with H100 equiv VRAM (prob don't even need HBM equiv) that wouldn't require quantizing larger models you would end up with a ton of LLM workstations at a fraction of what they charge for H100s. The demand would be high. What China was doing with the 4090s requires a great deal of technical/manufacturing prowess that doesn't apply to most.