3 ms·
> I look at cost versus VRAM. Fitting a model in one PC helps. Fitting a model on one GPU helps more. Yes unfortunately I dont see 128GB VRAM coming any time s
by ksec 3y ago
> I look at cost versus VRAM. Fitting a model in one PC helps. Fitting a model on one GPU helps more.
Yes unfortunately I dont see 128GB VRAM coming any time soon even with 512bit GDDR Memory Interface.
- deleted 3y ago[deleted]
- frognumber 3y agoI would very, very gladly pay for a GPU which took normal DIMMs, and let me get up to 256GB. I can buy a 32GB DIMM for <$50. Eight of them would do it for $400. YES, I know the performance hit, but I'm not limited so much by performance as by which models fit. That's true of a lot of other people too. Only way I can see this happening is if Intel or AMD get serious about AI. This would seriously undercut NVidia's business.