3 ms·
>> We can't possibly hope to run the kinds of models that run on 192GB of VRAM at home. I'm looking to build a mini-ITX system with 256GB of RAM for my next bu
by phkahler 2y ago
>> We can't possibly hope to run the kinds of models that run on 192GB of VRAM at home.
I'm looking to build a mini-ITX system with 256GB of RAM for my next build. DDR5 spec can support that in 2 modules, but nobody makes them yet. No need for a GPU, I'm looking to the AMD APUs which are getting into the 50TOPs range. But yes, RAM seems to be the limiting factor. I'm a little surprised the memory companies aren't pushing harder for consumers to have that capacity.
- auspiv 2y ago128GB DDR5 module - https://store.supermicro.com/us_en/supermicro-hynix-128gb-288-pin-ddr5-4800-pc5-38400-server-memory-mem-dr512mh-er48.html https://store.supermicro.com/us_en/supermicro-hynix-128gb-28... It is of course RDIMM, but you didn't specify what memory type you were looking at.