3 ms·
The AMD 395 supports up to 128GB unified RAM. So still not enough even at 1-bit quant unfortunately.
by kccqzy 4mo ago
The AMD 395 supports up to 128GB unified RAM. So still not enough even at 1-bit quant unfortunately.
- monksy 4mo ago96gb vram is the max it supports.
- cpburns2009 4mo agoThat's the max you can statically allocate in the BIOS. It's best to leave that at the minimum (500 MB I think), and let the drivers dynamically allocate. You can use up to about 120 GB on Linux.
- selfhoster11 4mo agoUnder Linux it is allegedly 110GB, but I’m not sure.