4 ms·
I think only 2/3 of ram is allocated to be available to the gpu, so like 14gb which is probably not enough to run even Q4 quant.
by redman25 1y ago
I think only 2/3 of ram is allocated to be available to the gpu, so like 14gb which is probably not enough to run even Q4 quant.
- tstrimple 1y agoThis is configurable by the way. sudo sysctl iogpu.wired_limit_mb=12345