4 ms·
Link has all the params but running at 4 bit quant.
by arresin 2y ago
Link has all the params but running at 4 bit quant.
- qingcharles 2y ago4-bit quant is generally kinda low, right? I wonder how badly this quant affects the output on DeepSeek?