2 ms·
4-bit quant is generally kinda low, right? I wonder how badly this quant affects the output on DeepSeek?
by qingcharles 2y ago
4-bit quant is generally kinda low, right?
I wonder how badly this quant affects the output on DeepSeek?
loading thread…