3 ms·
Are they quantized more effectively than the non-reasoning models for some reason?
by pamelafox 1y ago
Are they quantized more effectively than the non-reasoning models for some reason?
- GaggiX 1y agoThere is no difference, you can choose a 6 bits quantization if you prefer, at that point it's essentially lossless.