8 ms·

Reasoning models like qwen3 are even better, and they have more options, for example you can choose the 14B model (at the usual 4KM quantization) instead of the

• pamelafox 1y ago
  Are they quantized more effectively than the non-reasoning models for some reason?
  • GaggiX 1y ago
    There is no difference, you can choose a 6 bits quantization if you prefer, at that point it's essentially lossless.