4 ms·

> 8 vs 16 is near verboten in public conversation. i mean, deepseek is fp8

• CamperBob2 2y ago
  Not only that, but the 1.58 bit Unsloth dynamic quant is uncannily powerful.