3 ms·
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses
- stared 1mo agoCompare and contrast with tests on Qwen3.6 27B: * how does quantization hurts pelican-drawing skills (https://quesma.com/blog/qwen-quantization-quality/ https://quesma.com/blog/qwen-quantization-quality/) * how does it hurt knowledge (https://quesma.com/blog/quantization-hurts-knowledge/ https://quesma.com/blog/quantization-hurts-knowledge/)