3 ms·
What's the verdict for real world use on Q3 120B (fits in 64GB) vs Q4 of a smaller model?
by Archit3ch 8mo ago
What's the verdict for real world use on Q3 120B (fits in 64GB) vs Q4 of a smaller model?
- FuckButtons 8mo agoBigger model wins as long as the quantization was done properly.