4 ms·
It's incredibly niche, but Gemma 3 27b can recognize a number of popular video game characters even in novel fanart (I was a little surprised at that when messi
by brigade 1y ago
It's incredibly niche, but Gemma 3 27b can recognize a number of popular video game characters even in novel fanart (I was a little surprised at that when messing around with its vision). But the Q4 quants, even with QAT, are very likely to name a random wrong character from within the same franchise, even when Q8 quants name the correct character.
Niche of a niche, but just kind of interesting how the quantization jostles the name recall.
- smallerize 1y agoVision models do degrade more with quantization. https://unsloth.ai/blog/dynamic-4bit https://unsloth.ai/blog/dynamic-4bit