4 ms·
What's GPU-5?
by kristianp 2mo ago
What's GPU-5?
- LtdJorge 2mo agoThe fattest quantization. They show all of them here: https://huggingface.co/byteshape/Qwen3.8-27B-GGUF https://huggingface.co/byteshape/Qwen3.8-27B-GGUF Since they’re not using a stable number of bits per token, they use their own naming convention.
- noir_lord 2mo ago> they use their own naming convention. Seems like a lot of them do, I only compare them within the same repo because there doesn't seem to be a very standard way of saying all the possible combinations/rearrangements.
- iker00 2mo agobpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal the actual bpw.
- tancop 2mo agoIt's a bad way to compare. Average bpw ignores the fact that some layers can tolerate more aggressive quant than others.