2 ms·

What's GPU-5?

• LtdJorge 8d ago
  The fattest quantization. They show all of them here: https://huggingface.co/byteshape/Qwen3.8-27B-GGUF https://huggingface.co/byteshape/Qwen3.8-27B-GGUF Since they’re not using a stable number of bits per token, they use their own naming convention.
  • noir_lord 8d ago
    > they use their own naming convention. Seems like a lot of them do, I only compare them within the same repo because there doesn't seem to be a very standard way of saying all the possible combinations/rearrangements.
    • iker00 8d ago
      bpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal the actual bpw.
      • tancop 8d ago
        It's a bad way to compare. Average bpw ignores the fact that some layers can tolerate more aggressive quant than others.