3 ms·
bpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal t
by iker00 13d ago
bpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal the actual bpw.
- tancop 13d agoIt's a bad way to compare. Average bpw ignores the fact that some layers can tolerate more aggressive quant than others.