4 ms·
> they use their own naming convention. Seems like a lot of them do, I only compare them within the same repo because there doesn't seem to be a very standard
by noir_lord 14d ago
> they use their own naming convention.
Seems like a lot of them do, I only compare them within the same repo because there doesn't seem to be a very standard way of saying all the possible combinations/rearrangements.
- iker00 14d agobpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal the actual bpw.
- tancop 14d agoIt's a bad way to compare. Average bpw ignores the fact that some layers can tolerate more aggressive quant than others.