4 ms·

All of their benchmarks are against 16 bit models right? Why aren't they comparing to 2/3/4 bit quants?

• himata4113 6mo ago
  looked at quant versions of these models and they all outperform it so I guess it just doesn't look as good.
• mstr_anderson 6mo ago
  [flagged]