2 ms·

How much difference are you seeing between standard and Q4 versions in terms of degradation, and is it constant across tasks or more noticeable in some vs other

by ggsp 7mo ago

How much difference are you seeing between standard and Q4 versions in terms of degradation, and is it constant across tasks or more noticeable in some vs others?

rnewme 7mo ago
Less than expected, search for unsloths recent benchmark