4 ms·
No, the quants they released were also messed up. RC2 also ballooned the size so the ones who were excited about RC1 (like me) can no longer fit it in our hardw
by embedding-shape 2mo ago
No, the quants they released were also messed up. RC2 also ballooned the size so the ones who were excited about RC1 (like me) can no longer fit it in our hardware. They haven't promised anything, but said they'll try to restore the RC1 size for the next update of the weights.