3 ms·
But you're using a 3rd party quant of unknown quality. Nvidia is only providing weights as BF16 and FP8.
by Tepix 10mo ago
But you're using a 3rd party quant of unknown quality. Nvidia is only providing weights as BF16 and FP8.
loading thread…
3 ms·