3 ms·
I belive no sane provider, antropic and openai included, serve BF16. Side note: I suspect Antropic was experimenting with changing quant level based on server
by throwa356262 4mo ago
I belive no sane provider, antropic and openai included, serve BF16.
Side note: I suspect Antropic was experimenting with changing quant level based on server load a few months back which is what caused that major quality drop we saw then.