2 ms·
> but we literally have no way to prove they're right Of course we do. Just run a benchmark with Cerebras/Groq and compare to the results produced in a trusted
by threeducks 11mo ago
> but we literally have no way to prove they're right
Of course we do. Just run a benchmark with Cerebras/Groq and compare to the results produced in a trusted environment. If the scores are equal, the model is is either unquantized, or quantized so well that we can not tell, in which case it does not matter.
For example, here is a comparison of different providers for gpt-oss-120b, with differences of over 10 % for best and worst provider.
https://artificialanalysis.ai/models/gpt-oss-120b/providers#evaluations https://artificialanalysis.ai/models/gpt-oss-120b/providers#...