3 ms·
I have noticed this 100%. My theory is that they are serving quantized versions of the models randomly to save costs.
by istvan_intrnd 10mo ago
I have noticed this 100%. My theory is that they are serving quantized versions of the models randomly to save costs.