2 ms·
I feel like even TPS is becoming less of a good metric as we're seeing certain models handle similar problems while burning far fewer tokens.
by michaelbuckbee 2mo ago
I feel like even TPS is becoming less of a good metric as we're seeing certain models handle similar problems while burning far fewer tokens.