4 ms·
They probably do lots of tricks like using quantized or distilled models during times of high load. They also have a sizeable number of free users, who will be
by parentheses 1y ago
They probably do lots of tricks like using quantized or distilled models during times of high load. They also have a sizeable number of free users, who will be the first to get rate limited.