2 ms·
There is a bubble all-right, in token usage. All big providers show exponential increase in token usage month over month. Despite continuous optimization and d
by dist-epoch 1y ago
There is a bubble all-right, in token usage. All big providers show exponential increase in token usage month over month.
Despite continuous optimization and data center buildup, I frequently encounter "model is overloaded" errors.