3 ms·
Hosting the model is cheaper per token, the more batched token you get. So they have big advantage here.
by YetAnotherNick 9mo ago
Hosting the model is cheaper per token, the more batched token you get. So they have big advantage here.
loading thread…