4 ms·
While the differentiation aspect is real, for pricing I did some calculation for self hosting and even with small models, you are likely to loose money unless y
by YetAnotherNick 3y ago
While the differentiation aspect is real, for pricing I did some calculation for self hosting and even with small models, you are likely to loose money unless you have very high rps with users could tolerate some random delay. It's very hard to even get 7B model to be cheaper than ChatGPT API. And that was pre price reduction.