3 ms·
Chinese 1T+ models are being offered at a fraction of GPT/Claude cost, and the margin is healthy enough for dozens of providers to compete, so I find it highly
by b65e8bee43c2ed0 5mo ago
Chinese 1T+ models are being offered at a fraction of GPT/Claude cost, and the margin is healthy enough for dozens of providers to compete, so I find it highly likely that ClosedAI and Misanthropic sell tokens at massive markup. they just still bleed billions on their free tier and san francisco salaries.
- citrin_ru 5mo agoWhy we should assume that whoever offers these Chinese models makes sufficient profits and will not rise the prices eventually too?
- han1 5mo agoChinese models are state-funded and not concerned with taking profits.
- throawayonthe 5mo agothat's not how that works regardless, the parent comment is talking about third parties hosting, for a fee, the openly available models, usually outside china
- larme 5mo agoSome of these models are open weight. You can try hosting them and do the price calculation yourself. They also publish papers talking about how to save kv cache and computation powers. Because currently they don't have the most powerful nvidia cards, training and inference efficiency is very import for them.
- bakugo 5mo ago[dead]