3 ms·
It's just getting started. You won't find out what the real, actual cost is until after you build it into your workflow. In other words; right now, we're stil
by jqpabc123 5mo ago
It's just getting started. You won't find out what the real, actual cost is until after you build it into your workflow.
In other words; right now, we're still in the "bait" phase. The "switch" comes later.
- happyPersonR 5mo agoNext year is gonna be when the “switch” comes lollll
- ReptileMan 5mo agoNext year we will have new deepseek.
- happyPersonR 5mo agoI see a couple of possibilities 1) someone deepseeks deepseek lol: Generates their own weights and figures out a way to determine all of the intermediate states. 2) places realize there’s real risk with using a model that might have things baked into it that produce specific flaws that could be security bugs, but only under certain conditions.
- gdulli 5mo agoAnd the switch will continue, it won't be a one-time event. Like how the price of Netflix etc. keeps going up periodically. If people's dependence on their streaming service keeps them captive, just wait until people have gone 5 years without doing real work.
- kakaz 5mo ago[dead]
- b65e8bee43c2ed0 5mo agoChinese 1T+ models are being offered at a fraction of GPT/Claude cost, and the margin is healthy enough for dozens of providers to compete, so I find it highly likely that ClosedAI and Misanthropic sell tokens at massive markup. they just still bleed billions on their free tier and san francisco salaries.
- citrin_ru 5mo agoWhy we should assume that whoever offers these Chinese models makes sufficient profits and will not rise the prices eventually too?
- han1 5mo agoChinese models are state-funded and not concerned with taking profits.
- throawayonthe 5mo agothat's not how that works regardless, the parent comment is talking about third parties hosting, for a fee, the openly available models, usually outside china
- larme 5mo agoSome of these models are open weight. You can try hosting them and do the price calculation yourself. They also publish papers talking about how to save kv cache and computation powers. Because currently they don't have the most powerful nvidia cards, training and inference efficiency is very import for them.
- bakugo 5mo ago[dead]