4 ms·
Point taken but there isnt any western providers there yet. Power is cheaper in china.
by masafej536 5mo ago
Point taken but there isnt any western providers there yet. Power is cheaper in china.
- NitpickLawyer 5mo agoAs this is a new arch with tons of optimisations, it'll take some time for inference engines to support it properly, and we'll see more 3rd party providers offer it. Once that settles we'll have a median price for an optimised 1.6T model, and can "guesstimate" from there what the big labs can reasonably serve for the same price. But yeah, it's been said for a while that big labs are ok on API costs. The only unknown is if subscriptions were profitable or not. They've all been reducing the limits lately it seems.
- ithkuil 5mo agoIs there evidence that frontier models at anthropic, openai or google or whatnot are not using comparable optimizations to draw down their coats and that their markup is just higher because they can?
- 3uler 5mo agoThese models are open and there are tons of western providers offering it at comparable rates.
- persedes 5mo agonot soooo much though. It's heavily subsidized for residential consumption, but industrial power rates are almost comparable to the US (depends on the state you go to etc).