3 ms·
We have likely seen the cheapest prices already. Once we can’t function without them anymore - go as high as you can!
by nicce 1y ago
We have likely seen the cheapest prices already. Once we can’t function without them anymore - go as high as you can!
- nico 1y agoHopefully we get more competition and someone willing to undercut the more expensive options
- nicce 1y agoEntering the market and being competitive gets more difficult all the time. People want the best and fastest models - can you compete with trillion dollar datacenters?
- eru 1y agoYou might be right, but there's plenty of deep pocketed companies who are still very excited to compete in this market.
- overfeed 1y agoIt's more likely the shareholder zeitgeist will soon shift to demanding returns on the ungodly amounts already invested into AI.
- hirako2000 1y agoBy then comparable or even better models will easily run on edge. So if they crank up the prices we could just switch to local and not get lured by bigger and bigger models, rag, Agentic, MCP driven tech as if all of that couldn't run locally either.
- gnatolf 1y agoI am not as optimistic that locally run models will be able to compete anytime soon. And even if, the price to run them means you have to buy the compute/gear for a price that is likely equivalent to a lot of 'remote' tokens
- nicce 1y agoThe most meaningful models will run in the future on those trillion dollar data centers that are currently being build.
- Gerardo1 1y ago> By then comparable or even better models will easily run on edge. What are you basing that on?
- croon 1y agoPresumably your goal is to extract some practical value from this and not just higher benchmark numbers. If you can get the functionality you need from last-gen, there's no point in paying for next-gen. YMMV.
- hirako2000 1y agoIndeed that was the premise that we would be a step behind when running on edge. That's already the case.
- eru 1y agoYou know that competition is a thing, do you?