2 ms·
By then comparable or even better models will easily run on edge. So if they crank up the prices we could just switch to local and not get lured by bigger and
by hirako2000 1y ago
By then comparable or even better models will easily run on edge.
So if they crank up the prices we could just switch to local and not get lured by bigger and bigger models, rag, Agentic, MCP driven tech as if all of that couldn't run locally either.
- gnatolf 1y agoI am not as optimistic that locally run models will be able to compete anytime soon. And even if, the price to run them means you have to buy the compute/gear for a price that is likely equivalent to a lot of 'remote' tokens
- nicce 1y agoThe most meaningful models will run in the future on those trillion dollar data centers that are currently being build.
- Gerardo1 1y ago> By then comparable or even better models will easily run on edge. What are you basing that on?
- croon 1y agoPresumably your goal is to extract some practical value from this and not just higher benchmark numbers. If you can get the functionality you need from last-gen, there's no point in paying for next-gen. YMMV.
- hirako2000 1y agoIndeed that was the premise that we would be a step behind when running on edge. That's already the case.