3 ms·
How will anyone running home instances be able to compete against people paying some money running much more powerful models on much more powerful hardware?
by IncreasePosts 3mo ago
How will anyone running home instances be able to compete against people paying some money running much more powerful models on much more powerful hardware?
- Fr0styMatt88 3mo agoIt’ll be interesting. I’m using Qwen3.6:27B at home and mostly Sonnet/Opus (depending on the complexity of the task) at work. You have to break things down into smaller chunks for the local models. For the bigger cloud ones they can do a lot of the broader thinking.
- fragmede 3mo agoTime is money, but apparently now thinking is money as well. How much is it going to cost to think harder? If it's, say, $10 to use a bigger cloud model, it becomes easier to qualify the cost of thinking.
- jimbokun 3mo agoAt some point it will be hard for us to tell the difference.
- Bombthecat 3mo agoYeah. There always will be a gab. And it will keep growing for the next years...