4 ms·
> For actual work and not toying around the 10% gap is absolutely worth the cost. I agree with this... for now. But the hosted commercial models aren't wideni
by georgemcbay 1y ago
> For actual work and not toying around the 10% gap is absolutely worth the cost.
I agree with this... for now. But the hosted commercial models aren't widening the gap as far as I can tell, if anything it appears to be narrowing.
And if the relative delta doesn't increase somehow I don't see any way in which the "AI race" doesn't end in a situation where locally run LLMs on relatively cheap hardware end up being good enough for virtually everyone.
Which in many ways is the best possible outcome, except for the likely severe economic effects when the bubble bursts on the commercial AI side.
- moomoo11 1y agoSure. I'm talking about now. I don't know what will happen tomorrow, let alone 1 year or more down the line. If it ever becomes economical to run and maintain bare metal GPU compute to run LLMs, then that's what will need to be done..