4 ms·
Why does grep in a loop fall apart? It’s expensive, sure, but LLM costs are trending toward zero. With Sonnet 4.5, we’ve seen models get better at parallelizati
by nbstme 1y ago
Why does grep in a loop fall apart? It’s expensive, sure, but LLM costs are trending toward zero. With Sonnet 4.5, we’ve seen models get better at parallelization and memory management (compacting conversations and highlighting findings).
- adrianbooth17 1y ago"LLM costs are trending toward zero". They will never be zero for the cutting edge. One could argue that costs are zero now via local models but enterprises will always want the cutting edge which is likely to come with a cost
- jgalt212 1y agoIf LLM costs are trending towards zero, please explain the $600B openai when Oracle and the $100B deal with Nvidia. And if you think those deals are bogus, like I do, you still need to explain surging electricity prices.
- flyinglizard 1y agoThey're not trending toward zero; they're just aggressively subsidized with oil money.