4 ms·
Yeah, my point is that LLMs can reach that point too. Especially if you do it clientside. Copying was also way more expensive back in the 60s (accounting just f
by euazOn 2mo ago
Yeah, my point is that LLMs can reach that point too. Especially if you do it clientside. Copying was also way more expensive back in the 60s (accounting just for machine time and electricity, not storage cost, about 100 million times more expensive than today). Everything has a cost.
- deleted 2mo ago[deleted]
- throwaway27448 2mo agoLLMs will never be as cheap or reliable as copying.
- euazOn 2mo agoDefinitely, of course. But I think the logic of the author’s article is based on there being a huge difference between the two, or rather a high cost of inference in absolute terms. And that can change and we have seen it change. Which breaks the entire premise of the article going forward, no? Inference will be always more expensive than db operations or copying, sure. But how much more expensive is the question.