3 ms·
LLMs will never be as cheap or reliable as copying.
by throwaway27448 2mo ago
LLMs will never be as cheap or reliable as copying.
- euazOn 2mo agoDefinitely, of course. But I think the logic of the author’s article is based on there being a huge difference between the two, or rather a high cost of inference in absolute terms. And that can change and we have seen it change. Which breaks the entire premise of the article going forward, no? Inference will be always more expensive than db operations or copying, sure. But how much more expensive is the question.