3 ms·
Being able to ask a question in human language and get back an answer is the single most useful thing that LLMs have to offer. The obvious challenge here is "h
by simonw 2y ago
Being able to ask a question in human language and get back an answer is the single most useful thing that LLMs have to offer.
The obvious challenge here is "how do I ensure it can answer questions about this information that wasn't included in its training data?"
RAG is the best answer we have to that. Done well it can work great.
(Actually doing it well is surprisingly difficult - getting a basic implementation of RAG up and running is a couple of hours of hacking, making it production ready against whatever weird things people might throw at it can take months.)
- __loam 2y agoI recognize it's useful. I don't think it justifies the cost.
- surfingdino 2y agoOf course, it doesn't. Most of those questions are better answered using SQL and those which are truly complex can't be answered by AI.
- gregatragenet3 2y agoWhat cost? A few cents per question answered?
- __loam 2y agoThe billions spent on R&D, legal fees, and inference?
- neverokay 2y agoBeing able to ask a question in human language and get back an answer is the single most useful thing that LLMs have to offer. I’m gonna add: - I think this thing can become a universal parser over time.