3 ms·

But does the job of verifying that LLM output outweigh the job of just doing the search the old fashioned way? Probably, but we'll skip verification, just like

But does the job of verifying that LLM output outweigh the job of just doing the search the old fashioned way? Probably, but we'll skip verification, just like always. This is the scariest feature of LLMs; Failure is built into the design of the system, but people just laugh and call the failures "hallucinations" and move on. The efficiency gains from AI come entirely from trusting a system that can't be trusted

kube-system 1y ago
Not all implementations of LLMs are "just type questions into chatgpt.com or ollama and trust the raw result", even though that is probably what people are most familiar with right now. They can be used pretty safely when incorporated into other systems that have guardrails on them. Not simply a dumb wrapper, but inside of systems that simply use LLMs as processing tools. For example, one extremely safe use case is using LLMs as a search tool. Ask it to cite its sources, then string match those sources back against the source texts. You are guaranteed that the sources actually exist, because you validated it.