2 ms·
True, but it'd be nice if they could just answer "I don't know" unless they are able to use RAG to retrieve an answer.
by HarHarVeryFunny 3y ago
True, but it'd be nice if they could just answer "I don't know" unless they are able to use RAG to retrieve an answer.
- sp332 3y agoThe tooling around the model could be a lot better. The LLM is just a statistical model and the tooling takes the most likely token at each step (or samples from some of the most likely). Instead it could say "There are no high-probability completions here". Or you could give it a list of actual episode titles and it would select the most likely one.