3 ms·
> - as you'd need to validate the things the LLM serves And that is not as hard as retrieving that originally, how so then? Also no "here we have a prototype
by throwbadubadu 3y ago
> - as you'd need to validate the things the LLM serves
And that is not as hard as retrieving that originally, how so then?
Also no "here we have a prototype never intended to be the real thing, now ship it"-mentality there? Oh, certainly not, it is a non overloaded government agency :D
- YetAnotherNick 3y ago> > - as you'd need to validate the things the LLM serves > And that is not as hard as retrieving that originally, how so then? Not necessarily. With good prompts GPT-4 is decently good at citation of exact sentences in the source. And there could be a separate system that verifies that citation text matches the real text for being safe.
- bugglebeetle 3y ago> And there could be a separate system that verifies that citation text matches the real text for being safe. This is what we’re doing with LLMs at my job and it works quite well. Essentially, the LLM generates a space of possible answers that are then validated with various procedural logic checks. The two strategies work well together, whereas either alone wouldn’t produce as good of results.
- msp26 3y agoAny tips for someone currently working to create one of these systems?