3 ms·
In this case, where a RAG system is pulling from city legal code, what is the fix? Handling edge cases for individual laws it gets wrong?
by mmcwilliams 3y ago
In this case, where a RAG system is pulling from city legal code, what is the fix? Handling edge cases for individual laws it gets wrong?
- koolba 3y agoThe fix is not to rely on probabilistic text generation for legal purposes. It needs a verification step. Or maybe just use it to generate a set of canned answers for a FAQ, but again with each answer manually verified.
- mmcwilliams 3y agoI agree with you, I'm just unclear about the process by which people think this system could be updated for accuracy. I think manually verifying every possible answer means that the solution is to not use transformer models for this task.