3 ms·
Inevitably, someone relying on the advice of one of these AIs will be charged with a criminal or administrative offense. It'll be interesting to see if they'll
by pseudolus 3y ago
Inevitably, someone relying on the advice of one of these AIs will be charged with a criminal or administrative offense. It'll be interesting to see if they'll be able to successfully raise the defense that they were relying on the advice of a public official or a "published" interpretation of a public statute provided by an AI.
- koolba 3y agoThe discovery process for that case would be incredibly costly as it’s highly likely the AI would have been updated in between the incident and the court case. I bet if it were a private citizen running that AI, the overzealous DAs in NY would go after them for “destroying evidence of a crime” for not preserving the state of the AI.
- mmcwilliams 3y agoIn this case, where a RAG system is pulling from city legal code, what is the fix? Handling edge cases for individual laws it gets wrong?
- koolba 3y agoThe fix is not to rely on probabilistic text generation for legal purposes. It needs a verification step. Or maybe just use it to generate a set of canned answers for a FAQ, but again with each answer manually verified.
- mmcwilliams 3y agoI agree with you, I'm just unclear about the process by which people think this system could be updated for accuracy. I think manually verifying every possible answer means that the solution is to not use transformer models for this task.
- mcculley 3y agoI would expect most systems to preserve questions and answers for quality control and testing. Even if a system claims not to keep that record, I don’t trust it not to.