4 ms·
I'm so confused. Why do the lawyers not simply check to see if the references are real or not? How hard is it to look through an LLM's output and do a quick sea
by anon25783 3y ago
I'm so confused. Why do the lawyers not simply check to see if the references are real or not? How hard is it to look through an LLM's output and do a quick search to see if any of the laws or cases mentioned in it are in fact unsubstantiated?
- phren0logy 3y agoRegardless of how hard it is to check the references (which is not really all that hard), it's the job of a lawyer.
- Ekaros 3y agoSure use whatever tool to find suitable cases supporting you. But also verify that those cases support your position. Better not give ammo to your opponent.
- chrononaut 3y agoAt best an LLM in this case should serve as a "pointer" or "hint" to references. It's clear one would still need validate the entirety of the case and the arguments put forward from them.
- mike_hearn 3y agoBecause people aren't used to the idea that computers will make things up. I don't see why anyone is surprised by what the lawyer did here and for sure there is a lot more of this going on than is getting into the public. People spend their whole lives thinking of machines as logical and correct, but lacking in creativity. Suddenly generative AI comes along and totally upends this. If you're an HN reader and see in depth discussions of LLMs every day then of course it's obvious that these things can make up citations, but if you primary experience of the tech industry is search engines that have never made up fake results ever, then why would you even imagine it's possible?