3 ms·
The issue with GenAI is that is typically sounds correct, and presents its opinion in a way that seems authoritative, but might be wrong... and the only ways to
by thomascgalvin 2y ago
The issue with GenAI is that is typically sounds correct, and presents its opinion in a way that seems authoritative, but might be wrong... and the only ways to know that it' wrong are 1. to try its suggestion and fail, or 2. to look at it with existing expertise.
I see this frequently when generating source code; it'll get me 80-90% there, but I need to fix, massage, and adjust. This is fairly easy, since the code-test-code loop is already part of a normal development cycle.
When it's a matter of law, though? You don't really get those kinds of do-overs, and if the judge catches you citing a hallucination in your argument? I doubt that would go over well.