4 ms·
I’m a legal tech skeptic, but I’ve been very impressed by Chat GPT’s ability to answer simple legal questions. As long as bags of meat remain the ultimate decis
by rayiner 4y ago
I’m a legal tech skeptic, but I’ve been very impressed by Chat GPT’s ability to answer simple legal questions. As long as bags of meat remain the ultimate decision makers (judges and juries) you’re going to need some lawyers to interface with them. But it’s imaginable that you could reduce the number needed. The trial lawyer delivering the closing argument wouldn’t necessarily need a dozen other lawyers preparing the case for her. GPT is the first technology I’ve seen that seems to “understand” written work well enough to deliver meaningful answers to case-specific questions.
- vba616 4y agoI don't actually know what most of the work in today's legal industry comprises, (by what metric?) but in a discussion like this, it seems like people are thinking of Perry Mason or LA Law, whereas I'm thinking of document review, bates stamps, software like Relativity or proprietary document management systems. Deduplication, and search queries. If the best search technology dominated, why wouldn't Google have already taken over years ago? I know that's what I used to wonder. At least a few years ago, there seemed to be a lot of talk of disgruntled lawyers who turned to document review for low wages and miserable working conditions because they couldn't find "real" work. Can AI do that - for legal reasons, which after all, were why those lawyers got hired in the first place? Weren't the US based teams already replaced by offshore teams? How much can be gained now?
- gamblor956 4y agoI tried to get ChatGPT to answer some very simple legal questions and it was the most incompetent legal advisor I've ever seen. Sure, on the surface it seems like it's correct, but the content is all wrong. And content is what matters.
- JamesBarney 4y agoWere you using 3.5 or 4? I've used 4 and been very impressed with it. For business it's been great, because the language is usually clear and unambiguous. For employment contracts it's been not nearly as helpful because the non-compete language is meant to be vague and ambiguous, and relies on a lot of case law around what is and isn't enforceable.
- gamblor956 4y agoBoth. 3.5 was a non-starter. 4 is improved, in the sense that it produced stylistically correct looking fluff but still offered the kind of substantive legal nonsense that would get a human lawyer disbarred for gross incompetence: it still makes up laws, and cases, and facts. This is because ChatGPT doesn't have knowledge or understanding of the law, or facts, or the consequences of its output. It just matches linguistic tokens probabilistically. Those who rely on ChatGPT for legal advice will make some human lawyers very rich some day when they have to hire real lawyers to clean up ChatGPT's mistakes. This isn't to say that AI is incapable of providing legal advice; but it's not going to be an LLM (though it might be a KbLLM).
- JamesBarney 4y agoWhat were the really simple legal questions it got wrong?
- gamblor956 4y agoIt couldn't handle basic wills, or pre-nups, which are literally just templates in the most basic case. It couldn't explain how to get out of a traffic ticket. Oh, and it wasn't clear on how Miranda works. If it can't handle easy stuff which is literally just boilerplate, it can't be trusted to handle more important stuff where actual judgment or creativity is required.