4 ms·
This only shows that ChatGPT is as good as or better than your traditional search and not that it's gotten the law right. Unless you go to a lawyer and confirm
by xmprt 3y ago
This only shows that ChatGPT is as good as or better than your traditional search and not that it's gotten the law right. Unless you go to a lawyer and confirm this doesn't say a whole lot especially considering how prone LLMs are to hallucinating incorrect answers that look correct (even if you found it matched up with Google search, the answers might still be wrong in whatever blog or article you read).
- consumer451 3y agoThat's a fair point. This happened to all be in an area of the law, estate law, which was heavily documented for the public in that jurisdiction. The estate was tiny, and the actual legal advice was locked behind a paywall ($7k minimum in legal fees) which would have otherwise taken the majority of the estate. Still a huge win for $20/month.
- xmprt 3y agoYeah. The results are impressive and I can't deny the value when ChatGPT is able to get things like this right. But especially given how much disinformation is starting to be spread on the internet these days and how it's all being scraped for training LLMs (and especially in the case of law where different jurisdictions can have very different laws but ChatGPT could easily get its wires crossed), I'm worried that it might lead to more harm than good when people make decisions based on incorrect outputs of LLMs.