10 ms·

We're a very tech forward law firm, and we're bullish on AI. The issue is that lawyers are traditionally tech illiterate, and they treat Gen AI like a search en

We're a very tech forward law firm, and we're bullish on AI. The issue is that lawyers are traditionally tech illiterate, and they treat Gen AI like a search engine that puts results in narrative form. Realistically, I think AI generated motions and contracts are the future, and this instance will be looked at by every tech averse lawyer to try and stymie progress in the field. These lawyers deserve their sanctions for being so reckless with things they don't understand, but rather than take away that lawyers need to learn tech, lawyers will say tech is bad. I almost wish this was non-news so it wouldn't further push the legal industry into the past, but those clients were wronged and I guess people need to know what to beware of when hiring a lawyer. Personally, we get really good results from using AI, it's already present in all of our processes, but we tell it what to generate, rather than rely on it to know better.

codeflo 3y ago
It's not just lawyers who think that ChatGPT is a search engine. I've observed this many times in my vicinity, people from all walks of life think that Star Trek is here and computers now respond accurately to natural language queries. For non-techies, "just asking the computer" is so much more convenient than translating your question into traditional search queries. So I guarantee you that stuff like this is happening daily across all industries. Depending on the profession, people will lose money or get hurt as a result of someone blindly trusting this technology. I can't prove it, but statistically, that's basically a certainty. In my opinion, you can't overstate the importance of articles like this, which point out the limitations and highlight the dangers. I'm also against banning. But lay people need to be informed what ChatGPT is and is not, and OpenAI won't do it because they want to ride the hype train.
- fennecfoxy 3y ago
  Idk it's pretty reliable even now if you chuck a vector db of "knowledge" in and inform the GPT in the overall prompt that it is must not go outside the bounds of knowledge provided with the user's query, and that if no hard knowledge is provided that it should respond along the lines of "I don't know" (or search the internet and parse results for them). I imagine at some point this behaviour will be built in. People are treating GPTs like they're knowledge bases, but they're not. The fact that they can answer simple or complex questions correctly is only a byproduct of the transformer being taught how to string language together. It's like an artist who learns to draw by making paintings of raccoons. You can't then ask them "what do raccoons like to eat?" or "what foods are poisonous to a raccoon?" just because they learnt to draw by painting raccoons. This is how people are treating GPTs atm. They believe in it because they ask the artist "what colour fur do raccoons have?" and because the artist can answer that correctly, they assume all other answers are factual.
- gpm 3y ago
  In local-to-me politics we have a report on changing the admissions process for specialty programs in the public school system - which had a bunch of fake citations and people suspect was written with the "aid" of ChatGPT. https://www.thestar.com/news/gta/2023/05/26/tdsb-fires-researcher-for-allegedly-plagiarizing-parts-of-report-on-specialty-schools.html https://www.thestar.com/news/gta/2023/05/26/tdsb-fires-resea...
- Xenoamorphous 3y ago
  > It's not just lawyers who think that ChatGPT is a search engine. Let’s not forget that Google often puts incorrect information in their snippets/factboxes or whatever they call them.
- deleted 3y ago
  [deleted]
- cratermoon 3y ago
  Computer, what's the formula for transparent aluminum? Seriously, I got ChatGPT to spit out a scientific-seeming paper on the formula and manufacturing process for transparent aluminum. It did note that there's a real thing, aluminum oxynitride, which is the closest thing we have to the Star Trek material. It even wrote the following abstract, based on my prompt: > This scientific description provides an overview of the formula and manufacturing process of transparent aluminum, a material used in applications where both structural strength and transparency are required. Transparent aluminum finds extensive use in diverse fields, including public aquaria, where it allows for the display of large marine organisms. The description outlines the chemical composition, key properties, and the manufacturing steps involved in creating transparent aluminum. Whether or not the six-step manufacturing process it came up with is correct or not, I haven't the expertise to say.
  - codeflo 3y ago
    > Whether or not the six-step manufacturing process it came up with is correct or not, I haven't the expertise to say. I mean, you can try it and perhaps get rich. Or, probably more likely, die in a horrible explosion.
    - cratermoon 3y ago
      [the material is] placed in a high-pressure vessel, and temperature and pressure are simultaneously increased to near the melting point of aluminum. I don't need to try that to know that molten metal under high pressure at over 1000C is something I'm not ready to deal with.
ouid 3y ago
>ai generated contracts are the future. Man, why do you guys get paid so much? Contracts need semantic correctness, ie the verification of the logical consequences of natural language. This is an AGI determining problem. At the point this exists, humans are basically obsolete as workers, and you don't have to worry about your law firm keeping up anymore.
- hnfong 3y ago
  Let me get this straight, you're saying if AI can be a good lawyer AI can do anything humans can do? So you're trying to say that lawyering is the hardest job in the world and only the smartest people can do it...?
  - ouid 3y ago
    I claimed that it was a task that most people can do, but is really genuinely, intelligent. I actually thought it was everyone, but then you responded with your comment.
- vidarh 3y ago
  Contracts have lots of standard clauses or near standard variations of such, and as a consequence plenty of "dumb" template based generators already exists, and you may come across contracts that have just the occasional line manually written. At least one company already integrates or is about to (not sure if it's in production yet) LLMs in theirs to do effectively smarter completions. It won't be fully automated any time soon, but it will certainly eat into a lot of the simpler work.
drumhead 3y ago
You sound like an AI generated post.
Der_Einzige 3y ago
... retrieval augmented search is here today and is available in ChatGPT with plugins or integrations with vectorDB systems. A lot of AI systems are "search engines that give you narrative outputs"
Zafira 3y ago
> [L]awyers are traditionally tech illiterate This is the main reason I think disbarment as the punishment in this specific instance may not be fair. There are people who are unaware of the limitations of these systems and the risk of these confabulations occurring. While I don’t think disbarment is inappropriate, I would rather see the New York State Bar use this to require some better understanding of these emergent technologies or even better have all the State Bars start discussing some standardized training about this because it’s easy to see a person trying to treat this as LexisNexis.
- NoMoreNicksLeft 3y ago
  Is disbarment about fairness? Is the primary goal of such proceedings to rehabilitate and apply a sort of justice? Certainly, civil and criminal courts have those as their raison d'être. But I thought licensing boards had an entirely different purpose. If I surgeon was a good guy who genuinely wanted to help people and who didn't engage in any sort of malfeasance... but even so, he just kept slicing aortas open accidentally through incompetence, the board should say "aw shucks, he's had some bad luck but he really wants to heal people". This is the same. The court system is replete with circumstances where a client does not get a second chance at pursuing justice. A lawyer that fucks that up, even if doing so in good faith, leaves them with zero remedies. This might have been a bullshit "Slippin' Jimmy" case this time, but the stakes could've easily been higher. I don't think I want to live in a world where fairness plays any part in the decision by the bar on this matter.
  - Zafira 3y ago
    Disbarment is usually considered a punishment of last resort. That the failure of the attorney to carry out their obligations is so absolute, that it justifies taking away their right to practice law in a given state. There are certainly other measures that can be done here that are of a similar rebuke, just not as final. A suspension or temporary disbarment is also possible. We don’t know the full situation here, but a personal injury case against a bankrupt airline for striking someone in the knee with the serving cart seems remediable? Disbarment usually happens in cases where attorneys fail to file timely repeatedly at the expense of their clients and after multiple admonishments to stop that; utterly fail in their fiduciary obligations (i.e. they were acting like an escrow and then instead gambled the money away in Vegas).
nocoiner 3y ago
Out of curiosity, why do you think AI generated contracts are the future? Do you draw a distinction between contracts generated by AI and, say, contracts “generated” by first-year associates (i.e., using precedent to generate a first draft appropriate for the deal that’s then iterated by more experienced lawyers)? Also, how is this incident going to push the legal industry further into the past? Do you think lawyers are going to, like, stop using email because of this?

codeflo 3y ago

It's not just lawyers who think that ChatGPT is a search engine. I've observed this many times in my vicinity, people from all walks of life think that Star Trek is here and computers now respond accurately to natural language queries. For non-techies, "just asking the computer" is so much more convenient than translating your question into traditional search queries. So I guarantee you that stuff like this is happening daily across all industries. Depending on the profession, people will lose money or get hurt as a result of someone blindly trusting this technology. I can't prove it, but statistically, that's basically a certainty. In my opinion, you can't overstate the importance of articles like this, which point out the limitations and highlight the dangers. I'm also against banning. But lay people need to be informed what ChatGPT is and is not, and OpenAI won't do it because they want to ride the hype train.

fennecfoxy 3y ago
Idk it's pretty reliable even now if you chuck a vector db of "knowledge" in and inform the GPT in the overall prompt that it is must not go outside the bounds of knowledge provided with the user's query, and that if no hard knowledge is provided that it should respond along the lines of "I don't know" (or search the internet and parse results for them). I imagine at some point this behaviour will be built in. People are treating GPTs like they're knowledge bases, but they're not. The fact that they can answer simple or complex questions correctly is only a byproduct of the transformer being taught how to string language together. It's like an artist who learns to draw by making paintings of raccoons. You can't then ask them "what do raccoons like to eat?" or "what foods are poisonous to a raccoon?" just because they learnt to draw by painting raccoons. This is how people are treating GPTs atm. They believe in it because they ask the artist "what colour fur do raccoons have?" and because the artist can answer that correctly, they assume all other answers are factual.
gpm 3y ago
In local-to-me politics we have a report on changing the admissions process for specialty programs in the public school system - which had a bunch of fake citations and people suspect was written with the "aid" of ChatGPT. https://www.thestar.com/news/gta/2023/05/26/tdsb-fires-researcher-for-allegedly-plagiarizing-parts-of-report-on-specialty-schools.html https://www.thestar.com/news/gta/2023/05/26/tdsb-fires-resea...
Xenoamorphous 3y ago
> It's not just lawyers who think that ChatGPT is a search engine. Let’s not forget that Google often puts incorrect information in their snippets/factboxes or whatever they call them.
deleted 3y ago
[deleted]
cratermoon 3y ago
Computer, what's the formula for transparent aluminum? Seriously, I got ChatGPT to spit out a scientific-seeming paper on the formula and manufacturing process for transparent aluminum. It did note that there's a real thing, aluminum oxynitride, which is the closest thing we have to the Star Trek material. It even wrote the following abstract, based on my prompt: > This scientific description provides an overview of the formula and manufacturing process of transparent aluminum, a material used in applications where both structural strength and transparency are required. Transparent aluminum finds extensive use in diverse fields, including public aquaria, where it allows for the display of large marine organisms. The description outlines the chemical composition, key properties, and the manufacturing steps involved in creating transparent aluminum. Whether or not the six-step manufacturing process it came up with is correct or not, I haven't the expertise to say.
- codeflo 3y ago
  > Whether or not the six-step manufacturing process it came up with is correct or not, I haven't the expertise to say. I mean, you can try it and perhaps get rich. Or, probably more likely, die in a horrible explosion.
  - cratermoon 3y ago
    [the material is] placed in a high-pressure vessel, and temperature and pressure are simultaneously increased to near the melting point of aluminum. I don't need to try that to know that molten metal under high pressure at over 1000C is something I'm not ready to deal with.

ouid 3y ago

>ai generated contracts are the future. Man, why do you guys get paid so much? Contracts need semantic correctness, ie the verification of the logical consequences of natural language. This is an AGI determining problem. At the point this exists, humans are basically obsolete as workers, and you don't have to worry about your law firm keeping up anymore.

hnfong 3y ago
Let me get this straight, you're saying if AI can be a good lawyer AI can do anything humans can do? So you're trying to say that lawyering is the hardest job in the world and only the smartest people can do it...?
- ouid 3y ago
  I claimed that it was a task that most people can do, but is really genuinely, intelligent. I actually thought it was everyone, but then you responded with your comment.
vidarh 3y ago
Contracts have lots of standard clauses or near standard variations of such, and as a consequence plenty of "dumb" template based generators already exists, and you may come across contracts that have just the occasional line manually written. At least one company already integrates or is about to (not sure if it's in production yet) LLMs in theirs to do effectively smarter completions. It won't be fully automated any time soon, but it will certainly eat into a lot of the simpler work.

drumhead 3y ago

You sound like an AI generated post.

Der_Einzige 3y ago

... retrieval augmented search is here today and is available in ChatGPT with plugins or integrations with vectorDB systems. A lot of AI systems are "search engines that give you narrative outputs"

Zafira 3y ago

> [L]awyers are traditionally tech illiterate This is the main reason I think disbarment as the punishment in this specific instance may not be fair. There are people who are unaware of the limitations of these systems and the risk of these confabulations occurring. While I don’t think disbarment is inappropriate, I would rather see the New York State Bar use this to require some better understanding of these emergent technologies or even better have all the State Bars start discussing some standardized training about this because it’s easy to see a person trying to treat this as LexisNexis.

NoMoreNicksLeft 3y ago
Is disbarment about fairness? Is the primary goal of such proceedings to rehabilitate and apply a sort of justice? Certainly, civil and criminal courts have those as their raison d'être. But I thought licensing boards had an entirely different purpose. If I surgeon was a good guy who genuinely wanted to help people and who didn't engage in any sort of malfeasance... but even so, he just kept slicing aortas open accidentally through incompetence, the board should say "aw shucks, he's had some bad luck but he really wants to heal people". This is the same. The court system is replete with circumstances where a client does not get a second chance at pursuing justice. A lawyer that fucks that up, even if doing so in good faith, leaves them with zero remedies. This might have been a bullshit "Slippin' Jimmy" case this time, but the stakes could've easily been higher. I don't think I want to live in a world where fairness plays any part in the decision by the bar on this matter.
- Zafira 3y ago
  Disbarment is usually considered a punishment of last resort. That the failure of the attorney to carry out their obligations is so absolute, that it justifies taking away their right to practice law in a given state. There are certainly other measures that can be done here that are of a similar rebuke, just not as final. A suspension or temporary disbarment is also possible. We don’t know the full situation here, but a personal injury case against a bankrupt airline for striking someone in the knee with the serving cart seems remediable? Disbarment usually happens in cases where attorneys fail to file timely repeatedly at the expense of their clients and after multiple admonishments to stop that; utterly fail in their fiduciary obligations (i.e. they were acting like an escrow and then instead gambled the money away in Vegas).

nocoiner 3y ago

Out of curiosity, why do you think AI generated contracts are the future? Do you draw a distinction between contracts generated by AI and, say, contracts “generated” by first-year associates (i.e., using precedent to generate a first draft appropriate for the deal that’s then iterated by more experienced lawyers)? Also, how is this incident going to push the legal industry further into the past? Do you think lawyers are going to, like, stop using email because of this?