5 ms·

For all the consternation about Copilot and AI coding tools, its looking like legal work is as much if not more setup for disruption. Document review is alread

For all the consternation about Copilot and AI coding tools, its looking like legal work is as much if not more setup for disruption. Document review is already being done by AI, lawyers are using AI to beef up closing arguments and review arguments, AI researchers to go through the relevant cases for citations have been worked on for awhile. Lawyers being lawyers have immediately reached to "make it illegal" and setting up protections for their trade like they always done. Roberts is commenting that they are going to be disappointed if they think they can get legal protections that X or Y must always be done by a human.

ryandvm 3y ago
Agreed. LLMs seem almost purpose built for the boilerplate part of legal work. "Read this user agreement and point out any unusual or particularly risky clauses."
CapitalistCartr 3y ago
Also using AI (ChatGPT) to write briefs, appeals, etc. Just edit. Saves a lot of time, which reduces the number of paralegals needed. This ship has already sailed. But it does not eliminate the need for a well-trained person to edit and review.
- amalcon 3y ago
  The editing and review part is critical. Judges really have not liked it when completely fictitious citations ended up in court filings...
- ExoticPearTree 3y ago
  You will need really trained people to review whatever the AI writes and also need to be able to check sources in case the AI hallucinates and starts referencing made up case law or precedents. So maybe paralegals will transform into reviewers or something similar.
  - namelessoracle 3y ago
    this is how document review works now basically. It used to be lots of lawyers got hired to go through the documents, now AI does it, and flags things for actual lawyer to review (along with suggestions), so what was the work of a couple of dozen lawyers is like maybe 2. this is one of the huge issues for the unemployed lawyer problem, as those jobs were the entry level for straight of school lawyers. I expect similar problems with dev roles coming soon.
Spooky23 3y ago
Worse, judges are writing decisions and evaluating cases based on this. The problem is that we’re going to have people litigating court cases and stupid bureaucratic nonsense within companies by lobbing nonsense that nobody has read at each other. Everyone will wink and nod, but these organizations and institutions will be exponentially more clueless. As technologists, it’s easy to shrug. What do you do when a judge takes your kid away after using an LLM to read and interpret bullshit generated case notes that a CPS worker generated with another LLM?
- deleted 3y ago
  [deleted]
- vmfunction 3y ago
  What you are describing has being happening for a long time in tech. It was suppose to make our life easier and do things we don't want to do, but has it? Seems like we are just become salves of digital technologies now days. Instead what we got instead are surveillance capitalism and now this LLM/AI stuff that becomes much better are emulating human behaviour and languages. UX in software has NOT improved, and I dare to say it has gotten worse. Just feel the performance of iOS 6 on iPod touch vs the lates iOS. Tech over quarter century has just tech getting more complex, and made more easily to centralised and consolidate control. Is this what we really want?
- jprete 3y ago
  Technologists are spectacularly bad at understanding how much the system relies on trusting that people will do something vaguely reasonable/legal/prosocial, just how that trust is built up and preserved, and how fragile that trust really is. A lot of Big Tech disruption and moneymaking has been based on ignoring this point to consume systemic trust without replenishing it.
- narrator 3y ago
  I think judges will continue to enjoy sanctioning lawyers for quoting fake cases. It's pretty easy to check if the citations are real or not. The legal system is not some API you can just spam with bullshit. There are serious consequences for doing that. The fun part comes when the Woke API refuses to make arguments for case law that goes against its woke programming.
ClarityJones 3y ago
> Lawyers being lawyers have immediately reached to "make it illegal" and setting up protections for their trade like they always done. The legal field does not have a strong cartel at the moment. In 1940 and in 1970, the population of lawyers was about .13-.16% of people in the US. Currently, it's 3x higher at .39%... after 3 years of declining numbers. The market is saturated. Large numbers of lawyers can't find enough work, or have moved to other fields. Edit: Link to report: https://www.supremecourt.gov/publicinfo/year-end/2023year-endreport.pdf https://www.supremecourt.gov/publicinfo/year-end/2023year-en...
- namelessoracle 3y ago
  Try setting up a business for something relatively minor like helping people contest a traffic ticket (no representing them in court) and see what happens. You dont need a full legal education to do basic contestation of traffic tickets, but the legal system requires it. There is a plethora of things that are minor, don't require going to court, and can be handled via bog standard forms and documents that are just "replace the names" and that lawyers have their paralegals do for them in their entirety. But the paralegal cant go into business on their own can they? What is the equivalent of the nurse who can get you antibiotics in the US legal system?
  - ceejayoz 3y ago
    > What is the equivalent of the nurse who can get you antibiotics in the US legal system? A paralegal. In about half the US, said nurse practicioner must be working under a supervising doctor, just like the paralegal works under a supervising lawyer.
    - namelessoracle 3y ago
      > In about half the US So there isn't one.
      - ceejayoz 3y ago
        Paralegals and NPs are similar in this regard in about half the country. NPs can independently practice - to some extent - in the other half. (You'll find a lot of paralegals coming very close to practical indepdendent practice, though. Supervision can be quite theoretical.)
amalcon 3y ago
Indeed. Legal documentations are much more shared-source than software, by nature. Most agreements need to be in the possession of multiple parties and their attorneys in a reviewable form, for example, and court filings make the most contentious of such agreements public record. This is a massive boon to the training data set. GitHub is also massive, but legal has other systemic advantages as well (e.g. being similar to past work is a structural advantage rather than just a practical one).

ryandvm 3y ago

Agreed. LLMs seem almost purpose built for the boilerplate part of legal work. "Read this user agreement and point out any unusual or particularly risky clauses."

CapitalistCartr 3y ago

Also using AI (ChatGPT) to write briefs, appeals, etc. Just edit. Saves a lot of time, which reduces the number of paralegals needed. This ship has already sailed. But it does not eliminate the need for a well-trained person to edit and review.

amalcon 3y ago
The editing and review part is critical. Judges really have not liked it when completely fictitious citations ended up in court filings...
ExoticPearTree 3y ago
You will need really trained people to review whatever the AI writes and also need to be able to check sources in case the AI hallucinates and starts referencing made up case law or precedents. So maybe paralegals will transform into reviewers or something similar.
- namelessoracle 3y ago
  this is how document review works now basically. It used to be lots of lawyers got hired to go through the documents, now AI does it, and flags things for actual lawyer to review (along with suggestions), so what was the work of a couple of dozen lawyers is like maybe 2. this is one of the huge issues for the unemployed lawyer problem, as those jobs were the entry level for straight of school lawyers. I expect similar problems with dev roles coming soon.

Spooky23 3y ago

Worse, judges are writing decisions and evaluating cases based on this. The problem is that we’re going to have people litigating court cases and stupid bureaucratic nonsense within companies by lobbing nonsense that nobody has read at each other. Everyone will wink and nod, but these organizations and institutions will be exponentially more clueless. As technologists, it’s easy to shrug. What do you do when a judge takes your kid away after using an LLM to read and interpret bullshit generated case notes that a CPS worker generated with another LLM?

deleted 3y ago
[deleted]
vmfunction 3y ago
What you are describing has being happening for a long time in tech. It was suppose to make our life easier and do things we don't want to do, but has it? Seems like we are just become salves of digital technologies now days. Instead what we got instead are surveillance capitalism and now this LLM/AI stuff that becomes much better are emulating human behaviour and languages. UX in software has NOT improved, and I dare to say it has gotten worse. Just feel the performance of iOS 6 on iPod touch vs the lates iOS. Tech over quarter century has just tech getting more complex, and made more easily to centralised and consolidate control. Is this what we really want?
jprete 3y ago
Technologists are spectacularly bad at understanding how much the system relies on trusting that people will do something vaguely reasonable/legal/prosocial, just how that trust is built up and preserved, and how fragile that trust really is. A lot of Big Tech disruption and moneymaking has been based on ignoring this point to consume systemic trust without replenishing it.
narrator 3y ago
I think judges will continue to enjoy sanctioning lawyers for quoting fake cases. It's pretty easy to check if the citations are real or not. The legal system is not some API you can just spam with bullshit. There are serious consequences for doing that. The fun part comes when the Woke API refuses to make arguments for case law that goes against its woke programming.

ClarityJones 3y ago

> Lawyers being lawyers have immediately reached to "make it illegal" and setting up protections for their trade like they always done. The legal field does not have a strong cartel at the moment. In 1940 and in 1970, the population of lawyers was about .13-.16% of people in the US. Currently, it's 3x higher at .39%... after 3 years of declining numbers. The market is saturated. Large numbers of lawyers can't find enough work, or have moved to other fields. Edit: Link to report: https://www.supremecourt.gov/publicinfo/year-end/2023year-endreport.pdf https://www.supremecourt.gov/publicinfo/year-end/2023year-en...

namelessoracle 3y ago
Try setting up a business for something relatively minor like helping people contest a traffic ticket (no representing them in court) and see what happens. You dont need a full legal education to do basic contestation of traffic tickets, but the legal system requires it. There is a plethora of things that are minor, don't require going to court, and can be handled via bog standard forms and documents that are just "replace the names" and that lawyers have their paralegals do for them in their entirety. But the paralegal cant go into business on their own can they? What is the equivalent of the nurse who can get you antibiotics in the US legal system?
- ceejayoz 3y ago
  > What is the equivalent of the nurse who can get you antibiotics in the US legal system? A paralegal. In about half the US, said nurse practicioner must be working under a supervising doctor, just like the paralegal works under a supervising lawyer.
  - namelessoracle 3y ago
    > In about half the US So there isn't one.
    - ceejayoz 3y ago
      Paralegals and NPs are similar in this regard in about half the country. NPs can independently practice - to some extent - in the other half. (You'll find a lot of paralegals coming very close to practical indepdendent practice, though. Supervision can be quite theoretical.)

amalcon 3y ago

Indeed. Legal documentations are much more shared-source than software, by nature. Most agreements need to be in the possession of multiple parties and their attorneys in a reviewable form, for example, and court filings make the most contentious of such agreements public record. This is a massive boon to the training data set. GitHub is also massive, but legal has other systemic advantages as well (e.g. being similar to past work is a structural advantage rather than just a practical one).