8 ms·
Expert systems and the legal world
- soapdog 5y ago
- christkv 5y agoCompletely agree, hard no
- eru 5y agoAny comment on why?
- coldtea 5y agoOur experience with expert AI in other fields, from the Clippy to modern social media and government applications?
- eru 5y ago'Expert systems' are a rather special kind of 'AI'. I don't think eg any modern social media uses them much. See https://en.wikipedia.org/wiki/Expert_system https://en.wikipedia.org/wiki/Expert_system They were mostly popular in the 1980s, but never really went anywhere. Contemporary AI approaches tend to be much more statistical.
- t_mann 5y agoSounds like a mundane way of saying "let's create more templates so we can direct customer requests to callcenter agents who don't know anything about the enquiries they're dealing with (and probably even try to replace those humans with chat bots / online forms)". Perhaps being a bit cynical here, but I'm not really optimistic about the UX that's going to create for regular customers.
- igorkraw 5y agoMight be a European perspective, but I wonder how much a "right to speak to a human" would improve Bit UX as a 2nd order effect. Like, after a certain amount of revenue, your 1st level support needs to be able to be able to( or forward you to someone who can) do every possible interaction that is possible on your system, within 5 or 10 minutes median waiting time, with some simplicity constraints on basic things like cancellation (including a ban on upselling, delays etc), written with a "spirit not letter" style like GDPR. Either make a very expensive callcenter or a good UX
- t_mann 5y agoI think the problem there is that talking to a human per se doesn't help much, if said human isn't qualified (and that might be for reasons as simple as not speaking/understanding your language sufficiently). I've had interactions with human call center agents for things as simple as rebooking a flight that could have been taken straight out of a Kafka piece.
- Ekaros 5y agoYeah, first the human have to understand the problem. Then they must have capability and rights to solve it. Want to solve it might be less important. But the metrics driven environment we are means they sometimes aim is not to fix issue, just have it look right in metrics.
- netfl0 5y agoThis is the current reality, except the templates are generated by ML, and they are impossible to debug or explain. The UX opportunity is how you apply information from the system. You can’t just accept the output as it is.
- t_mann 5y agoTemplates generated by ML? Do you have any links to examples/explanations of how that works? I'm incredulous, why would one even think of doing that? The high frequency task is whatever the template is supposed to solve, not creating it. What would you even use to train the model (unless it's an OpenAI/DeepMind-level of general language model that can create a form from your verbal instructions, but talk about cracking nuts with sledgehammers)?
- coldtea 5y agoLet's not.
- sega_sai 5y agoI think if the set of rules underpinning an expert system is explicitly written down and available to everyone, and if it is possible to appeal your decision and request a human review, I don't mind this.
- mannykannot 5y agoThat is a reasonable position, but I don't think things are likely to work out this way. Companies have various more-or-less self-serving reasons to keep their decision-making process hidden. They will persuade policy-makers that unless they are allowed to keep this information 'proprietary', then 'society' (read: themselves) will not be able to reap the benefits of this technology. The next step is that the cost of having humans resolve problems becomes 'prohibitive', so any meaningful process of redress is removed through the use of one-sided 'agreements.' Just look to the big social media companies and telcos to see what can happen when decision-making is automated.
- jeroenhd 5y agoI'll trust expert systems when I have access to the documented source code of the decision making process after the fact. With modern AI, that's practically impossible because machine learning has replaced manual algorithms in this space ages ago. Even without AI, companies like these don't like to hand out their source code, so you wouldn't be able to trust them anyway. Programmers are not lawyers, no matter how hard we pretend to be sometimes, and unless every programmer on this project was also a judge I wouldn't trust it to advice or make any judgement. You're not going to find judges who happen to run a startup as a side-gig anyway, so let's just bin the idea. Automated systems are great at reducing the human factor in a lot of things. For stupid factory work where human minds can be put to much more useful tasks, that's great. For the legal system, no thank you.
- nonrandomstring 5y ago> I'll trust expert systems when I have access to the documented source code of the decision FWIW, that's precisely one of the things ES are designed to do, to backtrack and introspect, to explain their decision making. (I did a module on expert systems (blackboard models) back in 1988 when they were a hot topic)
- melony 5y agoThat only applies to tree search GOFAI expert systems. If somebody strings together one using for example a BERT model for the language generation and another neural network for the reasoning, then the guardrails are no longer in place.
- AnimalMuppet 5y agoIf a neural network is doing the reasoning, is that still an "expert system" (as the term is used in AI)?
- eikenberry 5y agoThen that is no longer an expert system. Expert systems are systems that capture the expertise of people in rule form, they are GOFAI by nature. If it is using neural networks instead it is not an expert system.
- jasonhansel 5y agoHere's a question: instead of using expert systems to write a contract, could you just write a contract that refers to a form that can be filled out by someone without legal expertise? For instance, instead of using an expert system to generate a contract that says "Alice will pay Bob $2000 a month in rent, plus utilities," you could write a contract that says "The party listed on line 1 of the attached form will pay the party listed on line 2 of the form the amount listed on line 3 of the form; if the checkbox on line 4 of the form is checked, then the first party will also pay for utilities." Then the attached form could look something like this: 1. Name of tenant: _______ 2. Name of landlord: ______ 3. Amount of rent: $_____ 4. [ ] Check here if tenant pays for utilities That solution would seem to be much more efficient and transparent than using an expert system; essentially, the "templating" is being done by the judges and/or lawyers reading the contract, not by an expert system writing one. Edit: of course any such contract might contain a lot of "conditional logic" that would only apply in very specific circumstances and thus would prove irrelevant for most users. But although the contract would be long, you'd only need to write it once, and there would only be one copy to maintain.
- allan_s 5y agoYou've described exactly what the company where I was previously working was doing in france for small company owners legalstart.fr basically you answers a questionnaire (with conditions betweens questions like "ask this question only if A and B are both physical person with revenue < 20000 euros a years") and at the end these answers are used to generate a template (with things like "put this paragraph as many times as they are people involved" ) the templates and questionnaires were made once (and updated every once in a while when law changed) by a specialist.
- jasonhansel 5y agoInstead of using templates to generate a contract based on questionnaire answers, my idea is to use a single unaltered contract that refers to the questionnaire answers provided as a separate document. One could even imagine those "universal contracts" being open-source, if you could find a business model.
- mark_l_watson 5y agoI was disappointed that the article didn’t mention which tools were used. In the 1980s I did a lot of hacking on OPS5, specifically modifying the Rete Network for multiple data worlds, etc. I really enjoyed that but in present time most of my work experience is in deep learning. I am keenly interested in hybrid AI.
- aaron695 5y agoWriting an expert system was a high school assignment decades ago. Why would it work now after 60 years of not working? Experts haven't changed. The software is simple. Creating expert systems are easy in a child's head, that's why it's a good school assignment, they get to see how quickly it gets out of hand. It's the same as the Semantic Web. Just making a cake is too hard, why is that not online if expert systems are possible? Substituting butter for vegetable oil, how much, what sort of vegetable oil, does that work for all cakes? Is it 10% worse as a cake. Do some culture actually like it better one way. Do kids care. Moist or dry matter. How do you translate measurements to stop getting silly results for empirical to metric. This article and webcast doesn't actually say there exists a working expert system. It will stay that way. Search is what has filled this gap. Maybe someday it will be AI (Outside of the AI in search)
- dreamcompiler 5y agoExpert systems tend not to scale very well. Once you get beyond $some_threshold rules, the decision algorithms get slow and the rules start conflicting with each other. What's needed is a meta-rule system that works during the knowledge capture phase to keep the rule set consistent. Lots of work was done on this problem in the late 80s/early 90s but I don't know what the current SOTA is since expert systems fell out of fashion. I'd expect it to be fairly straightforward to maintain a consistent rule base with modern computers that are 1000x bigger and faster than those of the 80s.
- AnimalMuppet 5y ago> I'd expect it to be fairly straightforward to maintain a consistent rule base with modern computers that are 1000x bigger and faster than those of the 80s. Maybe not. Maybe they'll just be used to create a rule base that is 1000x bigger than those of the 80s, and you'll still have trouble maintaining consistency.
- mark_l_watson 5y agoThe Rete algorithm used in OPS5 scales as O(N) where N is the number of rules - which is good. However, it scales as O(D^2) where D is the number of working memory facts.
- z3c0 5y agoThey do exist already, just not as widespread as I imagine the author is hoping to see. I work for one of the only software vendors in the space. One place where I've seen an expert system excel greatly is in automated billing resolution. Legal bills are often handled by third parties who maintain the billing contracts between a law firm and it's hiring party (who are often just other lawyers). What can and can't be billed for is usually determined by an exhaustive set of rules defined in the contract, and invoices are usually fed into a variety of out-of-date web forms. The task isn't cut-and-dry enough to automate via ML, other than small NLP tasks, so the system relies on a long list of hard-coded conditions managed by a swarm of bots that fail quickly and loudly to call out entry errors. It sounds messy, but it works very well, and the errors aren't muddied by a black box.
- EarlKing 5y agoExpert systems will be welcomed right up until the point where they start making the legal profession look incompetent. Vide what happened with MYCIN in the medical community if you need a refresher course on how this is going to go down.
- chartpath 5y agoMaybe the new generation of young lawyers will be running virtual firms this way and serving a much higher volume of clients for cheaper. There is a huge untapped market of those who need services for black letter issues but can't afford it.
- deleted 5y ago[deleted]