4 ms·
I've written software to replace this type of thing, in my case it was classifying communications as to whether they were attorney-client privileged or not. It
by fleitz 16y ago
I've written software to replace this type of thing, in my case it was classifying communications as to whether they were attorney-client privileged or not. It has to be cheaper, it was about a month of my time. And about a week working with a high priced lawyer to write the ruleset and confirm it caught everything and was excluding all the right stuff. With that software they've essentially got their best lawyer going through every piece of communication.
It has to be cheaper, I can't imaging paying someone with a law degree to go through all of that. And now their lawyers are freed up to do something more useful.
- sandGorgon 16y agois it possible for you to mention, how you went about doing this ? technology stack, algorithmic approach, etc.
- fleitz 16y agoTries for text search, that's really the only thing I learned is that if your searching through a body of text for 40,000 odd keyword you need to turn the document in to a trie. But that's something you'd learn as soon as you read any of the research on the topic. It's basically a programming language for text search that's stored in a database. If I had to do it again I'd base if off a parser-generator and use a DSL, possibly using git for versioning. I ended up basically storing an AST in the db and then creating an object for each node in the decision tree. It was written in perl but that was more of a constraint than a choice.
- kovar 16y agoTake a look at the TREC (Text REtrieval Conference) website - http://trec.nist.gov/ http://trec.nist.gov/ . The published papers are very enlightening.
- deleted 16y ago[deleted]