3 ms·
Consider this, a legal firm rather than using a search mechanism to scan 100,000 documents for specific terms - could instead say something like: "You are an a
by dudeinhawaii 4y ago
Consider this, a legal firm rather than using a search mechanism to scan 100,000 documents for specific terms - could instead say something like:
"You are an auditor/lawyer looking for suspicious conversations or patterns of deceit by employees of company Z. I will feed you documents and you will give your analysis of each document or collections of documents. Pay special attention to X Y Z. Consider these sorts of actions as deceptive (a,b,c,d). If you find anything of note, create a summary of the findings in the form ['wording indicates deceptive intent', document 37, page 93].".
You'd then feed it 20 pages at a time and for less than $100 you've scanned a mountain of legal documents in a way in which you'd normally require a team of legal assistants and 100s of hours of work.
Again, I'm not a lawyer but I can conjure this very simple example that I could implement in a month if I had the time. At this point I think you're just squeezing me for ideas.
Perhaps you should explain what the technology is marketed as that you see as lying or misrepresenting. That would make this more productive.
- ChatGTP 4y agoKey problem being, you cannot trust that what you're getting is accurate information, which somewhat negates having such a tool in the first place.
- dudeinhawaii 4y agoI honestly haven't found hallucination to be a problem on GPT-4 when asking it to analyze or parse a dataset but can acknowledge it being possible (I just haven't encountered it). I think that if we consider the accuracy rate as measured in various ways being roughly that of a human, then you're trading human mistakes for AI mistakes in exchange for dramatically lower costs and a dramatically higher speed of processing. You might even say a higher level of reasoning. In my own interactions it's been fantastic at reasoning clearly and quickly outside of complex trick questions. Most scenarios in life aren't generally full of trick questions.
- ChatGTP 4y agoThis is why I've decided that I'm siding with the FTC on this product being a problem and that testing products on large swathes of the populace is a bad idea. To some up my experience with basically all these products...YMMV.
- nixlim 4y agoAs a lawyer with 13 years experience in my previous life, I can tell you that you can't trust a paralegal either. What it does do is give you the "first pass" - if I could automate the first pass over 100,000 pages and the AI highlights say 100 examples of the content I am looking for, of which say 10 are good quality examples of what I am looking for, then we are off to a very good start.
- nuancebydefault 4y agoHow many tools are accurate? Every tool needs guidance and quality checks. If you turn the knob of your light switch and you stay in the dark, you need to find out whether it is the switch, the bulb or the net is broken.