5 ms·
> One of the few things I can currently see GPT do well is helping find legal precedence. GPT is really not good at finding anything, and actually it can't fin
by flanked-evergl 4y ago
> One of the few things I can currently see GPT do well is helping find legal precedence.
GPT is really not good at finding anything, and actually it can't find anything. It is not designed to do that. It is designed to make things up.
The difference may be subtle, but it is quite important. GPT makes up APIs, citations, tools, papers and rules. It makes up anything really. What it makes up is incredibly plausible, as it was trained to be as plausible as possible, to the point of being correct most of the time, but it still is just making things up.
If you use it with some different expectation you will be disappointed.
- vasilipupkin 4y agoI keep seeing comments along these lines. It doesn’t “make things up”. It outputs text under the objective function of maximizing probability of the token being outputted as “making sense” on some criteria. So, actually, it is biased towards not making things up. Occasionally, it hallucinates. I suspect we’ll see subsequent versions hallucinate less and less.
- bryankaplan 4y agoSo what you're saying is it makes things up.
- vasilipupkin 4y agoIt occasionally does. But it’s biased against it. It doesn’t make things up as it’s default behavior.