4 ms·
It's probably already superhuman? That's... one interpretation of GPT. I interpret it quite differently. Unless you're going to say that computers were alrea
by AnimalMuppet 4y ago
It's probably already superhuman? That's... one interpretation of GPT. I interpret it quite differently.
Unless you're going to say that computers were already superhuman? They could do arithmetic far faster than any human ever could. Also pure logic. Chess and go, even. Were they superhuman then?
Because as I look at GPT, I don't see superhuman. I see a babbling idiot that babbles in correctly-constructed English sentences, but has no idea what it's talking about, and that manages to be factually correct... maybe 70% of the time? (That's hard to measure, because the universe of possible discourse is really large.) And, worst of all, GPT has no idea of when it doesn't know something, but will irresponsibly blurt out... something. Something random that its training set made it think is the least-implausible thing to say right there.
You know, if they could just fix that - if they could add some kind of weight so that it knows when it's getting into an area that it doesn't have adequate training data for, and program it to express uncertainty rather than certainty in something wrong - that one change would make it, still not superhuman, but at least much more useful.
And, if we could do that, maybe we could do one more step. If it has more than one strong possibility, but they are contradictory, then there's contradictory data in it's training set, and it's likely dealing with something controversial rather than certain.
I know, I know. Everything is easy to the one who doesn't have to do it. It's probably much harder than I said. But I think that's what GPT needs going forward.
- deleted 4y ago[deleted]
- ctoth 4y ago> and that manages to be factually correct... maybe 70% of the time? Do you update on this when considering that GPT-3 got in the bottom 10% in several exams, whereas GPT-4 is now in the top 10%? Do you not see this clear improvement as evidence that it's just a matter of time?
- AnimalMuppet 4y agoClear evidence of improvement? Sure. Evidence that it's just a matter of time? Time will tell. Evidence that it's already superhuman (the original claim)? Very much no. Only in the top 10% isn't superhuman.
- ctoth 4y agoTake a look at the GPT-4 paper, and the list of exams and accompanying scores. Then tell me if you know any humans that did similarly? Looks superhuman to me. Especially considering it took all of these in less than a year.
- thomastjeffery 4y ago> Something random that its training set made it think That's the mistake right there. It didn't think. The text did. Specifically, humans encoded thought into language, and encoded language into text. GPT modeled the patterns from that text, and used those patterns to restructure it. Because language is the most dominant pattern, blindly following an inference model is very likely to result in correct language transformations. Because people don't write nonsense, the result of a correct language transformation is very likely to make sense.
- AnimalMuppet 4y agoYou missed the point there. When the information isn't in the training corpus, then GPT still generates... something. It's not in the text, but GPT's weights show something as the best correlation. Sometimes it's mining connections that the authors didn't even realize were there. And sometimes, it's following random correlations that don't mean anything, and as a result it's generating nonsense.
- thomastjeffery 4y agoIt is in the text. It's not the same shape, location, or order because GPT followed a complex pattern to "generate" the continuation. None of the tokens are new. > Sometimes it's mining connections that the authors didn't even realize were there. Exactly. GPT is not limited to modeling patterns that align to language. It models every pattern it can find. Text contains so much more than language: it contains powerful implicit patterns of behavior; and GPT proves that by modeling them.
- meh8881 4y agoI asked it to create a portmanteau insult for GPT doubter on hn and got GLTard or GPTSlother when asking for an animal one. I suspect you are not right. It also advised against name calling Edit: wrong in regards to no new tokens
- AnimalMuppet 4y agoBut it will also confidently tell me who won the 2023 NCAA tournament. It did not find that in "implicit patterns of behavior". It made it up from patterns in the text, but the answer was not there. At best what was in the text was projections, opinions, guesses. GPT takes all that in, but it's not actual information to answer the question, because there is no answer - not yet. So it finds a pattern, but a pattern that is not the answer. But it gives it as the answer, with full confidence.