4 ms·
> and that manages to be factually correct... maybe 70% of the time? Do you update on this when considering that GPT-3 got in the bottom 10% in several exams,
by ctoth 4y ago
> and that manages to be factually correct... maybe 70% of the time?
Do you update on this when considering that GPT-3 got in the bottom 10% in several exams, whereas GPT-4 is now in the top 10%?
Do you not see this clear improvement as evidence that it's just a matter of time?
- AnimalMuppet 4y agoClear evidence of improvement? Sure. Evidence that it's just a matter of time? Time will tell. Evidence that it's already superhuman (the original claim)? Very much no. Only in the top 10% isn't superhuman.
- ctoth 4y agoTake a look at the GPT-4 paper, and the list of exams and accompanying scores. Then tell me if you know any humans that did similarly? Looks superhuman to me. Especially considering it took all of these in less than a year.