3 ms·
Where are you seeing GPT-4? All I see is "compares favorably with GPT-3.5 for some tasks".
by SparkyMcUnicorn 3y ago
Where are you seeing GPT-4?
All I see is "compares favorably with GPT-3.5 for some tasks".
- dan-g 3y agoThe post mentions GPT4All benchmarks—maybe that’s where the confusion lies? https://gpt4all.io/ https://gpt4all.io/
- bbatsell 3y agoThe benchmarks towards the bottom are of ChatGPT-4, according to the footnotes.
- deleted 3y ago[deleted]
- rnosov 3y agoThe report cites both GPT-3.5 and GPT-4 scores on page 7 [1]. I've checked the numbers and they compare FreeWilly2 to GPT-3.5. For example, HellaSwag score of 85.5% corresponds to GPT-3.5. [1] https://arxiv.org/pdf/2303.08774v3.pdf https://arxiv.org/pdf/2303.08774v3.pdf
- courseofaction 3y agoThe footnoted papers mention GPT-4 in the title. Unless they're citing GPT3.5 results from papers with GPT-4 the name, which seems confusing.
- lgas 3y agoThere are no actual footnote marks that connect any statements in the post to the footnotes, so there are no specific claims referenced. But if you read the actual text of the page, they say it compares favorably to 3.5 for some tasks. Which means it falls short of 3.5 for the rest and GPT-4 for all of them, or else they surely would have mentioned that as well.