5 ms·
From reading the paper, GPT-4 also outperformed the researchers themselves in many categories, despite the researchers being the ones who created the dataset be
by hnaouesteuho 3y ago
From reading the paper, GPT-4 also outperformed the researchers themselves in many categories, despite the researchers being the ones who created the dataset being used to perform the comparison.
In other words, the metrics are biased in the researchers’ favor — so GPT-4 would have beat them even more often (probably a majority of the time based on the numbers), if someone else had created the guidelines and golden labels.
- ratg13 3y agoConsidering there are over half a million texts, can you really expect a researcher to be familiar with all of them?
- bequanna 3y agoWith the current unskilled labor shortage driving wage increases which pushes inflation up, this seems to be arriving just in the time.
- flandish 3y agoJust a small point of order: there is no such thing as “unskilled labor” - All labor is skilled labor. Even breaking rocks.
- pindab0ter 3y agoLabour for which no higher education is required, then?