3 ms·
GPT-4 generally performs better than expert human workers on NLP tasks, nevermind bespoke models. https://www.artisana.ai/articles/gpt-4-outperforms-elite-crowd
by famouswaffles 4y ago
GPT-4 generally performs better than expert human workers on NLP tasks, nevermind bespoke models. https://www.artisana.ai/articles/gpt-4-outperforms-elite-crowdworkers-saving-researchers-usd500-000-and-20#:~:text=Item%204-,GPT%2D4%20Outperforms%20Elite%20Crowdworkers%2C%20Saving%20Researchers%20%24500%2C000%20and%2020%2C000,about%20the%20future%20of%20crowdworking https://www.artisana.ai/articles/gpt-4-outperforms-elite-cro....
- rolisz 4y agoThe article you linked says that GPT4 performed better than crowdsourced workers, not than experts. The experts performed better than GPT4 in all but 1 or 2 cases. And in my experience with Mechanical Turk, the workers from MT are often barely better than random chance.
- famouswaffles 4y agoFair on the wording I suppose but First of all, the dataset used for evaluation was created by those researchers, weighing it in their favor. Second, GPT-4 still performs better in 6 of those. Hardly 1 or 2. And when it doesn't, it's usually very close. All of this is to say that GPT-4 will smoke any bespoke NLP model/API which is the main point.