3 ms·
"The researchers had the deep learning machine and 200 human subjects at Amazon’s Mechanical Turk crowdsourcing facility answer the same verbal questions. The r
by purpled_haze 11y ago
"The researchers had the deep learning machine and 200 human subjects at Amazon’s Mechanical Turk crowdsourcing facility answer the same verbal questions. The result: their system performed better than the average human."
Mechanical Turk represents the average human?
And did they just ask the Turk subjects whether they had a bachelor's or master's degree or not as proof that they had bachelor's or master's degrees? Could you count on that being accurate?
- swiley 11y agoIt's what most employers do.
- retbull 11y agoI don't think they rated it against the Turk subjects, I think the Turk subjects were used to train the AI and it got a score of between 115 and 120 which is what you should have on average if you graduate with a bachelors degree.
- blisterpeanuts 11y agoIf you match up the best AI systems against the bottom 25% of the U.S. population, the humans won't come out looking too smart. AI might still fail the Turing test at least some of the time, but it's getting a little scary.