4 ms·
79 passed. This was an extremely basic multiple choice test. It makes one wonder how the other 4,581 were smart enough to operate a web browser in t
by bad_user 16y ago
79 passed. This was an extremely basic multiple choice test.
It makes one wonder how the other 4,581 were smart enough to
operate a web browser in the first place.
I stopped reading right there.
As for the question itself, that's simple: people come for the money, and since "Turkers" are paid pennies for those tasks that means they have to do a lot of them; so replying randomly on a test is a no-brainer (I wouldn't even bother to click and type and just write a script).
It's a good thing we've got these magazines reminding us how we are so smart and the rest of the world is so stupid. What would I do without my over-inflated ego?
- thorax 16y agoOn my surveys on MT I ask things like "Why did you choose this answer?". I also made a little script library to record the times they enter answers in fields. I throw out any that appear to be scripted or were so rapidly answered as to not have been a real answer. At the price per HIT I paid (0.08 to 0.15), I only had to throw out 2-3 answers out of ~2000 due to someone trying to reply randomly.
- roqetman 16y agoI'll bet that there are language issues involved as well (with many of the "Turkers" not having English as a first language.
- LiveTheDream 16y agoIf you had kept on reading, you would have seen that the article specifically identifies low wages as a likely cause for the low quality.
- bad_user 16y agoYes, but why keep reading an article that insults people ... the reason for the low accuracy was not the point of my comment. My own father is "not smart enough" to operate a browser. Lack of English skills don't help him. But he can read French and Russian just fine, he has a Ph.D in his profession and a carrier in politics (former advisor to the prime minister, currently a senator in a eastern-European country).
- cullenking 16y agoIf you read the paper, you are correct. It states that after surveying the people taking the test, that they came to the conclusion people just answered, hoping to get access to tasks as fast as possible. Also, the paper says 1658 passed, but probably only 79 passed with > 90% accuracy?