4 ms·
"Two dozen young people go through photos and videos, labeling just about everything they see. That’s a car. That’s a traffic light. That’s bread, that’s milk,
by pcurve 8y ago
"Two dozen young people go through photos and videos, labeling just about everything they see. That’s a car. That’s a traffic light. That’s bread, that’s milk, that’s chocolate. That’s what it looks like when a person walks."
But in the U.S., we do it for free via Captcha. ;-)
- baybal2 8y agoHave you noticed that Google captcha now has photosets from Chinese cities? I can only guess what Google offered Chinese in exchange for permission to use their camera vans. I guess, this is what their recent Chinese campus expansion was about.
- hnphillipj 8y agonever thought of this.
- linkingday 8y agoBut how does Captcha know that your answers are correct? There's likely already a predictive model that knows (within some confidence intervals) which ones are the 'correct' answers - someone had to label that data to begin with! Chicken, meet egg.
- joncrane 8y agoThey display the same pictures to multiple people and have some kind of agreement algorithm.
- oh-kumudo 8y agoFor Captcha, you are pointing out the one or several pictures that doesn't belong to certain category, so that seems to me the service needs to know the answer beforehand, doesn't it? It could be used for QA purpose though.
- agnokapathetic 8y agoDon't need ground truth for crowd-sourced annotation just need agreement between n-different users. 1 randomly present captcha to few known-safe/low risk users 2. Compare answers with answers from higher risk user's Captcha responses.
- iforgotpassword 8y agoBack when the captchas just showed two words, one of them was already verified while the other was not. So if you got the former wrong you failed, but for the other one you could type anything you wanted. The modern ones most likely work in a similar way.