3 ms·
I've used Mechanical Turk in the early days but developed my own version for my vertical to manage freelancers. The problem as I see it is verifying the work i
by dubeye 1mo ago
I've used Mechanical Turk in the early days but developed my own version for my vertical to manage freelancers.
The problem as I see it is verifying the work is not done by AI. If it was possible to verify somehow that the work is definitely not done by AI I think there would still be a market for this. But the data just cannot be trusted.
An increasingly big part of my job is to try and weed out workers who use AI and it's not an easy task at scale because generally workers gain trust with manual work and then there is degradation over time.
- inemesitaffia 1mo agoOutsourcing shops? Proctoring? Locked down devices?
- dubeye 1mo agoI suppose it depends on the value of the individual task. I can't imagine it's really realistic to lock down devices of mechanical Turk workers in such a way that ai use can be monitored. In any case Locking down devices isn't really pragmatic at scale for relatively low value tasks, and also introduces complexity about employment law where I am.