Indeed, Panos's remarks are spot-on here. Reputation and quality management on small amounts of work are really only the smallest problem in crowd computing, an

Indeed, Panos's remarks are spot-on here. Reputation and quality management on small amounts of work are really only the smallest problem in crowd computing, and have been artificially created by the lack of simple reputation systems in broken markets like Turk. This is one reason why next-generation crowd platforms like our own, MobileWorks, (and for that matter, why users of crowd platforms) should make use of a high-quality workforce as a starting point, rather than as their ultimate goal. Once you assume that you have a high-quality workforce, a host of other problems become more relevant and valuable. - How can we make it simple for a user to specify their tasks in a way that crowd workers can understand? - How can we use crowds to solve arbitrary tasks, rather than a limited range of tasks? - How can we give back responses in real time? One of the reasons that MobileWorks (www.mobileworks.com) has been so effective as an alternative to Mechanical Turk is that it goes beyond reputation to address these problems.