So the author decided to rely on "Crowdsourcing"... without actually building any of the features needed to make crowdsourcing work... and was surprised at the

So the author decided to rely on "Crowdsourcing"... without actually building any of the features needed to make crowdsourcing work... and was surprised at the outcome? He appears to have supplied the task as a wide open Drawball or Google Docs type interface. This is great if you have some lasting leverage over the participants (such as "I can punch them in the face" or "I can fire them"), but otherwise some form of advanced moderation (Wikipedia with moderator bots) would be step zero, and a validation process would be step 1. The possibilities for, eg, anonymous drawings of dongs, are early and obvious in any open system, to the point that I start out collaborative document editing sessions in gaming by telling people to get it out of their systems at the beginning. Mechanical Turk is great, but the cost of paying people <$1/hr is you have to assume some percentage of them are unreliable or bots just trying to make money (if not actively malicious), and designing this expectation into your workflow is nearly the whole task at hand. There will be some multiplier where you pay for c*N hours of labor in order to perform N hours of work. Randomized peer review methods combined with long-term engagement can keep c quite low, far lower than management expenses in an enterprise, but it will always be greater than 1.