I found this very interesting, regarding crowdsourcing the training data: "After the first pass I had enough verified data that I was able to add an automatic

I found this very interesting, regarding crowdsourcing the training data: "After the first pass I had enough verified data that I was able to add an automatic accuracy checker into both tools for future data runs (it would periodically show the user known images and check their work to determine how much to trust their answers going forward)."