I have used a mechanical turk tool to do usability testing, this type of qualitative feedback would probably not do very well on there. People doing mechanical

I have used a mechanical turk tool to do usability testing, this type of qualitative feedback would probably not do very well on there. People doing mechanical turk have one goal, to complete your task as fast as humanly possible, even when laid out fairly concrete steps you end up with a lot of feedback that isnt necessarily useful, either because they purposefully skipped it or there was communication issues or they just decided it wasnt time efficient. I know mechanical turk has a feedback mechanism, but there is so much signal to noise that we found it much more useful to go and meet real people.