4 ms·
We've needed a crowd-sourced human testing platform for software products for some time. It would need granularity: as a developer I should be able to purchase
by cantlin 14y ago
We've needed a crowd-sourced human testing platform for software products for some time.
It would need granularity: as a developer I should be able to purchase N minutes of time from N people, potentially in such and such a demographic.
It would need an API: I should be able to build human testing into my deployment infrastructure.
It would need accountability: at minimum I want webcam footage of the tester using my product.
There are complications, but I see no reason why almost all of these couldn't be overcome by sufficiently smart automation.
Someone go build this!
- darkmethod 14y agoIf https://www.usertesting.com https://www.usertesting.com had an API, I think it would handle the majority of the points you listed. UserTesting may already have one, however my brief two minutes of poking around didn't reveal that they do.
- anandkulkarni 14y agoWe actually do this at MobileWorks (mobileworks.com). There's an API that lets you get N minutes from N people filtered by demographic. Some folks use our Premier product for on-demand testing set up by email -- they send test requests to premier@mobileworks.com. If you're looking for this more as a formal end-to-end service, you can take a look at our buddies at Rainforest (https://www.rainforestqa.com/ https://www.rainforestqa.com/). You can also look at services like uTest, though they're real pricey.
- cantlin 14y agoThanks for that - Rainforest look very interesting (what I can see of it). "QA as a service" sums it up nicely.
- bengl3rt 14y agoSome friends of mine have actually made a business out of this over at http://testloft.com http://testloft.com From what I understand the phone won't stop ringing so clearly there is strong demand for something like this out there.