3 ms·
Good news for you: being your target audience, we actually did have you guys on our radar.I For the scale of our project, however, the price point was prohibit
by stingraycharles 4y ago
Good news for you: being your target audience, we actually did have you guys on our radar.I
For the scale of our project, however, the price point was prohibitive.
We ended up building a small cli tool that interactively trained the model, and allowed us to focus on the most important messages (eg those where positive/negative sentiment was closest, the labels with the smallest volume, etc).
EDIT: If I now look at your website, it seems like you’ve also just provide good tooling for doing these types of things yourself? If that were the case, I wouldn’t mind having paid $50-$100 for a week of access to such a tool. But $20/hr to hire someone who classifies data which we would still need to audit afterwards was too much for us.
- Aeolun 4y ago$20/hour to classify data sounds reasonable though? If you have more time than money it might not make sense, but at that price point I could save myself a lot of time by just working a few extra hours doing SE and let someone else do 3x that amount of labelling.
- stingraycharles 4y agoI fully agree $20/hr is reasonable, it just was too expensive for us at that time. So in the end the whole problem boils down to “quality is (more) expensive”; but MTurk is a special case since they’re so heavily positioning themselves as “the” solution for this and they’re terrible.