2 ms·
Data quality matters for training, at least as much as quantity.
by HPsquared 2y ago
Data quality matters for training, at least as much as quantity.
- bunderbunder 2y agoA possible counterpoint here is The Unreasonable Effectiveness of Data by Halevy, Norvig and Pereira. https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/35179.pdf https://static.googleusercontent.com/media/research.google.c... Say what you will about the merits of this paper, it's hard to deny that it has been influential within the deep learning community.
- rolisz 2y agoThat's a bit outdated. At the scale LLMs are trained, quality starts to matter again.
- charlieyu1 2y agoThe pay that workers earn suggest otherwise
- vidarh 2y agoThere's AI annotation work paying into the $100+/hour range. Not nearly as much as at the lower rates, but the amount in the $20-$40/hour range might surprise you. (been offered contracts, have done some on the top end of the market, have access to data on some of the volume on the lower end)
- charlieyu1 2y agoCan’t found anything near that, $40 for expert roles is the most common I find. I worked with one of these vendors, and the working condition is so horrible that people who are actual experts would not tolerate