3 ms·
> While some of this is for annotation and ratings on data that came from the web or LLMs, they also create new training data whole-hog: The article states tha
by sdfgtr 2y ago
> While some of this is for annotation and ratings on data that came from the web or LLMs, they also create new training data whole-hog:
The article states that this human data is PhDs, poets, and other experts but my recollection from some info about programming LLM training is that there was a small army of low paid Indian programmers feeding it with data.
Even if it's actually experts now I have to wonder when that will switch to 3rd worlders making $1/hour.
- deleted 2y ago[deleted]
- stefan_ 2y agoI love the marketing upstart attitude, but indeed, the reality of "PhDs, poets and subject matter experts expanding the frontiers of AI" is much more likely to be the "Amazon cashierless supermarket" experience. The problem with hiring that group of people is presumably that they are not poor enough to lack ambition in their career, which every dummy can spot from miles away is an utter dead end feeding some LLM.
- XorNot 2y agoIsn't it just curating an encyclopaedia though? The point is that LLM training is moving from "suck down the internet" to "consume an annotated and contextualised reference of the library of Congress". The difference between trusting 5 random people to tell you how they think quantum mechanics works versus asking 5 presently publishing physicists.
- deleted 2y ago[deleted]
- jamilton 2y agoHere are the job postings from the mentioned company, Outlier. https://boards.greenhouse.io/outlier https://boards.greenhouse.io/outlier
- fewald_net 2y agoThank you for sharing the link. I got curious and clicked on one. They want programming skills and pay “up to $30/h”.