3 ms·
It was bootstrapped from SO. Now there are third party data companies like Scale AI that pay gig workers to write code examples for LLM training. It's died down
by andy99 1y ago
It was bootstrapped from SO. Now there are third party data companies like Scale AI that pay gig workers to write code examples for LLM training. It's died down but I saw lots of spam for this (ie hiring) earlier in the year.
Sota LLMs didn't get that way by scraping the internet, it's all custom labeled datasets.
- asdff 1y agoI guess that means AI isn't relieving us of our jobs then. Model must ingest ever more experimental data. Full circle.
- golergka 1y agoNo, at this point it can just ingest official library documentation and produce good SO-like answers.
- asdff 1y agoToo bad library documentation has taken a nosedive for a lot of modern tools. I blame all those automagic documentation/packaging tools that take some 2 line string and your args for each function and turn it into a boilerplate documentation page. You truly learn nothing you wouldn't by just looking at the source code of the function for pages generated like this. The author spends no additional time adding potentially useful information. A far cry from what you get when you man bash for example, where they even teach you how to file a bug report.
- Shorn 1y agoPlus, they're getting real world training data from everyone who either hasn't or doesn't have the ability to opt out of their stuff being used. For my personal stuff, I don't opt out of training for this very reason. What's more, I resent Stack Overflow and Reddit etc. trying to gate-keep the content that I wanted to give to the community and charge rent for it. I used to intentionally post question-answer style posts where I would both ask the question,wait for a while, then answer the question on both Reddit and Stack Overflow. I don't do that anymore because I'm not giving them free money if they're not passing some of the benefit on to the community
- ack_inc 1y ago"... resent SO and Reddit trying to gatekeep": Am curious why you felt they were gatekeeping your content. They are free websites, and anybody who wants/needs to read your content, can. "... not giving them free money if they're notnpassing some of the benefits ..." - Could you expand on the specific benefits you wanted them to pass on to the community? As a user, being able to find other people's content that is relevant to my current need is already a pretty solid benefit.
- miltonlost 1y ago> For my personal stuff, I don't opt out of training for this very reason. What's more, I resent Stack Overflow and Reddit etc. trying to gate-keep the content that I wanted to give to the community and charge rent for it. And AI companies don't charge for their stuff and charge rent?
- Jensson 1y agoNo, no publicly available model can do that, why do you think so?
- nudgeOrnurture 1y agoso you have to ask on SO how to train that into your custom model running on Ponzimbda's hAIrdware
- stuaxo 1y agoUnless you pay decent rates the code will be shite, otherwise outsourcing to underpriced developers would have worked in the last push to rid businesses of the expense of skilled developers.