3 ms·
That's why the major AI labs are really careful about the code they include in the training runs. The days of indiscriminately scraping every scrap of code on
by simonw 10mo ago
That's why the major AI labs are really careful about the code they include in the training runs.
The days of indiscriminately scraping every scrap of code on the internet and pumping it all in are long gone, from what I can tell.
- fooker 10mo agoDo you have pointers to this? Would be a great resource to understand what works and what doesn't.
- simonw 10mo agoNot really, sadly. It's more an intuition knocked up from following the space - the AI labs are still pretty secretive about their training mix.
- jacquesm 10mo agoWell, if as the OP points out it is 'all garbage' they don't have a whole lot of choice to discriminate.