4 ms·
It would be pretty easy to filter for repos prior to such and such a date. Prior to 2022 would be a good place to start.
by jjallen 4y ago
It would be pretty easy to filter for repos prior to such and such a date. Prior to 2022 would be a good place to start.
- jwolfe 4y agoRight, but then your AI is frozen in time and/or requires much more manual curation of its inputs. What about for new programming languages, libraries, and APIs that are created after 2022? What about generating images of new technologies that are invented, or new landmarks established?
- mxmlnkn 4y agoThat would only apply to repositories. But to train these models, you need hundreds of terabytes of diverse data from the internet. Up until now a relatively straight-forward scraper would yield "pristine" non-AI-generated content but now you would have to filter arbitrary websites somehow. And getting the date of publication for something might be difficult or highly specific to a particular website and therefore hard to integrate into a generic crawler.