7 ms·
That weird "conspiracy theory" doesn't make any sense. LLMs are trained off a static dump of example data, and it's trivially easy to build a webscraper of Redd
by hn_throwaway_99 3y ago
That weird "conspiracy theory" doesn't make any sense. LLMs are trained off a static dump of example data, and it's trivially easy to build a webscraper of Reddit's historical content.
- buildbot 3y agoIt's trivially easy to build a scraper for the new content too. And I think people really over estimate the relative amount of data reddit has compared to the literal rest of the internet. Like sure, it's nicely categorized and ranked (somewhat), but leaving reddit out of a corpus probably won't drastically effect your final model.