3 ms·
So far I have not seen any of the operators proposing what seems to me to be the obvious solution: sell this data set in a machine readable format for cheap to
by aftbit 2y ago
So far I have not seen any of the operators proposing what seems to me to be the obvious solution: sell this data set in a machine readable format for cheap to the biggest scrapers.
- MattDaEskimo 2y agoIt would have to be aggregated data that's constantly updated if it were to be anywhere competitive to just simply scraping the page.
- UncleEntity 2y agoPlus, the "biggest scrapers" have shown their unwillingness to pay for content.
- aftbit 2y agoYes, presumably the approach would be to publish both a current dump of all of the databases every week or month, as well as a daily diff. Even better if it were just given away for free. The challenge would be around monetization and licensing. Even if you only published e.g. the kernel mailing list archive in this way, I could see someone like OpenAI turning around and suing to claim that you had given them copyright over that content rather than just providing the content itself.
- deleted 2y ago[deleted]
- immibis 2y agoLots of sites have been trying to do this, but they're fighting a losing battle because the AI companies can get the same data for free.