2 ms·
Infrastructure has long been a tiny portion of wikipedias costs. I think Wikipedia even makes it easy to export all of its data, I don’t think AI scrapers would
by WatchDog 1y ago
Infrastructure has long been a tiny portion of wikipedias costs.
I think Wikipedia even makes it easy to export all of its data, I don’t think AI scrapers would be a significant new cost
- _def 1y agoThese are two very different cost factors. Scrapers don't use the available data dumps, that's why they scrape. They are also kind of dumb as they get lost in link structures constantly, which leads to unecessary traffic spikes.