3 ms·
> they're not going to re-scrape the content they already have That's true for static content, but much of it is forums and other places like that where the ma
by int_19h 1y ago
> they're not going to re-scrape the content they already have
That's true for static content, but much of it is forums and other places like that where the main value is that new content is constantly generated - but needs to be re-scraped.
- a96 1y agoIf only sites agreed on putting a machine readable URL somewhere that lists all items by date. Like a site summary or a syndication stream. And maybe like a "map" of a static site. It would be so easy to share their updates with other interested systems.
- int_19h 1y agoWhy should they agree to make life even easier for people doing something they don't want?
- TeMPOraL 1y agoYou've summarized the main problem with the Internet for the past 2+ decades. Everyone thinks they're a master fisher, and gets up in arms about those pesky users not acting dumb fish, instead trying to eat the content bait without biting the monetization hook.