3 ms·
Yeah, HTTP should be a protocol that users can use freely (as long as they don't use it for Denial of Service). I don't see why I shouldn't be able to fetch a w
by tovej 5y ago
Yeah, HTTP should be a protocol that users can use freely (as long as they don't use it for Denial of Service). I don't see why I shouldn't be able to fetch a website, scrape it for information and reassemble that information in the way I want it to be presented.
- chii 5y ago> reassemble that information in the way I want it to be presented site owners want the advertising that was embedded to be seen and thus make revenue from it.
- megous 5y agoNot all of them, some just want to sell stuff, but make it positively terrible to search for things. Some site owners provide you service, like banks, or chat services like Slack, or Jira, but the user interface is again a turd. Some just publish info on a blog, but you can expect it to go away, so why not save it for later. Slack limits the amount of searchable messages to 10k, so if you save them regularly to local DB, you can search without limits. All kinds of owners don't sell/show ads, or care about scraping.