4 ms·
Browser extensions (either bespoke or existing content blockers) could be another way to deal with user-hostile sites. Unfortunately, with either approach, it b
by flyinghamster 3y ago
Browser extensions (either bespoke or existing content blockers) could be another way to deal with user-hostile sites. Unfortunately, with either approach, it becomes a cat-and-mouse game the second the extension or scraper becomes popular.
- ThatPlayer 3y agoThe site I'm scraping will also just deny users access to the content regularly. It's not even a per-user rate limit, but seems to be site-wide. Unless you pay. They've recently also started banning too many requests, so a simple refresh script I used to use no longer works. So what I need isn't just a simple content blocker, but also an auxiliary database, and maybe a browser extension to pull data from that source instead.