3 ms·
The site I'm scraping will also just deny users access to the content regularly. It's not even a per-user rate limit, but seems to be site-wide. Unless you pay.
by ThatPlayer 3y ago
The site I'm scraping will also just deny users access to the content regularly. It's not even a per-user rate limit, but seems to be site-wide. Unless you pay. They've recently also started banning too many requests, so a simple refresh script I used to use no longer works.
So what I need isn't just a simple content blocker, but also an auxiliary database, and maybe a browser extension to pull data from that source instead.