4 ms·
How Gab Deals With Scraping on the Open Web
- version_five 3y agoWhile not in the same league, I have a website and it's super easy to identify and if necessary block automated traffic that's requesting too much, which is basically what this person is saying. My site is so small that anyone who wants to is welcome to scrape it, but I have encountered misconfigured scraping that requests over and over again, and it's easy just to block those. No doubt this can be automated on a larger scale and it's something every website has to deal with. It appears (but could be speculation) that Twitter's limits are because they didn't pay their cloud bills. Just admitting that would almost be less embarrassing than saying they don't know how to deal with bots.