4 ms·
While not in the same league, I have a website and it's super easy to identify and if necessary block automated traffic that's requesting too much, which is bas
by version_five 3y ago
While not in the same league, I have a website and it's super easy to identify and if necessary block automated traffic that's requesting too much, which is basically what this person is saying.
My site is so small that anyone who wants to is welcome to scrape it, but I have encountered misconfigured scraping that requests over and over again, and it's easy just to block those. No doubt this can be automated on a larger scale and it's something every website has to deal with.
It appears (but could be speculation) that Twitter's limits are because they didn't pay their cloud bills. Just admitting that would almost be less embarrassing than saying they don't know how to deal with bots.