3 ms·
If you're writing a scraper, you should handle any http error code and back off. And if you want to get really pedantic, 429 didn't exist when we did this. It
by jedberg 7y ago
If you're writing a scraper, you should handle any http error code and back off.
And if you want to get really pedantic, 429 didn't exist when we did this. It wasn't approved until April 2012 and the first patches for it didn't show up until around 2014. We could have monkey patched if we really wanted to, but we didn't really want to.