7 ms·
So, apply DOS/DDOS mitigations? You need to have those anyway, so you might as well use them for this too.
by a1369209993 7y ago
So, apply DOS/DDOS mitigations? You need to have those anyway, so you might as well use them for this too.
- sillyquiet 7y agoYeah, but where do you draw the line between 'oh sorry we dropped your request because of rate limiting' (or whatever mitigation strategy) and 'oh, we dropped your request because u scraping us bro' legally? IANAL, but this lawsuit seems to indicated that putting barriers in front of scraping attempts is a no-no.
- a1369209993 7y ago"You issued more than $X requests per $Y seconds. We don't care whether you're scraping or not; try again later." for any values of X and Y.