4 ms·
I've been fighting tailor made bots for over 15 years, and I can't say I'm a fan of people trying to circumvent it. In some cases it might not matter, but in ot
by NorwegianDude 3y ago
I've been fighting tailor made bots for over 15 years, and I can't say I'm a fan of people trying to circumvent it. In some cases it might not matter, but in others it can actually ruin a lot of things.
Let's say I have a few 100 Gbps connections that is mostly idle, is it fine if I direct them at browserless? No? Exactly, that kind of traffic is not wanted.
- codedokode 3y agoBrowserless could implement limits on their side, for example, allow only 1 parallel request to IP/domain. This way there will be no significant load, but the data will be scraped.
- thrwwycbr 3y agoAs if IPs matter in the golden age of IoT botnets and residential app malware. You can't even block the amount of subnets that's coming for you in a DDoS attack, thinking a human is able to keep up with something like this is pretty blindsighted and naive. The differentiation of network protocols and relay attacks alone is way too slow to be mitigated in most systems.
- meowface 3y agoThey're talking about rate limiting based on destination, not source.
- iamacyborg 3y agoIt’s all fun and games until you get a taste of your own medicine.