3 ms·
That makes sense, and I believe you, I'm just surprised it really deters the scrapers.
by frollogaston 5mo ago
That makes sense, and I believe you, I'm just surprised it really deters the scrapers.
- xena 5mo agoIf it's dumb and it works, is it really dumb?
- frollogaston 5mo agoNo it's not dumb, but I don't get how it manages to be so light still. Like I visit an Anubis-guarded site and barely have to wait. Scrapers really see that little CPU usage or wall time and back off? Or maybe that's just cause I'm not visiting sites that are under attack.
- saintfire 5mo agoIt chooses the challenge weight based on signals. If your phone looks like a phone from a residential IP you get a simple challenge. If you then spam requests you might get another, harder, hallenge appear. If you have a data center IP and look like bot traffic you get a hard challenge out the gate. AFAIU after looking at their docs several months ago.
- frollogaston 5mo agoAh, knowing the type of IP is really advantageous by itself