4 ms·
Do the AI labs in the U.S. publish the AWS IP address sets that their crawlers use? Is that not an effective way to block those crawlers anymore?
by tailrecursion 2mo ago
Do the AI labs in the U.S. publish the AWS IP address sets that their crawlers use? Is that not an effective way to block those crawlers anymore?
- theragra 2mo agoThey are often from residential IP.there are even businesses that allow you renting such IPs
- weird-eye-issue 2mo agoNobody serious would ever use an AWS IP lol