In my experience, these aren't the crawlers from legit companies, so they have infinite IPs via residential botnets/proxies. edit: 'nikcub beat me to it by 30

In my experience, these aren't the crawlers from legit companies, so they have infinite IPs via residential botnets/proxies. edit: 'nikcub beat me to it by 30 seconds :)