3 ms·

what would be great is if each agent was somehow able to obtain it's own ip address.

• kej 13y ago
  With IPv6 there's no reason you couldn't do this, but what is the use case? I'm not seeing what you could do with individually addressable agents that you couldn't do otherwise.
  • notastartup 13y ago
    Can you elaborate how one can do this with IPv6? What hosts have this? How many IP addresses can you get? Basically for web scraping. If you had multiple threads and each of them had separate IP addresses, you'd have a better chance than doing it with one IP address.
    • kej 13y ago
      Just about any host with IPv6 support will assign you a /64 block which is way more addresses than you'd need for this. Your case would then depend on the site you're scraping supporting IPv6, though.
      • AznHisoka 13y ago
        Not really. Websites can easily block scrapers from the same /64 block, so it doesn't matter if you got a 1000 different IPs.