4 ms·
Thanks to these technology laggards, a significant and growing number of Internet users are now participating in a sort of mix network [1] through their residen
by dhx 2y ago
Thanks to these technology laggards, a significant and growing number of Internet users are now participating in a sort of mix network [1] through their residential ISP or mobile carrier, who are using CGNAT/464XLAT at scale.
As a result it is easier to scrape a public website because the website would need to block legitimate users at the residential ISP or on the same mobile network, and this consequence is likely worse for the website than having to accept scraping. It's much harder for a website to determine that 100 requests/second from a single IPv4 address is a single user scraping away, or 100 customers each on their own phone/computer just wanting to use the website.
[1] https://en.wikipedia.org/wiki/Mix_network https://en.wikipedia.org/wiki/Mix_network