3 ms·
This looks to be complete nonsense. Scraping services work by going through thousands of intermediate proxies run on unsuspecting people's compromised computer
by threeseed 3y ago
This looks to be complete nonsense.
Scraping services work by going through thousands of intermediate proxies run on unsuspecting people's compromised computers. Each scraping request will be a unique IP with a normal looking header.
They may be able to look at the number of unique requests per account but given the ridiculous amount of spam/bots that exist clearly creating new accounts isn't an impediment.
The far more likely scenario is that they were throttled by AWS/GCP for not paying bills and are behind on their migration project.
- supsep2 3y agoSo all scrapers are viruses? Need to me.
- DistractionRect 3y agoAlmost all "residential" proxies are run without the knowledge of the user used as the proxy. Either it's slipped in the ToS/install of other legitimate product or straight up malware. A popular method, iirc, was bundling with free VPNs. Last I looked into the discussion, the consensus was there was no particularly reputable residential proxy service. Edit: I probably should explain the distinction for residential proxies. Basically, if you run a site that isn't B2B, you'll find basically no organic traffic comes from data centers/server farms. So traffic from IP blocks like owned by Microsoft (Azure), Amazon (AWS), Google (GCP), etc are all highly likely to be bot traffic and throttled or outright blocked by default. If you're running a scraper or a bot, you want to get your traffic to appear to come from residential IP blocks (owned by residential ISPs).