2 ms·
We've found coordinated attempts to scrape our pricing data. As the OP also found, they might have gotten away with it except for being greedy, setting up so ma
by CWuestefeld 10y ago
We've found coordinated attempts to scrape our pricing data. As the OP also found, they might have gotten away with it except for being greedy, setting up so many requesters that it affected our site performance and we went to investigate. The trail didn't go directly to a competitor, but to a service that actually specializes in providing price comparison data. Some additional circumstantial evidence led us to believe that they were working on behalf of one of our competitors specifically.
We also had the idea to feed them fake pricing, but in the end our CTO thought it better to just play it straight, so we built a way to identify certain fingerprints of their requests (I don't want to say what, publicly), and blacklist any offending IP addresses for several hours.