4 ms·
How do you get around these retailers blocking your scrapers? Most of them are anti-bot mechanisms to prevent competitors from scraping their prices.
by altdataseller 5y ago
How do you get around these retailers blocking your scrapers? Most of them are anti-bot mechanisms to prevent competitors from scraping their prices.
- imdane 5y agoWe do a number of things that limit the data that needs to be scraped e.g. key off of sale patterns / pair sites that tend to have the same price. Beyond that we do simple things to space out and decentralize.